Building

Started building at 2021/12/24 09:48:12
Calculating base
Updating mirror
Basing run on 7.1.0-1979 900774ee0
Updating tree for run 24.12.2021-09.48
gocb is at 635fa6c, changes since last good build: none
libcouchbase is at f6822fc, changes since last good build: none
indexing is at 8d3522b, changes since last good build: none
kv_engine is at cda4d73, changes since last good build: none
ns_server is at fadbef1, changes since last good build: 
 fadbef1bc MB-49954: Fix to race between initial map creation and rename of node.
 95b9b978b Merge remote-tracking branch 'couchbase/cheshire-cat'
 5dceb5022 MB-50198 Merge remote-tracking branch 'couchbase/mad-hatter'
 f1a694cf9 MB-33456 Remove last vestiges of moxi
 1e39487c1 MB-50198 Don't use "X-Forwarded-For" header when determining peer
couchstore is at 0bf3a4b, changes since last good build: none
couchdb is at fca2e6b, changes since last good build: none
testrunner is at a23e488, changes since last good build: none
Switching eventing to unstable
eventing is at ee5930d, changes since last good build: none
Switching eventing-ee to unstable
eventing-ee is at 8fcd80e, changes since last good build: none
Pulling in uncommitted change 160397 at refs/changes/97/160397/3
Total 23 (delta 15), reused 17 (delta 15)
[unstable 5c666ae0] MB-100 : Do not fail n1ql timeout test if we are catching timeout exceptions successfully
 Author: abhijpes 
 Date: Mon Aug 30 08:24:38 2021 +0530
 1 file changed, 2 insertions(+), 2 deletions(-)
Pulling in uncommitted change 163449 at refs/changes/49/163449/1
Total 48 (delta 27), reused 39 (delta 27)
[unstable 29c46656] MB-100: collect data when test fails
 Author: AnkitPrabhu 
 Date: Tue Oct 12 14:02:31 2021 +0530
 1 file changed, 2 insertions(+)
Pulling in uncommitted change 166698 at refs/changes/98/166698/3
Total 4 (delta 3), reused 4 (delta 3)
[unstable ef0a92cf] MB-48334 : Fail rebalance unless all functions deployed on current encryption level
 Author: abhijpes 
 Date: Wed Dec 1 14:51:29 2021 +0530
 1 file changed, 9 insertions(+)
Building cmakefiles and deps
Building main product

Testing

Started testing at 2021/12/24 10:02:48
Testing mode: rebalance,n1ql,functional
Starting server
Starting server: attempt 1

Functional tests

2021/12/24 10:04:19 Started functional
Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:51988->127.0.0.1:9000: read: connection reset by peer
Quota setup Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:51988->127.0.0.1:9000: read: connection reset by peer
2021/12/24 10:04:28 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/24 10:04:33 Error in adding nodes : , response: {"otpNode":"n_1@127.0.0.1"}
2021/12/24 10:04:33 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 10:04:39 Removing node(s): [] from the cluster
2021/12/24 10:04:44 Rebalance progress: 0
2021/12/24 10:04:49 Rebalance progress: 0.2170138888888889
2021/12/24 10:04:54 Rebalance progress: 4.8828125
2021/12/24 10:04:59 Rebalance progress: 9.25925925925926
2021/12/24 10:05:04 Rebalance progress: 12.89424189814815
2021/12/24 10:05:09 Rebalance progress: 17.6685474537037
2021/12/24 10:05:14 Rebalance progress: 21.01417824074074
2021/12/24 10:05:19 Rebalance progress: 25.67997685185185
2021/12/24 10:05:24 Rebalance progress: 100
2021/12/24 10:05:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:05:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:05:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:06:12 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:06:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:06:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:06:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:07:12 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:07:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:07:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:07:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:08:12 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:08:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:08:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:08:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:09:12 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:09:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:09:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 10:09:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
=== RUN   TestAdvancedGetOps
2021/12/24 10:10:14 Deploying app: TestAdvancedGetOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:10:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps stored in temp store"
}
2021/12/24 10:10:21 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/24 10:10:26 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/24 10:10:31 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/24 10:10:36 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/24 10:10:36 App: TestAdvancedGetOps got deployed
2021/12/24 10:10:36 Starting bucket ops to source bucket
2021/12/24 10:10:41 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 10:10:46 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/24 10:10:46 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 10:10:46 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:10:46 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:10:51 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/24 10:10:56 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/24 10:11:01 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/24 10:11:06 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/24 10:11:06 App: TestAdvancedGetOps got un-deployed
2021/12/24 10:11:06 No eventing-con process running
2021/12/24 10:11:06 Function: TestAdvancedGetOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps deleting in background"
}
2021/12/24 10:11:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:11:18 Waiting for dst bucket item count to get to: 0 curr count: 56
2021/12/24 10:11:23 Waiting for dst bucket item count to get to: 0 curr count: 6
2021/12/24 10:11:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:11:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:11:35 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:11:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedGetOps (80.13s)
=== RUN   TestAdvancedInsertOps
2021/12/24 10:11:35 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:11:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2021/12/24 10:11:41 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 10:11:46 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 10:11:51 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 10:11:56 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 10:11:56 App: TestAdvancedInsertOps got deployed
2021/12/24 10:11:56 Starting bucket ops to source bucket
2021/12/24 10:12:02 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/24 10:12:02 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/24 10:12:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:12:02 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:12:07 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 10:12:12 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 10:12:17 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 10:12:22 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 10:12:22 App: TestAdvancedInsertOps got un-deployed
2021/12/24 10:12:22 No eventing-con process running
2021/12/24 10:12:22 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2021/12/24 10:12:24 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:12:34 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 10:12:39 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/24 10:12:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:12:40 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:12:50 Waiting for dst bucket item count to get to: 0 curr count: 788
2021/12/24 10:12:55 Waiting for dst bucket item count to get to: 0 curr count: 788
2021/12/24 10:12:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:12:55 Testing insert operation on source bucket
2021/12/24 10:12:55 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:12:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2021/12/24 10:13:02 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 10:13:07 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 10:13:12 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 10:13:17 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 10:13:17 App: TestAdvancedInsertOps got deployed
2021/12/24 10:13:17 Starting bucket ops to source bucket
2021/12/24 10:13:22 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/24 10:13:27 Waiting for dst bucket item count to get to: 2048 curr count: 1731
2021/12/24 10:13:32 Waiting for dst bucket item count to get to: 2048 curr count: 1731
2021/12/24 10:13:32 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/24 10:13:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:13:33 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:13:38 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 10:13:43 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 10:13:48 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 10:13:53 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 10:13:53 App: TestAdvancedInsertOps got un-deployed
2021/12/24 10:13:53 No eventing-con process running
2021/12/24 10:13:53 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2021/12/24 10:13:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:14:04 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/24 10:14:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:14:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:14:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertOps (156.67s)
=== RUN   TestAdvancedUpsertOps
2021/12/24 10:14:11 Starting bucket ops to source bucket
2021/12/24 10:14:12 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:14:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2021/12/24 10:14:18 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 10:14:23 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 10:14:28 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 10:14:33 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 10:14:33 App: TestAdvancedUpsertOps got deployed
2021/12/24 10:14:33 Starting bucket ops to source bucket
2021/12/24 10:14:39 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 10:14:44 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 10:14:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:14:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:14:44 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:14:49 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 10:14:54 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 10:14:59 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 10:15:04 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 10:15:04 App: TestAdvancedUpsertOps got un-deployed
2021/12/24 10:15:04 No eventing-con process running
2021/12/24 10:15:04 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2021/12/24 10:15:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:15:16 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 10:15:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:15:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:15:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:15:23 Testing upsert operation on source bucket
2021/12/24 10:15:23 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:15:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2021/12/24 10:15:29 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 10:15:34 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 10:15:39 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 10:15:44 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 10:15:44 App: TestAdvancedUpsertOps got deployed
2021/12/24 10:15:44 Starting bucket ops to source bucket
2021/12/24 10:15:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:15:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:15:45 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:15:50 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 10:15:55 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 10:16:00 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 10:16:05 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 10:16:05 App: TestAdvancedUpsertOps got un-deployed
2021/12/24 10:16:05 No eventing-con process running
2021/12/24 10:16:05 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2021/12/24 10:16:07 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:16:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:16:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:16:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedUpsertOps (127.98s)
=== RUN   TestAdvancedReplaceOps
2021/12/24 10:16:19 Starting bucket ops to source bucket
2021/12/24 10:16:20 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:16:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2021/12/24 10:16:26 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 10:16:31 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 10:16:36 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 10:16:41 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 10:16:41 App: TestAdvancedReplaceOps got deployed
2021/12/24 10:16:41 Starting bucket ops to source bucket
2021/12/24 10:16:47 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 10:16:52 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 10:16:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:16:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:16:52 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:16:57 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 10:17:02 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 10:17:08 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 10:17:13 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 10:17:13 App: TestAdvancedReplaceOps got un-deployed
2021/12/24 10:17:13 No eventing-con process running
2021/12/24 10:17:13 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2021/12/24 10:17:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:17:24 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 10:17:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:17:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:17:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:17:31 Testing upsert operation on source bucket
2021/12/24 10:17:31 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:17:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2021/12/24 10:17:37 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 10:17:42 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 10:17:47 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 10:17:52 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 10:17:52 App: TestAdvancedReplaceOps got deployed
2021/12/24 10:17:52 Starting bucket ops to source bucket
2021/12/24 10:17:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:17:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:17:53 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:17:58 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 10:18:03 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 10:18:08 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 10:18:13 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 10:18:13 App: TestAdvancedReplaceOps got un-deployed
2021/12/24 10:18:13 No eventing-con process running
2021/12/24 10:18:13 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2021/12/24 10:18:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:18:25 Waiting for dst bucket item count to get to: 0 curr count: 398
2021/12/24 10:18:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:18:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:18:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedReplaceOps (132.75s)
=== RUN   TestAdvancedDeleteOps
2021/12/24 10:18:32 Starting bucket ops to source bucket
2021/12/24 10:18:32 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:18:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2021/12/24 10:18:38 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 10:18:43 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 10:18:48 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 10:18:53 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 10:18:53 App: TestAdvancedDeleteOps got deployed
2021/12/24 10:18:53 Starting bucket ops to source bucket
2021/12/24 10:18:58 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:19:03 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:19:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:19:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:19:03 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:19:08 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 10:19:13 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 10:19:18 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 10:19:23 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 10:19:23 App: TestAdvancedDeleteOps got un-deployed
2021/12/24 10:19:23 No eventing-con process running
2021/12/24 10:19:24 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2021/12/24 10:19:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:19:35 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:19:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:19:37 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:19:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:19:42 Testing delete operation on source bucket
2021/12/24 10:19:42 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:19:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2021/12/24 10:19:48 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 10:19:53 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 10:19:58 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 10:20:03 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 10:20:03 App: TestAdvancedDeleteOps got deployed
2021/12/24 10:20:03 Starting bucket ops to source bucket
2021/12/24 10:20:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:20:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:20:03 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:20:08 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 10:20:13 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 10:20:18 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 10:20:23 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 10:20:23 App: TestAdvancedDeleteOps got un-deployed
2021/12/24 10:20:23 No eventing-con process running
2021/12/24 10:20:23 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2021/12/24 10:20:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:20:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:20:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:20:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedDeleteOps (125.53s)
=== RUN   TestEnoentAdvancedGet
2021/12/24 10:20:37 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:20:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2021/12/24 10:20:44 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 10:20:49 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 10:20:54 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 10:20:59 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 10:20:59 App: TestEnoentAdvancedGet got deployed
2021/12/24 10:20:59 Starting bucket ops to source bucket
2021/12/24 10:21:04 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 10:21:09 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/24 10:21:09 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 10:21:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:21:09 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:21:14 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 10:21:19 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 10:21:24 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 10:21:29 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 10:21:29 App: TestEnoentAdvancedGet got un-deployed
2021/12/24 10:21:29 No eventing-con process running
2021/12/24 10:21:29 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2021/12/24 10:21:31 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:21:41 Waiting for dst bucket item count to get to: 0 curr count: 92
2021/12/24 10:21:46 Waiting for dst bucket item count to get to: 0 curr count: 92
2021/12/24 10:21:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:21:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:21:57 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:21:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:21:57 Testing get enoent operation on source bucket
2021/12/24 10:21:57 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:21:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2021/12/24 10:22:04 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 10:22:09 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 10:22:14 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 10:22:19 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 10:22:19 App: TestEnoentAdvancedGet got deployed
2021/12/24 10:22:19 Starting bucket ops to source bucket
2021/12/24 10:22:24 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/24 10:22:29 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/24 10:22:29 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/24 10:22:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:22:29 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:22:34 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 10:22:39 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 10:22:44 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 10:22:49 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 10:22:49 App: TestEnoentAdvancedGet got un-deployed
2021/12/24 10:22:49 No eventing-con process running
2021/12/24 10:22:49 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2021/12/24 10:22:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:23:01 Waiting for dst bucket item count to get to: 0 curr count: 186
2021/12/24 10:23:06 Waiting for dst bucket item count to get to: 0 curr count: 186
2021/12/24 10:23:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:23:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:23:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedGet (155.03s)
=== RUN   TestEnoentAdvancedReplace
2021/12/24 10:23:13 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:23:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2021/12/24 10:23:19 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 10:23:24 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 10:23:29 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 10:23:34 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 10:23:34 App: TestEnoentAdvancedReplace got deployed
2021/12/24 10:23:34 Starting bucket ops to source bucket
2021/12/24 10:23:39 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 10:23:44 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/24 10:23:44 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 10:23:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:23:44 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:23:49 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 10:23:54 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 10:23:59 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 10:24:04 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 10:24:04 App: TestEnoentAdvancedReplace got un-deployed
2021/12/24 10:24:04 No eventing-con process running
2021/12/24 10:24:04 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2021/12/24 10:24:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:24:16 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:24:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:24:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:24:27 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:24:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:24:27 Testing get enoent operation on source bucket
2021/12/24 10:24:27 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:24:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2021/12/24 10:24:34 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 10:24:39 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 10:24:44 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 10:24:49 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 10:24:49 App: TestEnoentAdvancedReplace got deployed
2021/12/24 10:24:49 Starting bucket ops to source bucket
2021/12/24 10:24:54 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/24 10:24:59 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/24 10:24:59 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/24 10:24:59 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:24:59 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:25:04 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 10:25:09 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 10:25:14 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 10:25:19 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 10:25:19 App: TestEnoentAdvancedReplace got un-deployed
2021/12/24 10:25:19 No eventing-con process running
2021/12/24 10:25:19 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2021/12/24 10:25:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:25:31 Waiting for dst bucket item count to get to: 0 curr count: 186
2021/12/24 10:25:36 Waiting for dst bucket item count to get to: 0 curr count: 186
2021/12/24 10:25:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:25:37 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:25:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedReplace (149.91s)
=== RUN   TestEnoentAdvancedDelete
2021/12/24 10:25:42 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:25:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2021/12/24 10:25:49 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 10:25:54 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 10:25:59 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 10:26:04 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 10:26:04 App: TestEnoentAdvancedDelete got deployed
2021/12/24 10:26:04 Starting bucket ops to source bucket
2021/12/24 10:26:09 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 10:26:14 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/24 10:26:14 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 10:26:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:26:14 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:26:19 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 10:26:24 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 10:26:29 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 10:26:34 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 10:26:34 App: TestEnoentAdvancedDelete got un-deployed
2021/12/24 10:26:34 No eventing-con process running
2021/12/24 10:26:34 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2021/12/24 10:26:36 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:26:46 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:26:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:26:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:26:57 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:26:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:26:57 Testing get enoent operation on source bucket
2021/12/24 10:26:57 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:26:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2021/12/24 10:27:04 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 10:27:09 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 10:27:14 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 10:27:19 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 10:27:19 App: TestEnoentAdvancedDelete got deployed
2021/12/24 10:27:19 Starting bucket ops to source bucket
2021/12/24 10:27:24 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/24 10:27:29 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/24 10:27:29 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/24 10:27:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:27:29 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:27:34 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 10:27:39 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 10:27:44 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 10:27:49 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 10:27:49 App: TestEnoentAdvancedDelete got un-deployed
2021/12/24 10:27:49 No eventing-con process running
2021/12/24 10:27:49 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2021/12/24 10:27:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:28:01 Waiting for dst bucket item count to get to: 0 curr count: 177
2021/12/24 10:28:06 Waiting for dst bucket item count to get to: 0 curr count: 177
2021/12/24 10:28:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:28:07 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:28:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedDelete (150.01s)
=== RUN   TestAdvancedInsertKeyExist
2021/12/24 10:28:12 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:28:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2021/12/24 10:28:19 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 10:28:24 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 10:28:29 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 10:28:34 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 10:28:34 App: TestAdvancedInsertKeyExist got deployed
2021/12/24 10:28:34 Starting bucket ops to source bucket
2021/12/24 10:28:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:28:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:28:34 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:28:39 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 10:28:44 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 10:28:49 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 10:28:54 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 10:28:54 App: TestAdvancedInsertKeyExist got un-deployed
2021/12/24 10:28:54 No eventing-con process running
2021/12/24 10:28:54 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2021/12/24 10:28:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:29:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:29:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:29:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:29:08 Pumping document in the destination bucket
2021/12/24 10:29:08 Starting bucket ops to source bucket
2021/12/24 10:29:08 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:29:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2021/12/24 10:29:14 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 10:29:19 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 10:29:24 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 10:29:29 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 10:29:29 App: TestAdvancedInsertKeyExist got deployed
2021/12/24 10:29:29 Starting bucket ops to source bucket
2021/12/24 10:29:35 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:29:40 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:29:45 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:29:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:29:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:29:45 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:29:50 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 10:29:55 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 10:30:00 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 10:30:05 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 10:30:05 App: TestAdvancedInsertKeyExist got un-deployed
2021/12/24 10:30:05 No eventing-con process running
2021/12/24 10:30:05 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2021/12/24 10:30:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:30:16 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:30:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:30:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:30:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertKeyExist (130.71s)
=== RUN   TestExipryGet
2021/12/24 10:30:23 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:30:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2021/12/24 10:30:29 Waiting for app: TestExipryGet to get deployed
2021/12/24 10:30:34 Waiting for app: TestExipryGet to get deployed
2021/12/24 10:30:39 Waiting for app: TestExipryGet to get deployed
2021/12/24 10:30:44 Waiting for app: TestExipryGet to get deployed
2021/12/24 10:30:44 App: TestExipryGet got deployed
2021/12/24 10:30:44 Starting bucket ops to source bucket
2021/12/24 10:31:30 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:31:35 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:31:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:31:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:31:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:31:40 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 10:31:45 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 10:31:50 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 10:31:55 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 10:31:55 App: TestExipryGet got un-deployed
2021/12/24 10:31:55 No eventing-con process running
2021/12/24 10:31:55 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2021/12/24 10:31:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:32:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:32:04 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:32:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:32:09 Pumping document in the destination bucket for expiry get
2021/12/24 10:32:09 Starting bucket ops to source bucket
2021/12/24 10:32:09 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:32:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2021/12/24 10:32:15 Waiting for app: TestExipryGet to get deployed
2021/12/24 10:32:20 Waiting for app: TestExipryGet to get deployed
2021/12/24 10:32:25 Waiting for app: TestExipryGet to get deployed
2021/12/24 10:32:30 Waiting for app: TestExipryGet to get deployed
2021/12/24 10:32:30 App: TestExipryGet got deployed
2021/12/24 10:32:30 Starting bucket ops to source bucket
2021/12/24 10:33:15 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:33:20 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:33:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:33:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:33:20 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:33:25 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 10:33:30 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 10:33:35 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 10:33:41 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 10:33:41 App: TestExipryGet got un-deployed
2021/12/24 10:33:41 No eventing-con process running
2021/12/24 10:33:41 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2021/12/24 10:33:42 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:33:52 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:33:57 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:33:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:33:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:34:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryGet (220.89s)
=== RUN   TestExipryInsert
2021/12/24 10:34:04 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:34:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2021/12/24 10:34:10 Waiting for app: TestExipryInsert to get deployed
2021/12/24 10:34:15 Waiting for app: TestExipryInsert to get deployed
2021/12/24 10:34:20 Waiting for app: TestExipryInsert to get deployed
2021/12/24 10:34:25 Waiting for app: TestExipryInsert to get deployed
2021/12/24 10:34:25 App: TestExipryInsert got deployed
2021/12/24 10:34:25 Starting bucket ops to source bucket
2021/12/24 10:35:11 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:35:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:35:11 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:35:11 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:35:16 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 10:35:21 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 10:35:26 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 10:35:31 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 10:35:31 App: TestExipryInsert got un-deployed
2021/12/24 10:35:31 No eventing-con process running
2021/12/24 10:35:31 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2021/12/24 10:35:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:35:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:35:40 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:35:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:35:45 Testing on the destination bucket for expiry insert
2021/12/24 10:35:45 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:35:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2021/12/24 10:35:51 Waiting for app: TestExipryInsert to get deployed
2021/12/24 10:35:56 Waiting for app: TestExipryInsert to get deployed
2021/12/24 10:36:01 Waiting for app: TestExipryInsert to get deployed
2021/12/24 10:36:06 Waiting for app: TestExipryInsert to get deployed
2021/12/24 10:36:06 App: TestExipryInsert got deployed
2021/12/24 10:36:06 Starting bucket ops to source bucket
2021/12/24 10:36:51 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:36:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:36:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:36:51 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:36:56 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 10:37:01 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 10:37:06 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 10:37:11 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 10:37:11 App: TestExipryInsert got un-deployed
2021/12/24 10:37:11 No eventing-con process running
2021/12/24 10:37:11 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2021/12/24 10:37:13 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:37:23 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:37:28 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:37:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:37:30 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:37:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryInsert (210.56s)
=== RUN   TestExipryReplace
2021/12/24 10:37:35 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:37:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2021/12/24 10:37:41 Waiting for app: TestExipryReplace to get deployed
2021/12/24 10:37:46 Waiting for app: TestExipryReplace to get deployed
2021/12/24 10:37:51 Waiting for app: TestExipryReplace to get deployed
2021/12/24 10:37:56 Waiting for app: TestExipryReplace to get deployed
2021/12/24 10:37:56 App: TestExipryReplace got deployed
2021/12/24 10:37:56 Starting bucket ops to source bucket
2021/12/24 10:38:41 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:38:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:38:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:38:41 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:38:46 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 10:38:51 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 10:38:56 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 10:39:01 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 10:39:01 App: TestExipryReplace got un-deployed
2021/12/24 10:39:01 No eventing-con process running
2021/12/24 10:39:01 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2021/12/24 10:39:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:39:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:39:10 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:39:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:39:15 Testing on the destination bucket for expiry insert
2021/12/24 10:39:15 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:39:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2021/12/24 10:39:21 Waiting for app: TestExipryReplace to get deployed
2021/12/24 10:39:26 Waiting for app: TestExipryReplace to get deployed
2021/12/24 10:39:31 Waiting for app: TestExipryReplace to get deployed
2021/12/24 10:39:36 Waiting for app: TestExipryReplace to get deployed
2021/12/24 10:39:36 App: TestExipryReplace got deployed
2021/12/24 10:39:36 Starting bucket ops to source bucket
2021/12/24 10:40:22 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:40:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:40:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:40:22 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:40:27 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 10:40:32 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 10:40:37 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 10:40:42 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 10:40:42 App: TestExipryReplace got un-deployed
2021/12/24 10:40:42 No eventing-con process running
2021/12/24 10:40:42 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2021/12/24 10:40:43 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:40:53 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:40:58 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:40:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:41:00 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:41:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryReplace (210.62s)
=== RUN   TestExipryUpsert
2021/12/24 10:41:05 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:41:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2021/12/24 10:41:11 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 10:41:16 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 10:41:21 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 10:41:26 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 10:41:26 App: TestExipryUpsert got deployed
2021/12/24 10:41:26 Starting bucket ops to source bucket
2021/12/24 10:42:12 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:42:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:42:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:42:12 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:42:17 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 10:42:22 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 10:42:27 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 10:42:32 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 10:42:32 App: TestExipryUpsert got un-deployed
2021/12/24 10:42:32 No eventing-con process running
2021/12/24 10:42:32 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2021/12/24 10:42:33 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:42:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:42:41 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:42:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:42:46 Testing on the destination bucket for expiry insert
2021/12/24 10:42:46 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:42:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2021/12/24 10:42:52 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 10:42:57 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 10:43:02 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 10:43:07 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 10:43:07 App: TestExipryUpsert got deployed
2021/12/24 10:43:07 Starting bucket ops to source bucket
2021/12/24 10:43:52 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:43:57 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:44:02 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:44:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:44:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:44:02 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:44:07 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 10:44:12 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 10:44:17 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 10:44:22 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 10:44:22 App: TestExipryUpsert got un-deployed
2021/12/24 10:44:22 No eventing-con process running
2021/12/24 10:44:22 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2021/12/24 10:44:24 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:44:34 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:44:39 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:44:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:44:41 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:44:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryUpsert (220.70s)
=== RUN   TestCasReplace
2021/12/24 10:44:46 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:44:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2021/12/24 10:44:52 Waiting for app: TestCasReplace to get deployed
2021/12/24 10:44:57 Waiting for app: TestCasReplace to get deployed
2021/12/24 10:45:02 Waiting for app: TestCasReplace to get deployed
2021/12/24 10:45:07 Waiting for app: TestCasReplace to get deployed
2021/12/24 10:45:07 App: TestCasReplace got deployed
2021/12/24 10:45:07 Starting bucket ops to source bucket
2021/12/24 10:45:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:45:07 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:45:07 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:45:12 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 10:45:17 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 10:45:22 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 10:45:27 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 10:45:28 App: TestCasReplace got un-deployed
2021/12/24 10:45:28 No eventing-con process running
2021/12/24 10:45:28 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2021/12/24 10:45:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:45:39 Waiting for dst bucket item count to get to: 0 curr count: 10
2021/12/24 10:45:44 Waiting for dst bucket item count to get to: 0 curr count: 7
2021/12/24 10:45:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:45:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:45:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:45:51 Testing on the destination bucket for upsert with cas
2021/12/24 10:45:51 Starting bucket ops to source bucket
2021/12/24 10:45:51 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:45:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2021/12/24 10:45:57 Waiting for app: TestCasReplace to get deployed
2021/12/24 10:46:02 Waiting for app: TestCasReplace to get deployed
2021/12/24 10:46:07 Waiting for app: TestCasReplace to get deployed
2021/12/24 10:46:12 Waiting for app: TestCasReplace to get deployed
2021/12/24 10:46:12 App: TestCasReplace got deployed
2021/12/24 10:46:12 Starting bucket ops to source bucket
2021/12/24 10:46:17 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:46:23 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:46:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:46:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:46:23 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:46:28 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 10:46:33 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 10:46:38 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 10:46:43 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 10:46:43 App: TestCasReplace got un-deployed
2021/12/24 10:46:43 No eventing-con process running
2021/12/24 10:46:43 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2021/12/24 10:46:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:46:54 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:46:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:46:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:47:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasReplace (135.17s)
=== RUN   TestCasDelete
2021/12/24 10:47:01 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:47:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2021/12/24 10:47:07 Waiting for app: TestCasDelete to get deployed
2021/12/24 10:47:12 Waiting for app: TestCasDelete to get deployed
2021/12/24 10:47:17 Waiting for app: TestCasDelete to get deployed
2021/12/24 10:47:22 Waiting for app: TestCasDelete to get deployed
2021/12/24 10:47:22 App: TestCasDelete got deployed
2021/12/24 10:47:22 Starting bucket ops to source bucket
2021/12/24 10:47:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:47:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:47:22 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:47:28 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 10:47:33 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 10:47:38 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 10:47:43 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 10:47:43 App: TestCasDelete got un-deployed
2021/12/24 10:47:43 No eventing-con process running
2021/12/24 10:47:43 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2021/12/24 10:47:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:47:54 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/24 10:47:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:47:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:48:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:48:01 Testing on the destination bucket for delete with cas
2021/12/24 10:48:01 Starting bucket ops to source bucket
2021/12/24 10:48:01 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:48:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2021/12/24 10:48:07 Waiting for app: TestCasDelete to get deployed
2021/12/24 10:48:12 Waiting for app: TestCasDelete to get deployed
2021/12/24 10:48:17 Waiting for app: TestCasDelete to get deployed
2021/12/24 10:48:22 Waiting for app: TestCasDelete to get deployed
2021/12/24 10:48:22 App: TestCasDelete got deployed
2021/12/24 10:48:22 Starting bucket ops to source bucket
2021/12/24 10:48:28 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:48:33 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:48:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:48:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:48:33 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 10:48:38 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 10:48:43 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 10:48:48 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 10:48:53 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 10:48:53 App: TestCasDelete got un-deployed
2021/12/24 10:48:53 No eventing-con process running
2021/12/24 10:48:53 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2021/12/24 10:48:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:49:05 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 10:49:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:49:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:49:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasDelete (130.18s)
=== RUN   TestCountersIncrement
2021/12/24 10:49:11 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 10:49:17 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 10:49:17 Removing node(s): [] from the cluster
2021/12/24 10:49:22 Rebalance progress: 100
2021/12/24 10:49:22 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:49:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2021/12/24 10:49:29 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 10:49:34 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 10:49:39 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 10:49:44 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 10:49:44 App: TestCountersIncrement got deployed
2021/12/24 10:49:44 Starting bucket ops to source bucket
2021/12/24 10:49:50 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/24 10:49:55 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/24 10:49:55 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/24 10:49:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:50:00 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 10:50:05 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 10:50:10 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 10:50:15 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 10:50:15 App: TestCountersIncrement got un-deployed
2021/12/24 10:50:15 No eventing-con process running
2021/12/24 10:50:15 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2021/12/24 10:50:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:50:27 Waiting for dst bucket item count to get to: 0 curr count: 1025
2021/12/24 10:50:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:50:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:50:39 Waiting for dst bucket item count to get to: 0 curr count: 927
2021/12/24 10:50:44 Waiting for dst bucket item count to get to: 0 curr count: 415
2021/12/24 10:50:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:50:44 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:50:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2021/12/24 10:50:50 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 10:50:55 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 10:51:00 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 10:51:05 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 10:51:05 App: TestCountersIncrement got deployed
2021/12/24 10:51:05 Starting bucket ops to source bucket
2021/12/24 10:51:11 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/24 10:51:16 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/24 10:51:16 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/24 10:51:16 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:51:21 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 10:51:26 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 10:51:31 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 10:51:36 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 10:51:36 App: TestCountersIncrement got un-deployed
2021/12/24 10:51:36 No eventing-con process running
2021/12/24 10:51:36 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2021/12/24 10:51:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:51:48 Waiting for dst bucket item count to get to: 0 curr count: 1354
2021/12/24 10:51:53 Waiting for dst bucket item count to get to: 0 curr count: 330
2021/12/24 10:51:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:51:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:52:05 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/24 10:52:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:52:05 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2021/12/24 10:52:10 Rebalance progress: 100
--- PASS: TestCountersIncrement (178.57s)
=== RUN   TestCountersDecrement
2021/12/24 10:52:10 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 10:52:10 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 10:52:10 Removing node(s): [] from the cluster
2021/12/24 10:52:15 Rebalance progress: 100
2021/12/24 10:52:15 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:52:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2021/12/24 10:52:22 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 10:52:27 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 10:52:32 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 10:52:37 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 10:52:37 App: TestCountersDecrement got deployed
2021/12/24 10:52:37 Starting bucket ops to source bucket
2021/12/24 10:52:43 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/24 10:52:48 Waiting for dst bucket item count to get to: 1024 curr count: 773
2021/12/24 10:52:53 Waiting for dst bucket item count to get to: 1024 curr count: 773
2021/12/24 10:52:53 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/24 10:52:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:52:58 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 10:53:03 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 10:53:08 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 10:53:13 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 10:53:13 App: TestCountersDecrement got un-deployed
2021/12/24 10:53:13 No eventing-con process running
2021/12/24 10:53:13 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2021/12/24 10:53:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:53:25 Waiting for dst bucket item count to get to: 0 curr count: 1025
2021/12/24 10:53:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:53:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:53:36 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 10:53:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:53:36 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:53:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2021/12/24 10:53:43 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 10:53:48 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 10:53:53 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 10:53:58 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 10:53:58 App: TestCountersDecrement got deployed
2021/12/24 10:53:58 Starting bucket ops to source bucket
2021/12/24 10:54:04 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/24 10:54:09 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/24 10:54:14 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/24 10:54:14 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/24 10:54:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:54:19 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 10:54:24 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 10:54:29 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 10:54:34 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 10:54:34 App: TestCountersDecrement got un-deployed
2021/12/24 10:54:34 No eventing-con process running
2021/12/24 10:54:34 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2021/12/24 10:54:36 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:54:46 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/24 10:54:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:54:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:54:58 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/24 10:54:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:54:58 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2021/12/24 10:55:03 Rebalance progress: 100
--- PASS: TestCountersDecrement (172.99s)
=== RUN   TestCacheGet
2021/12/24 10:55:03 Deploying app: TestCacheGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:55:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet stored in temp store"
}
2021/12/24 10:55:09 Waiting for app: TestCacheGet to get deployed
2021/12/24 10:55:14 Waiting for app: TestCacheGet to get deployed
2021/12/24 10:55:19 Waiting for app: TestCacheGet to get deployed
2021/12/24 10:55:24 Waiting for app: TestCacheGet to get deployed
2021/12/24 10:55:24 App: TestCacheGet got deployed
2021/12/24 10:55:24 Starting bucket ops to source bucket
2021/12/24 10:55:29 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/24 10:55:34 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/24 10:55:39 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/24 10:55:44 Waiting for dst bucket item count to get to: 20 curr count: 8
2021/12/24 10:55:49 Waiting for dst bucket item count to get to: 20 curr count: 16
2021/12/24 10:55:54 Waiting for dst bucket item count to get to: 20 curr count: 18
2021/12/24 10:55:54 src & dst bucket item count matched up. src bucket count: 20 dst bucket count: 20
2021/12/24 10:55:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:55:59 Waiting for app: TestCacheGet to get un-deployed
2021/12/24 10:56:05 Waiting for app: TestCacheGet to get un-deployed
2021/12/24 10:56:10 Waiting for app: TestCacheGet to get un-deployed
2021/12/24 10:56:15 Waiting for app: TestCacheGet to get un-deployed
2021/12/24 10:56:15 App: TestCacheGet got un-deployed
2021/12/24 10:56:15 No eventing-con process running
2021/12/24 10:56:15 Function: TestCacheGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet deleting in background"
}
2021/12/24 10:56:16 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:56:26 Waiting for dst bucket item count to get to: 0 curr count: 20
2021/12/24 10:56:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:56:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:56:38 Waiting for dst bucket item count to get to: 0 curr count: 14
2021/12/24 10:56:43 Waiting for dst bucket item count to get to: 0 curr count: 4
2021/12/24 10:56:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheGet (100.35s)
=== RUN   TestCacheRYOW
2021/12/24 10:56:43 Deploying app: TestCacheRYOW. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:56:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW stored in temp store"
}
2021/12/24 10:56:49 Waiting for app: TestCacheRYOW to get deployed
2021/12/24 10:56:55 Waiting for app: TestCacheRYOW to get deployed
2021/12/24 10:57:00 Waiting for app: TestCacheRYOW to get deployed
2021/12/24 10:57:05 Waiting for app: TestCacheRYOW to get deployed
2021/12/24 10:57:05 App: TestCacheRYOW got deployed
2021/12/24 10:57:05 Starting bucket ops to source bucket
2021/12/24 10:57:10 Waiting for dst bucket item count to get to: 50 curr count: 0
2021/12/24 10:57:15 Waiting for dst bucket item count to get to: 50 curr count: 25
2021/12/24 10:57:15 src & dst bucket item count matched up. src bucket count: 50 dst bucket count: 50
2021/12/24 10:57:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:57:20 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/24 10:57:25 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/24 10:57:30 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/24 10:57:35 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/24 10:57:35 App: TestCacheRYOW got un-deployed
2021/12/24 10:57:35 No eventing-con process running
2021/12/24 10:57:35 Function: TestCacheRYOW delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW deleting in background"
}
2021/12/24 10:57:37 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:57:47 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:57:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:57:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:57:59 Waiting for dst bucket item count to get to: 0 curr count: 41
2021/12/24 10:58:04 Waiting for dst bucket item count to get to: 0 curr count: 16
2021/12/24 10:58:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheRYOW (80.37s)
=== RUN   TestCacheExpiry
2021/12/24 10:58:04 Deploying app: TestCacheExpiry. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:58:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry stored in temp store"
}
2021/12/24 10:58:10 Waiting for app: TestCacheExpiry to get deployed
2021/12/24 10:58:15 Waiting for app: TestCacheExpiry to get deployed
2021/12/24 10:58:20 Waiting for app: TestCacheExpiry to get deployed
2021/12/24 10:58:25 Waiting for app: TestCacheExpiry to get deployed
2021/12/24 10:58:25 App: TestCacheExpiry got deployed
2021/12/24 10:58:25 Starting bucket ops to source bucket
2021/12/24 10:58:30 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 10:58:35 Waiting for dst bucket item count to get to: 100 curr count: 14
2021/12/24 10:58:40 Waiting for dst bucket item count to get to: 100 curr count: 37
2021/12/24 10:58:45 Waiting for dst bucket item count to get to: 100 curr count: 72
2021/12/24 10:58:50 Waiting for dst bucket item count to get to: 100 curr count: 99
2021/12/24 10:58:50 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 10:58:50 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 10:58:55 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/24 10:59:00 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/24 10:59:05 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/24 10:59:10 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/24 10:59:10 App: TestCacheExpiry got un-deployed
2021/12/24 10:59:10 No eventing-con process running
2021/12/24 10:59:10 Function: TestCacheExpiry delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry deleting in background"
}
2021/12/24 10:59:12 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:59:22 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:59:27 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 10:59:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 10:59:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 10:59:39 Waiting for dst bucket item count to get to: 0 curr count: 98
2021/12/24 10:59:44 Waiting for dst bucket item count to get to: 0 curr count: 48
2021/12/24 10:59:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiry (100.34s)
=== RUN   TestCacheExpiryCustom
2021/12/24 10:59:44 Deploying app: TestCacheExpiryCustom. Item count src bucket: 0 dst bucket: 0
2021/12/24 10:59:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom stored in temp store"
}
2021/12/24 10:59:50 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/24 10:59:55 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/24 11:00:00 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/24 11:00:05 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/24 11:00:05 App: TestCacheExpiryCustom got deployed
2021/12/24 11:00:05 Starting bucket ops to source bucket
2021/12/24 11:00:10 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 11:00:15 Waiting for dst bucket item count to get to: 100 curr count: 19
2021/12/24 11:00:20 Waiting for dst bucket item count to get to: 100 curr count: 19
2021/12/24 11:00:25 Waiting for dst bucket item count to get to: 100 curr count: 94
2021/12/24 11:00:31 Waiting for dst bucket item count to get to: 100 curr count: 94
2021/12/24 11:00:31 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 11:00:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:00:36 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/24 11:00:41 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/24 11:00:46 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/24 11:00:51 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/24 11:00:51 App: TestCacheExpiryCustom got un-deployed
2021/12/24 11:00:51 No eventing-con process running
2021/12/24 11:00:51 Function: TestCacheExpiryCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom deleting in background"
}
2021/12/24 11:00:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:01:03 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 11:01:08 Waiting for dst bucket item count to get to: 0 curr count: 25
2021/12/24 11:01:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:01:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:01:19 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 11:01:24 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 11:01:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiryCustom (100.44s)
=== RUN   TestCacheOverflowCustom
2021/12/24 11:01:24 Deploying app: TestCacheOverflowCustom. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:01:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom stored in temp store"
}
2021/12/24 11:01:31 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/24 11:01:36 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/24 11:01:41 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/24 11:01:46 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/24 11:01:46 App: TestCacheOverflowCustom got deployed
2021/12/24 11:01:46 Starting bucket ops to source bucket
2021/12/24 11:01:51 Waiting for dst bucket item count to get to: 35 curr count: 0
2021/12/24 11:01:56 Waiting for dst bucket item count to get to: 35 curr count: 13
2021/12/24 11:02:01 Waiting for dst bucket item count to get to: 35 curr count: 13
2021/12/24 11:02:06 Waiting for dst bucket item count to get to: 35 curr count: 27
2021/12/24 11:02:11 Waiting for dst bucket item count to get to: 35 curr count: 27
2021/12/24 11:02:11 src & dst bucket item count matched up. src bucket count: 35 dst bucket count: 35
2021/12/24 11:02:11 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:02:16 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/24 11:02:21 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/24 11:02:26 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/24 11:02:31 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/24 11:02:31 App: TestCacheOverflowCustom got un-deployed
2021/12/24 11:02:31 No eventing-con process running
2021/12/24 11:02:31 Function: TestCacheOverflowCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom deleting in background"
}
2021/12/24 11:02:33 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:02:43 Waiting for dst bucket item count to get to: 0 curr count: 5
2021/12/24 11:02:48 Waiting for dst bucket item count to get to: 0 curr count: 3
2021/12/24 11:02:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:02:50 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:03:00 Waiting for dst bucket item count to get to: 0 curr count: 17
2021/12/24 11:03:05 Waiting for dst bucket item count to get to: 0 curr count: 17
2021/12/24 11:03:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheOverflowCustom (100.29s)
=== RUN   TestStrictMode
2021/12/24 11:03:05 Deploying app: TestStrictMode. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:03:06 Context: Post to main store, response code: 422 dump: {
 "name": "ERR_HANDLER_COMPILATION",
 "code": 27,
 "description": {
  "area": "handlerCode",
  "column_number": 63,
  "compile_success": false,
  "description": "        destination[meta.id] = 00000000000000000000000000000101;\n                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nSyntaxError: Octal literals are not allowed in strict mode.\n",
  "index": 132,
  "language": "JavaScript",
  "line_number": 4
 }
}
--- PASS: TestStrictMode (1.07s)
=== RUN   TestDataTypes
2021/12/24 11:03:06 Deploying app: TestDataTypes. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:03:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes stored in temp store"
}
2021/12/24 11:03:12 Waiting for app: TestDataTypes to get deployed
2021/12/24 11:03:17 Waiting for app: TestDataTypes to get deployed
2021/12/24 11:03:22 Waiting for app: TestDataTypes to get deployed
2021/12/24 11:03:27 Waiting for app: TestDataTypes to get deployed
2021/12/24 11:03:27 App: TestDataTypes got deployed
2021/12/24 11:03:27 Starting bucket ops to source bucket
2021/12/24 11:03:32 Waiting for dst bucket item count to get to: 18 curr count: 0
2021/12/24 11:03:32 src & dst bucket item count matched up. src bucket count: 18 dst bucket count: 18
2021/12/24 11:03:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:03:37 Waiting for app: TestDataTypes to get un-deployed
2021/12/24 11:03:42 Waiting for app: TestDataTypes to get un-deployed
2021/12/24 11:03:47 Waiting for app: TestDataTypes to get un-deployed
2021/12/24 11:03:52 Waiting for app: TestDataTypes to get un-deployed
2021/12/24 11:03:52 App: TestDataTypes got un-deployed
2021/12/24 11:03:52 No eventing-con process running
2021/12/24 11:03:52 Function: TestDataTypes delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes deleting in background"
}
2021/12/24 11:03:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:04:04 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/24 11:04:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:04:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:04:16 Waiting for dst bucket item count to get to: 0 curr count: 18
2021/12/24 11:04:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDataTypes (70.08s)
=== RUN   TestEnoentGet
2021/12/24 11:04:16 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:04:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2021/12/24 11:04:22 Waiting for app: TestEnoentGet to get deployed
2021/12/24 11:04:27 Waiting for app: TestEnoentGet to get deployed
2021/12/24 11:04:32 Waiting for app: TestEnoentGet to get deployed
2021/12/24 11:04:37 Waiting for app: TestEnoentGet to get deployed
2021/12/24 11:04:37 App: TestEnoentGet got deployed
2021/12/24 11:04:37 Starting bucket ops to source bucket
2021/12/24 11:04:42 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 11:04:42 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 11:04:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:04:47 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 11:04:52 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 11:04:57 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 11:05:02 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 11:05:02 App: TestEnoentGet got un-deployed
2021/12/24 11:05:02 No eventing-con process running
2021/12/24 11:05:02 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2021/12/24 11:05:04 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:05:14 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 11:05:19 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 11:05:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:05:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:05:31 Waiting for dst bucket item count to get to: 0 curr count: 99
2021/12/24 11:05:36 Waiting for dst bucket item count to get to: 0 curr count: 99
2021/12/24 11:05:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:05:36 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:05:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2021/12/24 11:05:42 Waiting for app: TestEnoentGet to get deployed
2021/12/24 11:05:47 Waiting for app: TestEnoentGet to get deployed
2021/12/24 11:05:52 Waiting for app: TestEnoentGet to get deployed
2021/12/24 11:05:57 Waiting for app: TestEnoentGet to get deployed
2021/12/24 11:05:57 App: TestEnoentGet got deployed
2021/12/24 11:05:57 Starting bucket ops to source bucket
2021/12/24 11:06:02 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 11:06:07 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/24 11:06:12 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/24 11:06:12 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 11:06:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:06:18 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 11:06:23 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 11:06:28 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 11:06:33 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 11:06:33 App: TestEnoentGet got un-deployed
2021/12/24 11:06:33 No eventing-con process running
2021/12/24 11:06:33 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2021/12/24 11:06:34 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:06:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 11:06:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:06:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:06:56 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 11:06:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentGet (160.48s)
=== RUN   TestEnoentDelete
2021/12/24 11:06:56 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:06:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2021/12/24 11:07:02 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 11:07:07 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 11:07:12 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 11:07:17 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 11:07:17 App: TestEnoentDelete got deployed
2021/12/24 11:07:17 Starting bucket ops to source bucket
2021/12/24 11:07:23 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 11:07:28 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/24 11:07:33 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/24 11:07:33 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 11:07:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:07:38 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 11:07:43 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 11:07:48 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 11:07:53 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 11:07:53 App: TestEnoentDelete got un-deployed
2021/12/24 11:07:53 No eventing-con process running
2021/12/24 11:07:53 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2021/12/24 11:07:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:08:05 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 11:08:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:08:07 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:08:17 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 11:08:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:08:17 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:08:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2021/12/24 11:08:23 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 11:08:28 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 11:08:33 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 11:08:38 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 11:08:38 App: TestEnoentDelete got deployed
2021/12/24 11:08:38 Starting bucket ops to source bucket
2021/12/24 11:08:43 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 11:08:48 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/24 11:08:53 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/24 11:08:53 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 11:08:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:08:58 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 11:09:03 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 11:09:08 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 11:09:13 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 11:09:13 App: TestEnoentDelete got un-deployed
2021/12/24 11:09:13 No eventing-con process running
2021/12/24 11:09:13 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2021/12/24 11:09:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:09:25 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 11:09:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:09:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:09:37 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 11:09:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentDelete (160.67s)
=== RUN   TestError
2021/12/24 11:09:47 Waiting for app: TestError to get un-deployed
2021/12/24 11:09:47 App: TestError got un-deployed
2021/12/24 11:09:47 No eventing-con process running
2021/12/24 11:09:47 Function: TestError delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestError not found"
}
2021/12/24 11:09:49 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:09:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:09:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:10:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:10:00 Deploying app: TestError. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:10:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError stored in temp store"
}
2021/12/24 11:10:07 Waiting for app: TestError to get deployed
2021/12/24 11:10:12 Waiting for app: TestError to get deployed
2021/12/24 11:10:17 Waiting for app: TestError to get deployed
2021/12/24 11:10:22 Waiting for app: TestError to get deployed
2021/12/24 11:10:22 App: TestError got deployed
2021/12/24 11:10:22 Starting bucket ops to source bucket
2021/12/24 11:10:27 Waiting for dst bucket item count to get to: 300 curr count: 0
2021/12/24 11:10:32 Waiting for dst bucket item count to get to: 300 curr count: 0
2021/12/24 11:10:32 src & dst bucket item count matched up. src bucket count: 300 dst bucket count: 300
2021/12/24 11:10:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:10:37 Waiting for app: TestError to get un-deployed
2021/12/24 11:10:42 Waiting for app: TestError to get un-deployed
2021/12/24 11:10:47 Waiting for app: TestError to get un-deployed
2021/12/24 11:10:52 Waiting for app: TestError to get un-deployed
2021/12/24 11:10:52 App: TestError got un-deployed
2021/12/24 11:10:52 No eventing-con process running
2021/12/24 11:10:52 Function: TestError delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError deleting in background"
}
2021/12/24 11:10:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:11:04 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 11:11:09 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 11:11:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:11:11 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:11:21 Waiting for dst bucket item count to get to: 0 curr count: 268
2021/12/24 11:11:26 Waiting for dst bucket item count to get to: 0 curr count: 268
2021/12/24 11:11:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestError (108.90s)
=== RUN   TestCRLF
2021/12/24 11:11:36 Waiting for app: TestCRLF to get un-deployed
2021/12/24 11:11:36 App: TestCRLF got un-deployed
2021/12/24 11:11:36 No eventing-con process running
2021/12/24 11:11:36 Function: TestCRLF delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCRLF not found"
}
2021/12/24 11:11:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:11:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:11:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:11:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:11:49 Deploying app: TestCRLF. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:11:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF stored in temp store"
}
2021/12/24 11:11:55 Waiting for app: TestCRLF to get deployed
2021/12/24 11:12:00 Waiting for app: TestCRLF to get deployed
2021/12/24 11:12:05 Waiting for app: TestCRLF to get deployed
2021/12/24 11:12:11 Waiting for app: TestCRLF to get deployed
2021/12/24 11:12:11 App: TestCRLF got deployed
2021/12/24 11:12:11 Starting bucket ops to source bucket
2021/12/24 11:12:16 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 11:12:21 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 11:12:21 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 11:12:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:12:26 Waiting for app: TestCRLF to get un-deployed
2021/12/24 11:12:31 Waiting for app: TestCRLF to get un-deployed
2021/12/24 11:12:36 Waiting for app: TestCRLF to get un-deployed
2021/12/24 11:12:41 Waiting for app: TestCRLF to get un-deployed
2021/12/24 11:12:41 App: TestCRLF got un-deployed
2021/12/24 11:12:41 No eventing-con process running
2021/12/24 11:12:41 Function: TestCRLF delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF deleting in background"
}
2021/12/24 11:12:43 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:12:53 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 11:12:58 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 11:12:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:13:00 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:13:10 Waiting for dst bucket item count to get to: 0 curr count: 48
2021/12/24 11:13:15 Waiting for dst bucket item count to get to: 0 curr count: 48
2021/12/24 11:13:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCRLF (108.87s)
=== RUN   TestImportExport
2021/12/24 11:13:25 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 11:13:25 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/24 11:13:25 No eventing-con process running
2021/12/24 11:13:25 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_n1ql_insert_on_update not found"
}
2021/12/24 11:13:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:13:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:13:33 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:13:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:13:43 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 11:13:43 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/24 11:13:43 No eventing-con process running
2021/12/24 11:13:43 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_bucket_op_on_update not found"
}
2021/12/24 11:13:45 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:13:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:13:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:13:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:13:57 Deploying app: TestImportExport_n1ql_insert_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:13:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update stored in temp store"
}
2021/12/24 11:13:58 Deploying app: TestImportExport_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:13:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update stored in temp store"
}
2021/12/24 11:14:04 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/24 11:14:09 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/24 11:14:14 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/24 11:14:19 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/24 11:14:19 App: TestImportExport_n1ql_insert_on_update got deployed
2021/12/24 11:14:24 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/24 11:14:29 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/24 11:14:34 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/24 11:14:34 App: TestImportExport_bucket_op_on_update got deployed
2021/12/24 11:14:39 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 11:14:44 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 11:14:49 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 11:14:54 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 11:14:54 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/24 11:14:54 No eventing-con process running
2021/12/24 11:14:55 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2021/12/24 11:15:00 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 11:15:05 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 11:15:10 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 11:15:15 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 11:15:15 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/24 11:15:15 No eventing-con process running
2021/12/24 11:15:15 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2021/12/24 11:15:32 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 11:15:32 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/24 11:15:32 No eventing-con process running
2021/12/24 11:15:32 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2021/12/24 11:15:34 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:15:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:15:41 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:15:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:15:51 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 11:15:51 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/24 11:15:51 No eventing-con process running
2021/12/24 11:15:51 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2021/12/24 11:15:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:15:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:15:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:16:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestImportExport (169.57s)
=== RUN   TestDeployUndeployLoopNonDefaultSettings
2021/12/24 11:16:14 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:16:14 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 11:16:14 No eventing-con process running
2021/12/24 11:16:14 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopNonDefaultSettings not found"
}
2021/12/24 11:16:16 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:16:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:16:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:16:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:16:28 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:16:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/24 11:16:29 Starting bucket ops to source bucket
2021/12/24 11:16:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:16:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:16:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:16:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:16:57 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/24 11:16:57 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:17:02 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/24 11:17:02 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/24 11:17:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:17:02 Undeploying app: bucket_op_on_update
2021/12/24 11:17:07 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:17:12 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:17:17 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:17:22 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:17:22 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 11:17:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:17:22 No eventing-con process running
2021/12/24 11:17:24 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:17:31 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:18:06 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:18:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/24 11:18:07 Starting bucket ops to source bucket
2021/12/24 11:18:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:18:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:18:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:18:30 Waiting for dst bucket item count to get to: 5000 curr count: 410
2021/12/24 11:18:35 Waiting for dst bucket item count to get to: 5000 curr count: 410
2021/12/24 11:18:35 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:18:40 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/24 11:18:40 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/24 11:18:40 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:18:40 Undeploying app: bucket_op_on_update
2021/12/24 11:18:46 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:18:51 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:18:56 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:19:01 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:19:01 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 11:19:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:19:01 No eventing-con process running
2021/12/24 11:19:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:19:10 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:19:45 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:19:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/24 11:19:46 Starting bucket ops to source bucket
2021/12/24 11:19:54 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:19:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:20:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:20:09 Waiting for dst bucket item count to get to: 5000 curr count: 2379
2021/12/24 11:20:14 Waiting for dst bucket item count to get to: 5000 curr count: 2379
2021/12/24 11:20:14 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:20:19 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/24 11:20:19 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/24 11:20:19 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:20:19 Undeploying app: bucket_op_on_update
2021/12/24 11:20:24 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:20:29 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:20:34 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:20:39 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:20:39 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 11:20:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:20:39 No eventing-con process running
2021/12/24 11:20:41 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:20:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:21:23 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:21:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/24 11:21:24 Starting bucket ops to source bucket
2021/12/24 11:21:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:21:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:21:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:21:47 Waiting for dst bucket item count to get to: 5000 curr count: 1500
2021/12/24 11:21:52 Waiting for dst bucket item count to get to: 5000 curr count: 4000
2021/12/24 11:21:52 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:21:57 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/24 11:21:57 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/24 11:21:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:21:57 Undeploying app: bucket_op_on_update
2021/12/24 11:22:02 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:22:07 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:22:13 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:22:18 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:22:18 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 11:22:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:22:18 No eventing-con process running
2021/12/24 11:22:19 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:22:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:23:02 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:23:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/24 11:23:03 Starting bucket ops to source bucket
2021/12/24 11:23:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:23:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:23:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:23:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:23:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:23:31 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/24 11:23:31 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/24 11:23:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:23:31 Undeploying app: bucket_op_on_update
2021/12/24 11:23:36 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:23:41 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:23:46 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:23:51 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 11:23:51 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 11:23:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:23:51 No eventing-con process running
2021/12/24 11:23:53 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:24:00 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:24:35 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings deleting in background"
}
--- PASS: TestDeployUndeployLoopNonDefaultSettings (510.72s)
=== RUN   TestOnUpdateN1QLOp
2021/12/24 11:24:45 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/24 11:24:45 App: TestOnUpdateN1QLOp got un-deployed
2021/12/24 11:24:45 No eventing-con process running
2021/12/24 11:24:45 Function: TestOnUpdateN1QLOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateN1QLOp not found"
}
2021/12/24 11:24:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:24:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:24:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:24:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:24:59 Deploying app: TestOnUpdateN1QLOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:25:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp stored in temp store"
}
2021/12/24 11:25:00 Starting bucket ops to source bucket
2021/12/24 11:25:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:25:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:25:18 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:25:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:25:28 Waiting for dst bucket item count to get to: 5000 curr count: 2495
2021/12/24 11:25:28 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:25:28 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:25:33 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/24 11:25:38 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/24 11:25:43 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/24 11:25:48 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/24 11:25:48 App: TestOnUpdateN1QLOp got un-deployed
2021/12/24 11:25:48 No eventing-con process running
2021/12/24 11:25:48 Function: TestOnUpdateN1QLOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp deleting in background"
}
2021/12/24 11:25:50 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:26:00 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 11:26:05 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 11:26:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:26:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:26:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 11:26:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateN1QLOp (101.55s)
=== RUN   TestOnUpdateBucketOpDefaultSettings
2021/12/24 11:26:26 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/24 11:26:27 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2021/12/24 11:26:27 No eventing-con process running
2021/12/24 11:26:27 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings not found"
}
2021/12/24 11:26:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:26:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:26:35 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:26:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:26:40 Deploying app: TestOnUpdateBucketOpDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:26:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings stored in temp store"
}
2021/12/24 11:26:41 Starting bucket ops to source bucket
2021/12/24 11:26:49 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:26:54 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:26:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:27:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:27:04 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:27:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:27:09 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/24 11:27:14 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/24 11:27:19 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/24 11:27:24 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/24 11:27:24 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2021/12/24 11:27:24 No eventing-con process running
2021/12/24 11:27:24 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings deleting in background"
}
2021/12/24 11:27:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:27:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 11:27:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:27:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:27:48 Waiting for dst bucket item count to get to: 0 curr count: 3466
2021/12/24 11:27:53 Waiting for dst bucket item count to get to: 0 curr count: 966
2021/12/24 11:27:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings (96.50s)
=== RUN   TestOnUpdateBucketOpNonDefaultSettings
2021/12/24 11:28:03 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 11:28:03 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/24 11:28:03 No eventing-con process running
2021/12/24 11:28:03 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpNonDefaultSettings not found"
}
2021/12/24 11:28:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:28:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:28:12 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:28:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:28:17 Deploying app: TestOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:28:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2021/12/24 11:28:18 Starting bucket ops to source bucket
2021/12/24 11:28:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:28:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:28:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:28:41 Waiting for dst bucket item count to get to: 5000 curr count: 274
2021/12/24 11:28:46 Waiting for dst bucket item count to get to: 5000 curr count: 274
2021/12/24 11:28:46 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:28:46 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:28:51 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 11:28:56 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 11:29:01 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 11:29:06 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 11:29:06 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/24 11:29:06 No eventing-con process running
2021/12/24 11:29:06 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2021/12/24 11:29:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:29:18 Waiting for dst bucket item count to get to: 0 curr count: 2782
2021/12/24 11:29:23 Waiting for dst bucket item count to get to: 0 curr count: 282
2021/12/24 11:29:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:29:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:29:35 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 11:29:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpNonDefaultSettings (101.63s)
=== RUN   TestOnUpdateBucketOpDefaultSettings10K
2021/12/24 11:29:45 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/24 11:29:45 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2021/12/24 11:29:45 No eventing-con process running
2021/12/24 11:29:45 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings10K not found"
}
2021/12/24 11:29:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:29:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:29:53 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:29:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:29:58 Deploying app: TestOnUpdateBucketOpDefaultSettings10K. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:29:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K stored in temp store"
}
2021/12/24 11:29:59 Starting bucket ops to source bucket
2021/12/24 11:30:07 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:30:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:30:17 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:30:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:30:27 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/24 11:30:27 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:30:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:30:33 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/24 11:30:38 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/24 11:30:43 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/24 11:30:48 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/24 11:30:48 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2021/12/24 11:30:48 No eventing-con process running
2021/12/24 11:30:48 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K deleting in background"
}
2021/12/24 11:30:49 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:30:59 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 11:31:04 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 11:31:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:31:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:31:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 11:31:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings10K (101.59s)
=== RUN   TestOnUpdateBucketOpDefaultSettings100K
2021/12/24 11:31:26 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/24 11:31:26 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2021/12/24 11:31:26 No eventing-con process running
2021/12/24 11:31:26 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings100K not found"
}
2021/12/24 11:31:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:31:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:31:35 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:31:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:31:40 Deploying app: TestOnUpdateBucketOpDefaultSettings100K. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:31:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K stored in temp store"
}
2021/12/24 11:31:41 Starting bucket ops to source bucket
2021/12/24 11:31:49 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:31:54 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:31:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:32:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:32:04 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:32:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:32:09 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/24 11:32:15 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/24 11:32:20 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/24 11:32:25 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/24 11:32:25 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2021/12/24 11:32:25 No eventing-con process running
2021/12/24 11:32:25 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K deleting in background"
}
2021/12/24 11:32:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:32:37 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 11:32:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:32:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:32:48 Waiting for dst bucket item count to get to: 0 curr count: 4073
2021/12/24 11:32:53 Waiting for dst bucket item count to get to: 0 curr count: 1573
2021/12/24 11:32:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings100K (97.07s)
=== RUN   TestOnDeleteBucketOp
2021/12/24 11:33:03 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/24 11:33:03 App: TestOnDeleteBucketOp got un-deployed
2021/12/24 11:33:03 No eventing-con process running
2021/12/24 11:33:03 Function: TestOnDeleteBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp not found"
}
2021/12/24 11:33:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:33:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:33:12 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:33:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:33:17 Deploying app: TestOnDeleteBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:33:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp stored in temp store"
}
2021/12/24 11:33:18 Starting bucket ops to source bucket
2021/12/24 11:33:29 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:33:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:33:39 Waiting for dst bucket item count to get to: 5000 curr count: 106
2021/12/24 11:33:44 Waiting for dst bucket item count to get to: 5000 curr count: 106
2021/12/24 11:33:44 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:33:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:33:49 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/24 11:33:54 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/24 11:33:59 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/24 11:34:04 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/24 11:34:04 App: TestOnDeleteBucketOp got un-deployed
2021/12/24 11:34:04 No eventing-con process running
2021/12/24 11:34:04 Function: TestOnDeleteBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp deleting in background"
}
2021/12/24 11:34:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:34:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:34:13 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:34:23 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 11:34:28 Waiting for dst bucket item count to get to: 0 curr count: 2496
2021/12/24 11:34:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp (94.88s)
=== RUN   TestOnDeleteBucketOp5K
2021/12/24 11:34:38 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/24 11:34:38 App: TestOnDeleteBucketOp5K got un-deployed
2021/12/24 11:34:38 No eventing-con process running
2021/12/24 11:34:38 Function: TestOnDeleteBucketOp5K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp5K not found"
}
2021/12/24 11:34:40 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:34:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:34:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:34:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:34:52 Deploying app: TestOnDeleteBucketOp5K. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:34:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K stored in temp store"
}
2021/12/24 11:34:53 Starting bucket ops to source bucket
2021/12/24 11:35:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:35:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:35:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:35:14 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:35:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:35:19 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/24 11:35:24 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/24 11:35:29 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/24 11:35:34 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/24 11:35:34 App: TestOnDeleteBucketOp5K got un-deployed
2021/12/24 11:35:34 No eventing-con process running
2021/12/24 11:35:34 Function: TestOnDeleteBucketOp5K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K deleting in background"
}
2021/12/24 11:35:36 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:35:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:35:43 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:35:53 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 11:35:58 Waiting for dst bucket item count to get to: 0 curr count: 2496
2021/12/24 11:35:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp5K (89.84s)
=== RUN   TestTimerBucketOp
2021/12/24 11:36:08 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/24 11:36:08 App: TestTimerBucketOp got un-deployed
2021/12/24 11:36:08 No eventing-con process running
2021/12/24 11:36:08 Function: TestTimerBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerBucketOp not found"
}
2021/12/24 11:36:10 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:36:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:36:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:36:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:36:22 Deploying app: TestTimerBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:36:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp stored in temp store"
}
2021/12/24 11:36:23 Starting bucket ops to source bucket
2021/12/24 11:36:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:36:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:36:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:36:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:36:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:36:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:37:01 Waiting for dst bucket item count to get to: 5000 curr count: 2796
2021/12/24 11:37:06 Waiting for dst bucket item count to get to: 5000 curr count: 2796
2021/12/24 11:37:06 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:37:06 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:37:11 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/24 11:37:16 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/24 11:37:21 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/24 11:37:26 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/24 11:37:26 App: TestTimerBucketOp got un-deployed
2021/12/24 11:37:26 No eventing-con process running
2021/12/24 11:37:26 Function: TestTimerBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp deleting in background"
}
2021/12/24 11:37:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:37:38 Waiting for dst bucket item count to get to: 0 curr count: 2692
2021/12/24 11:37:43 Waiting for dst bucket item count to get to: 0 curr count: 192
2021/12/24 11:37:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:37:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:37:54 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 11:37:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerBucketOp (116.40s)
=== RUN   TestTimerInPastBucketOp
2021/12/24 11:38:04 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/24 11:38:04 App: TestTimerInPastBucketOp got un-deployed
2021/12/24 11:38:04 No eventing-con process running
2021/12/24 11:38:04 Function: TestTimerInPastBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerInPastBucketOp not found"
}
2021/12/24 11:38:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:38:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:38:13 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:38:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:38:18 Deploying app: TestTimerInPastBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:38:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp stored in temp store"
}
2021/12/24 11:38:19 Starting bucket ops to source bucket
2021/12/24 11:38:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:38:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:38:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:38:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:38:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:38:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:38:57 Waiting for dst bucket item count to get to: 5000 curr count: 1743
2021/12/24 11:39:02 Waiting for dst bucket item count to get to: 5000 curr count: 4243
2021/12/24 11:39:02 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:39:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:39:07 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/24 11:39:12 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/24 11:39:17 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/24 11:39:22 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/24 11:39:22 App: TestTimerInPastBucketOp got un-deployed
2021/12/24 11:39:22 No eventing-con process running
2021/12/24 11:39:22 Function: TestTimerInPastBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp deleting in background"
}
2021/12/24 11:39:24 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:39:34 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 11:39:39 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 11:39:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:39:41 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:39:51 Waiting for dst bucket item count to get to: 0 curr count: 4585
2021/12/24 11:39:56 Waiting for dst bucket item count to get to: 0 curr count: 4585
2021/12/24 11:39:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerInPastBucketOp (121.38s)
=== RUN   TestDeployUndeployLoopTimer
2021/12/24 11:40:06 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:40:06 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 11:40:06 No eventing-con process running
2021/12/24 11:40:06 Function: TestDeployUndeployLoopTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopTimer not found"
}
2021/12/24 11:40:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:40:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:40:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:40:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:40:19 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:40:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/24 11:40:20 Starting bucket ops to source bucket
2021/12/24 11:40:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:40:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:40:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:40:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:40:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:40:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:40:59 Waiting for dst bucket item count to get to: 5000 curr count: 4267
2021/12/24 11:41:04 Waiting for dst bucket item count to get to: 5000 curr count: 4267
2021/12/24 11:41:04 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:41:09 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/24 11:41:09 App: TestDeployUndeployLoopTimer got deployed
2021/12/24 11:41:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:41:09 Undeploying app: bucket_op_with_timer
2021/12/24 11:41:14 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:41:19 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:41:24 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:41:29 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:41:29 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 11:41:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:41:29 No eventing-con process running
2021/12/24 11:41:31 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:41:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:42:13 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:42:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/24 11:42:14 Starting bucket ops to source bucket
2021/12/24 11:42:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:42:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:42:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:42:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:42:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:42:47 Waiting for dst bucket item count to get to: 5000 curr count: 11
2021/12/24 11:42:52 Waiting for dst bucket item count to get to: 5000 curr count: 306
2021/12/24 11:42:57 Waiting for dst bucket item count to get to: 5000 curr count: 2795
2021/12/24 11:42:57 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:43:02 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/24 11:43:02 App: TestDeployUndeployLoopTimer got deployed
2021/12/24 11:43:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:43:02 Undeploying app: bucket_op_with_timer
2021/12/24 11:43:07 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:43:12 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:43:17 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:43:22 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:43:22 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 11:43:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:43:22 No eventing-con process running
2021/12/24 11:43:24 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:43:31 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:44:06 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:44:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/24 11:44:07 Starting bucket ops to source bucket
2021/12/24 11:44:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:44:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:44:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:44:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:44:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:44:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:44:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:44:45 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:44:50 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/24 11:44:50 App: TestDeployUndeployLoopTimer got deployed
2021/12/24 11:44:50 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:44:50 Undeploying app: bucket_op_with_timer
2021/12/24 11:44:55 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:45:00 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:45:05 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:45:10 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:45:10 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 11:45:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:45:11 No eventing-con process running
2021/12/24 11:45:12 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:45:19 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:45:55 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:45:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/24 11:45:56 Starting bucket ops to source bucket
2021/12/24 11:46:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:46:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:46:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:46:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:46:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:46:29 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:46:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:46:39 Waiting for dst bucket item count to get to: 5000 curr count: 4367
2021/12/24 11:46:44 Waiting for dst bucket item count to get to: 5000 curr count: 4367
2021/12/24 11:46:44 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:46:49 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/24 11:46:49 App: TestDeployUndeployLoopTimer got deployed
2021/12/24 11:46:49 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:46:49 Undeploying app: bucket_op_with_timer
2021/12/24 11:46:54 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:46:59 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:47:04 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:47:09 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:47:09 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 11:47:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:47:09 No eventing-con process running
2021/12/24 11:47:11 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:47:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:47:53 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:47:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/24 11:47:54 Starting bucket ops to source bucket
2021/12/24 11:48:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:48:07 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:48:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:48:17 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:48:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:48:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:48:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:48:37 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/24 11:48:37 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:48:42 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/24 11:48:42 App: TestDeployUndeployLoopTimer got deployed
2021/12/24 11:48:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:48:42 Undeploying app: bucket_op_with_timer
2021/12/24 11:48:47 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:48:52 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:48:57 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:49:02 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 11:49:02 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 11:49:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:49:02 No eventing-con process running
2021/12/24 11:49:04 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:49:11 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:49:46 Function: TestDeployUndeployLoopTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer deleting in background"
}
--- PASS: TestDeployUndeployLoopTimer (590.47s)
=== RUN   TestMultipleHandlers
2021/12/24 11:49:56 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/24 11:49:56 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2021/12/24 11:49:56 No eventing-con process running
2021/12/24 11:49:56 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_update not found"
}
2021/12/24 11:49:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:50:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:50:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:50:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:50:15 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/24 11:50:15 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2021/12/24 11:50:15 No eventing-con process running
2021/12/24 11:50:15 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_delete not found"
}
2021/12/24 11:50:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:50:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:50:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:50:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:50:28 Deploying app: TestMultipleHandlers_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:50:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update stored in temp store"
}
2021/12/24 11:50:29 Deploying app: TestMultipleHandlers_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:50:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete stored in temp store"
}
2021/12/24 11:50:36 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/24 11:50:41 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/24 11:50:46 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/24 11:50:51 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/24 11:50:51 App: TestMultipleHandlers_bucket_op_on_update got deployed
2021/12/24 11:50:56 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/24 11:51:01 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/24 11:51:06 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/24 11:51:06 App: TestMultipleHandlers_bucket_op_on_delete got deployed
2021/12/24 11:51:06 Starting bucket ops to source bucket
2021/12/24 11:51:16 Waiting for dst bucket item count to get to: 5000 curr count: 674
2021/12/24 11:51:21 Waiting for dst bucket item count to get to: 5000 curr count: 2417
2021/12/24 11:51:26 Waiting for dst bucket item count to get to: 5000 curr count: 4243
2021/12/24 11:51:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:51:26 Starting bucket ops to source bucket
2021/12/24 11:51:41 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 11:51:41 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 11:51:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:51:41 Function: TestMultipleHandlers_bucket_op_on_update update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:51:41 Function: TestMultipleHandlers_bucket_op_on_delete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:51:46 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/24 11:51:51 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/24 11:51:56 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/24 11:52:01 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/24 11:52:01 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2021/12/24 11:52:01 No eventing-con process running
2021/12/24 11:52:01 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update deleting in background"
}
2021/12/24 11:52:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:52:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:52:10 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:52:20 Waiting for dst bucket item count to get to: 0 curr count: 6525
2021/12/24 11:52:25 Waiting for dst bucket item count to get to: 0 curr count: 6525
2021/12/24 11:52:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:52:30 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/24 11:52:35 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/24 11:52:40 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/24 11:52:45 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/24 11:52:45 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2021/12/24 11:52:45 No eventing-con process running
2021/12/24 11:52:45 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete deleting in background"
}
2021/12/24 11:52:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:52:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:52:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:52:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMultipleHandlers (192.71s)
=== RUN   TestPauseResumeLoopDefaultSettings
2021/12/24 11:53:09 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/24 11:53:09 App: TestPauseResumeLoopDefaultSettings got un-deployed
2021/12/24 11:53:09 No eventing-con process running
2021/12/24 11:53:09 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopDefaultSettings not found"
}
2021/12/24 11:53:11 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:53:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:53:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:53:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:53:23 Deploying app: TestPauseResumeLoopDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:53:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings stored in temp store"
}
2021/12/24 11:53:24 Starting bucket ops to source bucket
2021/12/24 11:53:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:53:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:53:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:53:47 Waiting for dst bucket item count to get to: 5000 curr count: 2084
2021/12/24 11:53:52 Waiting for dst bucket item count to get to: 5000 curr count: 4584
2021/12/24 11:53:52 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:53:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:53:57 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/24 11:53:57 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/24 11:53:57 Pausing app: bucket_op_on_update
2021/12/24 11:53:57 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:54:02 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/24 11:54:02 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/24 11:54:02 Resuming app: bucket_op_on_update
2021/12/24 11:54:03 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:54:03 Starting bucket ops to source bucket
2021/12/24 11:54:11 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 11:54:16 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 11:54:21 Waiting for dst bucket item count to get to: 10000 curr count: 5329
2021/12/24 11:54:26 Waiting for dst bucket item count to get to: 10000 curr count: 7829
2021/12/24 11:54:26 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 11:54:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:54:31 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/24 11:54:31 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/24 11:54:31 Pausing app: bucket_op_on_update
2021/12/24 11:54:31 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:54:36 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/24 11:54:36 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/24 11:54:36 Resuming app: bucket_op_on_update
2021/12/24 11:54:37 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:54:37 Starting bucket ops to source bucket
2021/12/24 11:54:45 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 11:54:50 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 11:54:55 Waiting for dst bucket item count to get to: 15000 curr count: 12500
2021/12/24 11:54:55 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2021/12/24 11:54:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:55:01 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/24 11:55:01 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/24 11:55:01 Pausing app: bucket_op_on_update
2021/12/24 11:55:01 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:55:06 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/24 11:55:06 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/24 11:55:06 Resuming app: bucket_op_on_update
2021/12/24 11:55:07 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:55:07 Starting bucket ops to source bucket
2021/12/24 11:55:15 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 11:55:20 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 11:55:20 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/24 11:55:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:55:25 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/24 11:55:25 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/24 11:55:25 Pausing app: bucket_op_on_update
2021/12/24 11:55:25 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:55:30 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/24 11:55:30 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/24 11:55:30 Resuming app: bucket_op_on_update
2021/12/24 11:55:31 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:55:31 Starting bucket ops to source bucket
2021/12/24 11:55:39 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 11:55:44 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 11:55:49 Waiting for dst bucket item count to get to: 25000 curr count: 21882
2021/12/24 11:55:54 Waiting for dst bucket item count to get to: 25000 curr count: 21882
2021/12/24 11:55:54 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/24 11:55:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:55:59 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/24 11:55:59 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/24 11:55:59 Pausing app: bucket_op_on_update
2021/12/24 11:55:59 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:56:04 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/24 11:56:04 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/24 11:56:09 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/24 11:56:14 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/24 11:56:19 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/24 11:56:25 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/24 11:56:25 App: TestPauseResumeLoopDefaultSettings got un-deployed
2021/12/24 11:56:25 No eventing-con process running
2021/12/24 11:56:25 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings deleting in background"
}
2021/12/24 11:56:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:56:36 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/24 11:56:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:56:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:56:48 Waiting for dst bucket item count to get to: 0 curr count: 19897
2021/12/24 11:56:53 Waiting for dst bucket item count to get to: 0 curr count: 7397
2021/12/24 11:56:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopDefaultSettings (234.29s)
=== RUN   TestPauseResumeLoopNonDefaultSettings
2021/12/24 11:57:03 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/24 11:57:03 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2021/12/24 11:57:03 No eventing-con process running
2021/12/24 11:57:03 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopNonDefaultSettings not found"
}
2021/12/24 11:57:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:57:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:57:12 Context: Bucket flush, response code: 200 dump: 
2021/12/24 11:57:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 11:57:17 Deploying app: TestPauseResumeLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 11:57:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings stored in temp store"
}
2021/12/24 11:57:18 Starting bucket ops to source bucket
2021/12/24 11:57:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:57:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:57:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:57:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:57:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:57:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:57:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 11:57:56 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 11:57:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:58:01 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/24 11:58:01 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/24 11:58:01 Pausing app: bucket_op_with_timer
2021/12/24 11:58:01 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:58:06 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/24 11:58:06 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/24 11:58:06 Resuming app: bucket_op_with_timer
2021/12/24 11:58:07 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:58:07 Starting bucket ops to source bucket
2021/12/24 11:58:15 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 11:58:20 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 11:58:25 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 11:58:30 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 11:58:35 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 11:58:40 Waiting for dst bucket item count to get to: 10000 curr count: 6053
2021/12/24 11:58:45 Waiting for dst bucket item count to get to: 10000 curr count: 8553
2021/12/24 11:58:45 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 11:58:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:58:50 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/24 11:58:50 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/24 11:58:50 Pausing app: bucket_op_with_timer
2021/12/24 11:58:51 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:58:56 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/24 11:58:56 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/24 11:58:56 Resuming app: bucket_op_with_timer
2021/12/24 11:58:57 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:58:57 Starting bucket ops to source bucket
2021/12/24 11:59:05 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 11:59:10 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 11:59:15 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 11:59:20 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 11:59:25 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 11:59:30 Waiting for dst bucket item count to get to: 15000 curr count: 11924
2021/12/24 11:59:35 Waiting for dst bucket item count to get to: 15000 curr count: 14424
2021/12/24 11:59:35 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2021/12/24 11:59:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 11:59:40 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/24 11:59:40 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/24 11:59:40 Pausing app: bucket_op_with_timer
2021/12/24 11:59:40 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:59:45 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/24 11:59:45 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/24 11:59:45 Resuming app: bucket_op_with_timer
2021/12/24 11:59:46 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 11:59:46 Starting bucket ops to source bucket
2021/12/24 11:59:54 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 11:59:59 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 12:00:04 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 12:00:09 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 12:00:14 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 12:00:19 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2021/12/24 12:00:24 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2021/12/24 12:00:24 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/24 12:00:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:00:29 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/24 12:00:29 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/24 12:00:29 Pausing app: bucket_op_with_timer
2021/12/24 12:00:29 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:00:34 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/24 12:00:34 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/24 12:00:34 Resuming app: bucket_op_with_timer
2021/12/24 12:00:36 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:00:36 Starting bucket ops to source bucket
2021/12/24 12:00:43 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 12:00:48 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 12:00:53 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 12:00:58 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 12:01:03 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 12:01:08 Waiting for dst bucket item count to get to: 25000 curr count: 23059
2021/12/24 12:01:13 Waiting for dst bucket item count to get to: 25000 curr count: 23059
2021/12/24 12:01:13 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/24 12:01:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:01:18 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/24 12:01:19 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/24 12:01:19 Pausing app: bucket_op_with_timer
2021/12/24 12:01:19 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:01:24 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/24 12:01:24 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/24 12:01:29 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/24 12:01:34 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/24 12:01:39 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/24 12:01:44 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/24 12:01:44 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2021/12/24 12:01:44 No eventing-con process running
2021/12/24 12:01:44 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings deleting in background"
}
2021/12/24 12:01:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:01:56 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/24 12:01:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:01:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:02:07 Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/24 12:02:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopNonDefaultSettings (314.24s)
=== RUN   TestPauseAndResumeWithWorkerCountChange
2021/12/24 12:02:17 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/24 12:02:18 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2021/12/24 12:02:18 No eventing-con process running
2021/12/24 12:02:18 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseAndResumeWithWorkerCountChange not found"
}
2021/12/24 12:02:19 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:02:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:02:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:02:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:02:31 Deploying app: TestPauseAndResumeWithWorkerCountChange. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:02:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange stored in temp store"
}
2021/12/24 12:02:37 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/24 12:02:42 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/24 12:02:47 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/24 12:02:52 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/24 12:02:52 App: TestPauseAndResumeWithWorkerCountChange got deployed
2021/12/24 12:02:52 Starting bucket ops to source bucket
2021/12/24 12:03:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:03:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:03:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:03:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:03:22 Waiting for dst bucket item count to get to: 5000 curr count: 4173
2021/12/24 12:03:27 Waiting for dst bucket item count to get to: 5000 curr count: 4173
2021/12/24 12:03:27 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:03:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:03:27 Pausing app: bucket_op_with_timer
2021/12/24 12:03:27 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:03:32 Waiting for function: TestPauseAndResumeWithWorkerCountChange status to change to paused
2021/12/24 12:03:32 Function: TestPauseAndResumeWithWorkerCountChange status changed to paused
2021/12/24 12:03:32 Resuming app: bucket_op_with_timer
2021/12/24 12:03:33 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:03:33 Starting bucket ops to source bucket
2021/12/24 12:03:45 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 12:03:50 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 12:03:55 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 12:04:00 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 12:04:05 Waiting for dst bucket item count to get to: 10000 curr count: 6868
2021/12/24 12:04:10 Waiting for dst bucket item count to get to: 10000 curr count: 9368
2021/12/24 12:04:10 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 12:04:15 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/24 12:04:20 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/24 12:04:25 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/24 12:04:30 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/24 12:04:30 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2021/12/24 12:04:30 No eventing-con process running
2021/12/24 12:04:30 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange deleting in background"
}
2021/12/24 12:04:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:04:42 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 12:04:47 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 12:04:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:04:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:04:58 Waiting for dst bucket item count to get to: 0 curr count: 8388
2021/12/24 12:05:03 Waiting for dst bucket item count to get to: 0 curr count: 3388
2021/12/24 12:05:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseAndResumeWithWorkerCountChange (175.97s)
=== RUN   TestPauseResumeWithEventingReb
2021/12/24 12:05:13 Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/24 12:05:13 App: TestPauseResumeWithEventingReb got un-deployed
2021/12/24 12:05:13 No eventing-con process running
2021/12/24 12:05:13 Function: TestPauseResumeWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeWithEventingReb not found"
}
2021/12/24 12:05:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:05:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:05:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:05:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:05:27 Deploying app: TestPauseResumeWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:05:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb stored in temp store"
}
2021/12/24 12:05:33 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/24 12:05:38 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/24 12:05:43 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/24 12:05:48 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/24 12:05:48 App: TestPauseResumeWithEventingReb got deployed
2021/12/24 12:05:48 Starting bucket ops to source bucket
2021/12/24 12:05:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:06:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:06:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:06:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:06:18 Waiting for dst bucket item count to get to: 5000 curr count: 2404
2021/12/24 12:06:23 Waiting for dst bucket item count to get to: 5000 curr count: 4904
2021/12/24 12:06:23 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:06:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:06:23 Pausing app: bucket_op_with_timer
2021/12/24 12:06:23 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:06:28 Waiting for function: TestPauseResumeWithEventingReb status to change to paused
2021/12/24 12:06:28 Function: TestPauseResumeWithEventingReb status changed to paused
2021/12/24 12:06:28 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 12:06:28 Removing node(s): [] from the cluster
2021/12/24 12:06:33 Rebalance progress: 29.16666666666666
2021/12/24 12:06:38 Rebalance progress: 29.16666666666666
2021/12/24 12:06:43 Rebalance progress: 100
2021/12/24 12:06:43 Resuming app: bucket_op_with_timer
2021/12/24 12:06:45 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:06:45 Starting bucket ops to source bucket
2021/12/24 12:06:56 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 12:07:01 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 12:07:06 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 12:07:11 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 12:07:16 Waiting for dst bucket item count to get to: 10000 curr count: 5820
2021/12/24 12:07:21 Waiting for dst bucket item count to get to: 10000 curr count: 7980
2021/12/24 12:07:26 Waiting for dst bucket item count to get to: 10000 curr count: 9660
2021/12/24 12:07:26 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 12:07:26 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 12:07:31 Rebalance progress: 29.16666666666666
2021/12/24 12:07:36 Rebalance progress: 29.16666666666666
2021/12/24 12:07:41 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2021/12/24 12:07:47 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:60} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 12:08:02 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:60} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 12:08:17 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:60} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 12:08:32 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:60} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 12:08:47 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:60} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 12:09:02 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:60} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 12:09:17 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:60} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 12:09:32 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:60} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 12:09:47 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:60} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: aeff0917ae22f47cd27682b462d26cad
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [0-56]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [57-113]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [114-170]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [171-227]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [228-284]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 57
	v: [285-341]
Producer node: 172.31.2.134:9300	Node UUID: 9bea86fa17d5b93ea1a7a1f88eadb1d1
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [968-1023]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [683-739]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [740-796]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [797-853]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [854-910]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [911-967]
Producer node: 127.0.0.1:9303	Node UUID: 11e32af51c92adfd2c62d92f6cea93e0
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [627-682]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [342-398]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [399-455]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [456-512]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [513-569]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [570-626]


2021/12/24 12:10:02 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:10:07 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/24 12:10:12 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/24 12:10:17 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/24 12:10:22 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/24 12:10:22 clusterSetup.go:405: App: TestPauseResumeWithEventingReb got un-deployed
2021/12/24 12:10:22 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:10:22 eventingSetup.go:418: Function: TestPauseResumeWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb deleting in background"
}
2021/12/24 12:10:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:10:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 12:10:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:10:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:10:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:10:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8555
2021/12/24 12:10:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8555
2021/12/24 12:10:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeWithEventingReb (352.14s)
=== RUN   TestBucketDeleteAfterPause
2021/12/24 12:11:06 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2021/12/24 12:11:06 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2021/12/24 12:11:06 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:11:06 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteAfterPause not found"
}
2021/12/24 12:11:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:11:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:11:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:11:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:11:19 eventingSetup.go:125: Deploying app: TestBucketDeleteAfterPause. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:11:20 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause stored in temp store"
}
2021/12/24 12:11:25 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/24 12:11:30 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/24 12:11:35 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/24 12:11:40 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/24 12:11:40 clusterSetup.go:354: App: TestBucketDeleteAfterPause got deployed
2021/12/24 12:11:40 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:11:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:11:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:11:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:11:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:11:55 handler_test.go:712: Pausing app: bucket_op_on_update
2021/12/24 12:11:55 eventingSetup.go:270: Function: TestBucketDeleteAfterPause update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:12:00 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to paused
2021/12/24 12:12:00 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to paused
2021/12/24 12:12:00 handler_test.go:716: Deleting source bucket: default
2021/12/24 12:12:06 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to undeployed
2021/12/24 12:12:06 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to undeployed
2021/12/24 12:12:11 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2021/12/24 12:12:12 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2021/12/24 12:12:12 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:12:12 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause deleting in background"
}
2021/12/24 12:12:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:12:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:12:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:12:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 12:12:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 12:12:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketDeleteAfterPause (98.96s)
=== RUN   TestChangeFnCodeBetweenPauseResume
2021/12/24 12:12:45 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/24 12:12:45 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2021/12/24 12:12:45 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:12:45 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestChangeFnCodeBetweenPauseResume not found"
}
2021/12/24 12:12:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:12:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:12:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:12:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:12:58 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:12:59 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2021/12/24 12:13:04 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/24 12:13:09 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/24 12:13:14 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/24 12:13:19 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/24 12:13:19 clusterSetup.go:354: App: TestChangeFnCodeBetweenPauseResume got deployed
2021/12/24 12:13:19 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:13:54 handler_test.go:739: Pausing function: TestChangeFnCodeBetweenPauseResume
2021/12/24 12:13:54 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:13:59 eventingSetup.go:719: Waiting for function: TestChangeFnCodeBetweenPauseResume status to change to paused
2021/12/24 12:13:59 eventingSetup.go:727: Function: TestChangeFnCodeBetweenPauseResume status changed to paused
2021/12/24 12:16:59 handler_test.go:748: Resuming function: TestChangeFnCodeBetweenPauseResume
2021/12/24 12:16:59 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 5000 dst bucket: 0
2021/12/24 12:17:00 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2021/12/24 12:17:05 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/24 12:17:05 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:17:05 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 0 expected 5000
2021/12/24 12:17:10 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/24 12:17:10 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:17:10 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 2431 expected 5000
2021/12/24 12:17:15 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/24 12:17:15 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:17:15 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 3047 expected 5000
2021/12/24 12:17:20 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/24 12:17:20 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:17:20 eventingSetup.go:804: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 5000
2021/12/24 12:17:20 handler_test.go:753: Undeploying function: TestChangeFnCodeBetweenPauseResume
2021/12/24 12:17:20 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:17:30 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/24 12:17:36 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/24 12:17:41 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/24 12:17:41 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2021/12/24 12:17:41 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:17:41 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume deleting in background"
}
2021/12/24 12:17:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:17:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:17:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:17:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:17:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:18:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestChangeFnCodeBetweenPauseResume (329.01s)
=== RUN   TestCommentUnCommentOnDelete
2021/12/24 12:18:14 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/24 12:18:14 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2021/12/24 12:18:14 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:18:14 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCommentUnCommentOnDelete not found"
}
2021/12/24 12:18:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:18:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:18:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:18:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:18:27 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:18:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2021/12/24 12:18:33 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 12:18:38 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 12:18:43 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 12:18:48 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 12:18:48 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2021/12/24 12:18:48 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:18:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:19:02 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 797
2021/12/24 12:19:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 797
2021/12/24 12:19:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:19:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:19:07 handler_test.go:780: Undeploying app: TestCommentUnCommentOnDelete
2021/12/24 12:19:07 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:19:37 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 5000 dst bucket: 5000
2021/12/24 12:19:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2021/12/24 12:19:43 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 12:19:48 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 12:19:53 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 12:19:58 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 12:19:58 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2021/12/24 12:19:58 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:20:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:20:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 12:20:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:20:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:20:16 handler_test.go:799: Undeploying app: TestCommentUnCommentOnDelete
2021/12/24 12:20:16 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:20:26 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/24 12:20:31 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/24 12:20:36 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/24 12:20:36 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2021/12/24 12:20:36 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:20:36 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete deleting in background"
}
2021/12/24 12:20:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:20:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:20:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:20:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCommentUnCommentOnDelete (165.53s)
=== RUN   TestCPPWorkerCleanup
2021/12/24 12:20:59 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/24 12:20:59 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2021/12/24 12:20:59 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:20:59 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCPPWorkerCleanup not found"
}
2021/12/24 12:21:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:21:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:21:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:21:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:21:12 eventingSetup.go:125: Deploying app: TestCPPWorkerCleanup. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:21:13 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup stored in temp store"
}
2021/12/24 12:21:13 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:21:20 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:21:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:21:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:21:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 434
2021/12/24 12:21:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2404
2021/12/24 12:21:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4470
2021/12/24 12:21:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:21:45 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:21:51 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/24 12:21:56 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/24 12:22:01 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/24 12:22:06 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/24 12:22:06 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2021/12/24 12:22:06 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:22:06 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup deleting in background"
}
2021/12/24 12:22:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:22:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:22:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:22:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:22:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4792
2021/12/24 12:22:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2292
2021/12/24 12:22:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCPPWorkerCleanup (134.64s)
=== RUN   TestWithUserXattrs
2021/12/24 12:23:14 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/24 12:23:14 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2021/12/24 12:23:14 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:23:14 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestWithUserXattrs not found"
}
2021/12/24 12:23:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:23:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:23:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:23:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:23:27 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:23:29 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:23:31 eventingSetup.go:125: Deploying app: TestWithUserXattrs. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:23:32 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs stored in temp store"
}
2021/12/24 12:23:37 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/24 12:23:42 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/24 12:23:47 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/24 12:23:52 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/24 12:23:52 clusterSetup.go:354: App: TestWithUserXattrs got deployed
2021/12/24 12:23:52 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:24:01 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:24:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/24 12:24:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:24:06 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:24:11 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/24 12:24:17 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/24 12:24:22 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/24 12:24:27 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/24 12:24:27 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2021/12/24 12:24:27 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:24:27 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs deleting in background"
}
2021/12/24 12:24:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:24:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3225
2021/12/24 12:24:43 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 725
2021/12/24 12:24:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:24:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:24:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:24:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestWithUserXattrs (110.86s)
=== RUN   TestEventProcessingPostBucketFlush
2021/12/24 12:25:05 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 12:25:05 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/24 12:25:05 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:25:05 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventProcessingPostBucketFlush not found"
}
2021/12/24 12:25:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:25:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:25:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:25:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:25:18 eventingSetup.go:125: Deploying app: TestEventProcessingPostBucketFlush. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:25:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush stored in temp store"
}
2021/12/24 12:25:24 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/24 12:25:29 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/24 12:25:34 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/24 12:25:39 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/24 12:25:39 clusterSetup.go:354: App: TestEventProcessingPostBucketFlush got deployed
2021/12/24 12:25:39 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:25:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:25:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 135
2021/12/24 12:25:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2635
2021/12/24 12:25:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:25:58 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:26:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:26:12 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3950
2021/12/24 12:26:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1450
2021/12/24 12:26:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:26:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:26:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:26:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 12:26:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:26:34 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:26:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 17864
2021/12/24 12:27:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 17864
2021/12/24 12:27:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/24 12:27:04 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:27:04 eventingSetup.go:270: Function: TestEventProcessingPostBucketFlush update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:27:09 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 12:27:14 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 12:27:19 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 12:27:24 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 12:27:24 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/24 12:27:24 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:27:29 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 12:27:29 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/24 12:27:29 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:27:29 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush deleting in background"
}
2021/12/24 12:27:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:27:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 24694
2021/12/24 12:27:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 24694
2021/12/24 12:27:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:27:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:27:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/24 12:27:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventProcessingPostBucketFlush (182.57s)
=== RUN   TestMetaBucketDelete
2021/12/24 12:28:07 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/24 12:28:07 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/24 12:28:07 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:28:07 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDelete not found"
}
2021/12/24 12:28:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:28:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:28:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:28:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:28:20 eventingSetup.go:125: Deploying app: TestMetaBucketDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:28:21 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete stored in temp store"
}
2021/12/24 12:28:26 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/24 12:28:31 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/24 12:28:36 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/24 12:28:41 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/24 12:28:41 clusterSetup.go:354: App: TestMetaBucketDelete got deployed
2021/12/24 12:28:41 handler_test.go:902: Deleting metadata bucket: eventing
2021/12/24 12:28:43 handler_test.go:904: Deleted metadata bucket: eventing
2021/12/24 12:28:48 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/24 12:28:48 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/24 12:29:03 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/24 12:29:03 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/24 12:29:03 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:29:03 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete deleting in background"
}
2021/12/24 12:29:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:29:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:29:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:29:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDelete (79.03s)
=== RUN   TestMetaBucketDeleteWithBootstrap
2021/12/24 12:29:26 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 12:29:26 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 12:29:26 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:29:26 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDeleteWithBootstrap not found"
}
2021/12/24 12:29:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:29:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:29:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:29:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:29:39 eventingSetup.go:125: Deploying app: TestMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:29:40 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap stored in temp store"
}
2021/12/24 12:29:59 handler_test.go:923: Deleting metadata bucket: eventing
2021/12/24 12:30:00 handler_test.go:925: Deleted metadata bucket: eventing
2021/12/24 12:30:15 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 12:30:15 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 12:30:30 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 12:30:30 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 12:30:30 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:30:30 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap deleting in background"
}
2021/12/24 12:30:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:30:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:30:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:30:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDeleteWithBootstrap (87.02s)
=== RUN   TestSourceBucketDelete
2021/12/24 12:30:53 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/24 12:30:53 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/24 12:30:53 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:30:53 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDelete not found"
}
2021/12/24 12:30:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:31:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:31:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:31:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:31:06 eventingSetup.go:125: Deploying app: TestSourceBucketDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:31:07 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete stored in temp store"
}
2021/12/24 12:31:12 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/24 12:31:17 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/24 12:31:22 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/24 12:31:27 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/24 12:31:28 clusterSetup.go:354: App: TestSourceBucketDelete got deployed
2021/12/24 12:31:28 handler_test.go:945: Deleting source bucket: default
2021/12/24 12:31:29 handler_test.go:947: Deleted source bucket: default
2021/12/24 12:31:34 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/24 12:31:34 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/24 12:31:49 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/24 12:31:49 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/24 12:31:49 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:31:49 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete deleting in background"
}
2021/12/24 12:31:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:31:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:31:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:32:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDelete (78.89s)
=== RUN   TestSourceBucketDeleteWithBootstrap
2021/12/24 12:32:12 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/24 12:32:12 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/24 12:32:12 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:32:12 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDeleteWithBootstrap not found"
}
2021/12/24 12:32:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:32:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:32:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:32:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:32:25 eventingSetup.go:125: Deploying app: TestSourceBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:32:26 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap stored in temp store"
}
2021/12/24 12:32:45 handler_test.go:966: Deleting source bucket: default
2021/12/24 12:32:47 handler_test.go:968: Deleted source bucket: default
2021/12/24 12:33:02 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/24 12:33:02 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/24 12:33:17 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/24 12:33:17 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/24 12:33:17 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:33:17 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap deleting in background"
}
2021/12/24 12:33:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:33:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:33:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:33:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDeleteWithBootstrap (87.68s)
=== RUN   TestSourceAndMetaBucketDeleteWithBootstrap
2021/12/24 12:33:40 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 12:33:40 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 12:33:40 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:33:40 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceAndMetaBucketDeleteWithBootstrap not found"
}
2021/12/24 12:33:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:33:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:33:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:33:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:33:53 eventingSetup.go:125: Deploying app: TestSourceAndMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:33:54 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap stored in temp store"
}
2021/12/24 12:34:13 handler_test.go:988: Deleting source bucket: default
2021/12/24 12:34:14 handler_test.go:990: Deleted source bucket: default
2021/12/24 12:34:14 handler_test.go:992: Deleting metadata bucket: eventing
2021/12/24 12:34:15 handler_test.go:994: Deleted metadata bucket: eventing
2021/12/24 12:34:30 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 12:34:30 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 12:34:45 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 12:34:45 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 12:34:45 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:34:45 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap deleting in background"
}
2021/12/24 12:34:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:34:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:34:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:34:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceAndMetaBucketDeleteWithBootstrap (88.45s)
=== RUN   TestUndeployDuringBootstrap
2021/12/24 12:35:08 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/24 12:35:08 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/24 12:35:08 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:35:08 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployDuringBootstrap not found"
}
2021/12/24 12:35:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:35:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:35:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:35:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:35:21 eventingSetup.go:125: Deploying app: TestUndeployDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:35:23 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap stored in temp store"
}
2021/12/24 12:35:23 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:35:34 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:35:35 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/24 12:35:35 clusterSetup.go:378: App: TestUndeployDuringBootstrap started bootstrap
2021/12/24 12:35:35 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/24 12:35:40 clusterSetup.go:367: No apps undergoing bootstrap
2021/12/24 12:35:45 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/24 12:35:50 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/24 12:35:55 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/24 12:35:55 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/24 12:35:55 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:36:20 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/24 12:36:20 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/24 12:36:20 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:36:20 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap deleting in background"
}
2021/12/24 12:36:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:36:31 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:36:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:36:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:36:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:36:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2846
2021/12/24 12:36:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 346
2021/12/24 12:36:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployDuringBootstrap (114.75s)
=== RUN   TestDeleteBeforeUndeploy
2021/12/24 12:36:58 eventingSetup.go:125: Deploying app: TestDeleteBeforeUndeploy. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:36:59 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy stored in temp store"
}
2021/12/24 12:37:04 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/24 12:37:09 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/24 12:37:14 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/24 12:37:19 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/24 12:37:19 clusterSetup.go:354: App: TestDeleteBeforeUndeploy got deployed
2021/12/24 12:37:19 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 422 dump: {
 "name": "ERR_APP_NOT_UNDEPLOYED",
 "code": 22,
 "description": "Function: TestDeleteBeforeUndeploy skipping delete request as it hasn't been undeployed"
}
2021/12/24 12:37:19 eventingSetup.go:270: Function: TestDeleteBeforeUndeploy update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:37:19 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy deleting in background"
}
2021/12/24 12:37:24 clusterSetup.go:397: Waiting for app: TestDeleteBeforeUndeploy to get un-deployed
2021/12/24 12:37:25 clusterSetup.go:405: App: TestDeleteBeforeUndeploy got un-deployed
2021/12/24 12:37:25 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:37:25 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeleteBeforeUndeploy not found"
}
2021/12/24 12:37:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:37:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:37:32 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:37:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDeleteBeforeUndeploy (44.49s)
=== RUN   TestUndeployWhenTimersAreFired
2021/12/24 12:37:48 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 12:37:48 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/24 12:37:48 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:37:48 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWhenTimersAreFired not found"
}
2021/12/24 12:37:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:37:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:37:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:38:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:38:01 eventingSetup.go:125: Deploying app: TestUndeployWhenTimersAreFired. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:38:02 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired stored in temp store"
}
2021/12/24 12:38:07 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/24 12:38:12 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/24 12:38:17 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/24 12:38:22 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/24 12:38:22 clusterSetup.go:354: App: TestUndeployWhenTimersAreFired got deployed
2021/12/24 12:38:22 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:38:57 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 12:39:02 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 12:39:07 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 12:39:12 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 12:39:12 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/24 12:39:12 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:40:57 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 12:40:57 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/24 12:40:57 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:40:57 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired deleting in background"
}
2021/12/24 12:40:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:41:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:41:14 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 12:41:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:41:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:41:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:41:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWhenTimersAreFired (227.93s)
=== RUN   TestUndeployWithKVFailover
2021/12/24 12:41:35 clusterSetup.go:397: Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/24 12:41:35 clusterSetup.go:405: App: TestUndeployWithKVFailover got un-deployed
2021/12/24 12:41:35 eventingSetup.go:46: No eventing-con process running
2021/12/24 12:41:35 eventingSetup.go:418: Function: TestUndeployWithKVFailover delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWithKVFailover not found"
}
2021/12/24 12:41:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:41:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:41:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:41:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:41:49 eventingSetup.go:125: Deploying app: TestUndeployWithKVFailover. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:41:50 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover stored in temp store"
}
2021/12/24 12:41:50 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 12:41:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:42:02 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:42:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:42:12 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:42:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:42:22 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 191
2021/12/24 12:42:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2450
2021/12/24 12:42:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4759
2021/12/24 12:42:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:42:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/24 12:42:32 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 12:42:37 Rebalance progress: 29.16666666666666
2021/12/24 12:42:42 Rebalance progress: 29.16666666666666
2021/12/24 12:42:47 Rebalance progress: 100
2021/12/24 12:42:47 Failing over: [127.0.0.1:19003]
2021/12/24 12:42:57 Function: TestUndeployWithKVFailover update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 12:43:57 Removing node(s): [] from the cluster
2021/12/24 12:44:02 Rebalance progress: 29.16666666666666
2021/12/24 12:44:07 Rebalance progress: 29.16666666666666
2021/12/24 12:44:12 Rebalance progress: 100
2021/12/24 12:44:17 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/24 12:44:17 App: TestUndeployWithKVFailover got un-deployed
2021/12/24 12:44:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:44:22 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/24 12:44:22 App: TestUndeployWithKVFailover got un-deployed
2021/12/24 12:44:22 No eventing-con process running
2021/12/24 12:44:22 Function: TestUndeployWithKVFailover delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover deleting in background"
}
2021/12/24 12:44:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:44:34 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:44:39 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 12:44:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:44:40 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:44:50 Waiting for dst bucket item count to get to: 0 curr count: 3851
2021/12/24 12:44:55 Waiting for dst bucket item count to get to: 0 curr count: 3851
2021/12/24 12:44:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWithKVFailover (209.89s)
=== RUN   TestBucketFlushWhileFnDeployed
2021/12/24 12:45:05 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/24 12:45:05 App: TestBucketFlushWhileFnDeployed got un-deployed
2021/12/24 12:45:05 No eventing-con process running
2021/12/24 12:45:05 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketFlushWhileFnDeployed not found"
}
2021/12/24 12:45:07 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:45:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:45:13 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:45:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:45:18 Deploying app: TestBucketFlushWhileFnDeployed. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:45:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed stored in temp store"
}
2021/12/24 12:45:25 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/24 12:45:30 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/24 12:45:35 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/24 12:45:40 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/24 12:45:40 App: TestBucketFlushWhileFnDeployed got deployed
2021/12/24 12:45:40 Starting bucket ops to source bucket
2021/12/24 12:46:00 Waiting for dst bucket item count to get to: 20000 curr count: 11143
2021/12/24 12:46:05 Waiting for dst bucket item count to get to: 20000 curr count: 16256
2021/12/24 12:46:05 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/24 12:46:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:46:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:46:18 Waiting for dst bucket item count to get to: 0 curr count: 10080
2021/12/24 12:46:23 Waiting for dst bucket item count to get to: 0 curr count: 80
2021/12/24 12:46:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:46:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:46:35 Waiting for dst bucket item count to get to: 0 curr count: 20000
2021/12/24 12:46:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:46:35 Starting bucket ops to source bucket
2021/12/24 12:46:48 Waiting for dst bucket item count to get to: 10000 curr count: 4328
2021/12/24 12:46:53 Waiting for dst bucket item count to get to: 10000 curr count: 4328
2021/12/24 12:46:53 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 12:46:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:46:58 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/24 12:47:03 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/24 12:47:08 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/24 12:47:13 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/24 12:47:13 App: TestBucketFlushWhileFnDeployed got un-deployed
2021/12/24 12:47:13 No eventing-con process running
2021/12/24 12:47:13 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed deleting in background"
}
2021/12/24 12:47:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:47:24 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 12:47:29 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:47:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:47:31 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:47:41 Waiting for dst bucket item count to get to: 0 curr count: 9460
2021/12/24 12:47:46 Waiting for dst bucket item count to get to: 0 curr count: 9460
2021/12/24 12:47:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketFlushWhileFnDeployed (170.54s)
=== RUN   TestTimerOverwrite
2021/12/24 12:47:56 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/24 12:47:56 App: TestTimerOverwrite got un-deployed
2021/12/24 12:47:56 No eventing-con process running
2021/12/24 12:47:56 Function: TestTimerOverwrite delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverwrite not found"
}
2021/12/24 12:47:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:48:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:48:04 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:48:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:48:09 Deploying app: TestTimerOverwrite. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:48:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite stored in temp store"
}
2021/12/24 12:48:15 Waiting for app: TestTimerOverwrite to get deployed
2021/12/24 12:48:20 Waiting for app: TestTimerOverwrite to get deployed
2021/12/24 12:48:25 Waiting for app: TestTimerOverwrite to get deployed
2021/12/24 12:48:30 Waiting for app: TestTimerOverwrite to get deployed
2021/12/24 12:48:30 App: TestTimerOverwrite got deployed
2021/12/24 12:48:40 Starting bucket ops to source bucket
2021/12/24 12:48:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:48:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 12:49:45 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:49:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:50:00 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/24 12:50:05 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/24 12:50:10 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/24 12:50:15 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/24 12:50:15 App: TestTimerOverwrite got un-deployed
2021/12/24 12:50:15 No eventing-con process running
2021/12/24 12:50:15 Function: TestTimerOverwrite delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite deleting in background"
}
2021/12/24 12:50:16 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:50:26 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:50:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:50:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:50:38 Waiting for dst bucket item count to get to: 0 curr count: 3551
2021/12/24 12:50:43 Waiting for dst bucket item count to get to: 0 curr count: 1086
2021/12/24 12:50:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverwrite (177.18s)
=== RUN   TestUndeployBackdoorDuringBootstrap
2021/12/24 12:50:48 Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/24 12:50:49 Removing node(s): [] from the cluster
2021/12/24 12:50:54 Rebalance progress: 100
2021/12/24 12:50:54 Failing over: [127.0.0.1:19003]
2021/12/24 12:50:59 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/24 12:50:59 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/24 12:50:59 No eventing-con process running
2021/12/24 12:50:59 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2021/12/24 12:51:00 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:51:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:51:07 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:51:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:51:12 Deploying app: TestUndeployBackdoorDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:51:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap stored in temp store"
}
2021/12/24 12:51:13 Starting bucket ops to source bucket
2021/12/24 12:51:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:51:23 Context: Post to set retry counter, response code: 200 dump: {
 "code": 0
}
2021/12/24 12:51:23 set retry counter, response &{[123 10 32 34 99 111 100 101 34 58 32 48 10 125] }
2021/12/24 12:52:28 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/24 12:52:28 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/24 12:52:28 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:52:28 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap deleting in background"
}
2021/12/24 12:52:33 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/24 12:52:33 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/24 12:52:33 No eventing-con process running
2021/12/24 12:52:33 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2021/12/24 12:52:34 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:52:44 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:52:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:52:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:52:56 Waiting for dst bucket item count to get to: 0 curr count: 1681
2021/12/24 12:52:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:52:56 Removing node(s): [] from the cluster
2021/12/24 12:53:01 Rebalance progress: 100
--- PASS: TestUndeployBackdoorDuringBootstrap (138.13s)
=== RUN   TestOnUpdateSrcMutation
2021/12/24 12:53:11 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/24 12:53:11 App: TestOnUpdateSrcMutation got un-deployed
2021/12/24 12:53:11 No eventing-con process running
2021/12/24 12:53:11 Function: TestOnUpdateSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutation not found"
}
2021/12/24 12:53:12 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:53:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:53:19 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:53:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:53:24 Deploying app: TestOnUpdateSrcMutation. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:53:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation stored in temp store"
}
2021/12/24 12:53:25 Starting bucket ops to source bucket
2021/12/24 12:53:52 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 12:53:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:53:58 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/24 12:54:03 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/24 12:54:08 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/24 12:54:13 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/24 12:54:13 App: TestOnUpdateSrcMutation got un-deployed
2021/12/24 12:54:13 No eventing-con process running
2021/12/24 12:54:13 Function: TestOnUpdateSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation deleting in background"
}
2021/12/24 12:54:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:54:24 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 12:54:29 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:54:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:54:31 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:54:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutation (94.56s)
=== RUN   TestOnDeleteSrcMutation
2021/12/24 12:54:46 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/24 12:54:46 App: TestOnDeleteSrcMutation got un-deployed
2021/12/24 12:54:46 No eventing-con process running
2021/12/24 12:54:46 Function: TestOnDeleteSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutation not found"
}
2021/12/24 12:54:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:54:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:54:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:54:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:54:59 Deploying app: TestOnDeleteSrcMutation. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:55:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation stored in temp store"
}
2021/12/24 12:55:00 Starting bucket ops to source bucket
2021/12/24 12:55:29 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:55:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:55:34 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/24 12:55:39 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/24 12:55:44 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/24 12:55:49 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/24 12:55:49 App: TestOnDeleteSrcMutation got un-deployed
2021/12/24 12:55:49 No eventing-con process running
2021/12/24 12:55:49 Function: TestOnDeleteSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation deleting in background"
}
2021/12/24 12:55:50 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:56:00 Waiting for dst bucket item count to get to: 0 curr count: 3665
2021/12/24 12:56:05 Waiting for dst bucket item count to get to: 0 curr count: 3665
2021/12/24 12:56:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:56:07 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:56:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutation (96.14s)
=== RUN   TestOnUpdateSrcMutationWithTimer
2021/12/24 12:56:22 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/24 12:56:22 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2021/12/24 12:56:22 No eventing-con process running
2021/12/24 12:56:22 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutationWithTimer not found"
}
2021/12/24 12:56:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:56:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:56:30 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:56:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:56:35 Deploying app: TestOnUpdateSrcMutationWithTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:56:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer stored in temp store"
}
2021/12/24 12:56:36 Starting bucket ops to source bucket
2021/12/24 12:57:13 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 12:57:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:57:18 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/24 12:57:23 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/24 12:57:28 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/24 12:57:33 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/24 12:57:33 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2021/12/24 12:57:33 No eventing-con process running
2021/12/24 12:57:33 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer deleting in background"
}
2021/12/24 12:57:35 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:57:45 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 12:57:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:57:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:57:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutationWithTimer (99.49s)
=== RUN   TestOnDeleteSrcMutationsWithTimer
2021/12/24 12:58:01 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/24 12:58:01 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2021/12/24 12:58:01 No eventing-con process running
2021/12/24 12:58:01 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutationsWithTimer not found"
}
2021/12/24 12:58:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:58:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:58:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:58:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:58:14 Deploying app: TestOnDeleteSrcMutationsWithTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 12:58:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer stored in temp store"
}
2021/12/24 12:58:16 Starting bucket ops to source bucket
2021/12/24 12:58:54 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 12:58:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 12:58:59 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/24 12:59:05 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/24 12:59:10 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/24 12:59:15 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/24 12:59:15 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2021/12/24 12:59:15 No eventing-con process running
2021/12/24 12:59:15 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer deleting in background"
}
2021/12/24 12:59:16 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:59:26 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 12:59:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:59:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:59:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutationsWithTimer (101.37s)
=== RUN   TestInterHandlerRecursion
2021/12/24 12:59:43 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 12:59:43 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/24 12:59:43 No eventing-con process running
2021/12/24 12:59:43 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_source_bucket_update_op not found"
}
2021/12/24 12:59:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:59:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 12:59:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 12:59:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:00:01 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 13:00:01 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/24 13:00:01 No eventing-con process running
2021/12/24 13:00:01 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/24 13:00:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:00:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:00:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:00:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:00:14 Deploying app: TestInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:00:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2021/12/24 13:00:15 response body {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2021/12/24 13:00:20 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 13:00:25 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 13:00:30 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 13:00:35 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 13:00:35 App: TestInterHandlerRecursion_source_bucket_update_op got deployed
2021/12/24 13:00:35 Deploying app: TestInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:00:35 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
}
2021/12/24 13:00:35 response body {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
} err 
2021/12/24 13:00:40 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 13:00:45 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 13:00:50 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 13:00:55 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 13:00:55 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/24 13:00:55 No eventing-con process running
2021/12/24 13:00:55 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2021/12/24 13:00:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:01:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:01:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:01:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:01:13 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 13:01:13 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/24 13:01:13 No eventing-con process running
2021/12/24 13:01:13 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/24 13:01:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:01:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:01:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:01:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterHandlerRecursion (113.66s)
=== RUN   TestInterBucketRecursion
2021/12/24 13:01:31 Deploying app: TestInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:01:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
}
2021/12/24 13:01:33 response body {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
} err 
2021/12/24 13:01:33 Deploying app: TestInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:01:33 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion_function2 causes a cycle involving functions: [TestInterBucketRecursion_function1], hence deployment is disallowed"
}
2021/12/24 13:01:38 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/24 13:01:43 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/24 13:01:48 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/24 13:01:53 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/24 13:01:53 App: TestInterBucketRecursion_function1 got deployed
2021/12/24 13:01:58 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/24 13:02:03 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/24 13:02:08 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/24 13:02:13 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/24 13:02:13 App: TestInterBucketRecursion_function1 got un-deployed
2021/12/24 13:02:13 No eventing-con process running
2021/12/24 13:02:13 Function: TestInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 deleting in background"
}
2021/12/24 13:02:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:02:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:02:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:02:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:02:31 Waiting for app: TestInterBucketRecursion_function2 to get un-deployed
2021/12/24 13:02:31 App: TestInterBucketRecursion_function2 got un-deployed
2021/12/24 13:02:31 No eventing-con process running
2021/12/24 13:02:31 Function: TestInterBucketRecursion_function2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion_function2 not found"
}
2021/12/24 13:02:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:02:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:02:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:02:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion (77.56s)
=== RUN   TestLargeHandler
2021/12/24 13:02:44 Changed force_compress value to false
2021/12/24 13:02:44 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:02:44 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_APPCODE_SIZE",
 "code": 39,
 "description": "Function: TestLargeHandler_function handler Code size is more than 131072. Code Size: 131768"
}
2021/12/24 13:02:44 Changed force_compress value to true
2021/12/24 13:02:44 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:02:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function stored in temp store"
}
2021/12/24 13:02:51 Waiting for app: TestLargeHandler_function to get deployed
2021/12/24 13:02:56 Waiting for app: TestLargeHandler_function to get deployed
2021/12/24 13:03:01 Waiting for app: TestLargeHandler_function to get deployed
2021/12/24 13:03:06 Waiting for app: TestLargeHandler_function to get deployed
2021/12/24 13:03:06 App: TestLargeHandler_function got deployed
2021/12/24 13:03:11 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/24 13:03:16 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/24 13:03:21 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/24 13:03:21 App: TestLargeHandler_function got un-deployed
2021/12/24 13:03:21 No eventing-con process running
2021/12/24 13:03:21 Function: TestLargeHandler_function delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function deleting in background"
}
2021/12/24 13:03:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:03:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:03:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:03:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestLargeHandler (50.46s)
=== RUN   TestAllowInterHandlerRecursion
2021/12/24 13:03:44 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 13:03:44 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/24 13:03:44 No eventing-con process running
2021/12/24 13:03:44 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op not found"
}
2021/12/24 13:03:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:03:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:03:53 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:03:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:04:03 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 13:04:03 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/24 13:04:03 No eventing-con process running
2021/12/24 13:04:03 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/24 13:04:04 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:04:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:04:11 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:04:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:04:16 Deploying app: TestAllowInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:04:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2021/12/24 13:04:17 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2021/12/24 13:04:22 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 13:04:27 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 13:04:32 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 13:04:37 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 13:04:37 App: TestAllowInterHandlerRecursion_source_bucket_update_op got deployed
2021/12/24 13:04:37 Deploying app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:04:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
}
2021/12/24 13:04:38 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
} err 
2021/12/24 13:04:43 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/24 13:04:48 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/24 13:04:53 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/24 13:04:58 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/24 13:04:58 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got deployed
2021/12/24 13:04:58 TestAllowInterHandlerRecursion_src_bucket_op_on_delete is deployed
2021/12/24 13:05:03 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 13:05:08 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 13:05:13 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 13:05:18 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 13:05:18 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/24 13:05:18 No eventing-con process running
2021/12/24 13:05:18 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2021/12/24 13:05:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:05:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:05:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:05:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:05:38 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 13:05:43 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 13:05:48 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 13:05:53 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 13:05:53 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/24 13:05:53 No eventing-con process running
2021/12/24 13:05:53 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete deleting in background"
}
2021/12/24 13:05:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:05:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:06:01 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:06:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterHandlerRecursion (151.45s)
=== RUN   TestAllowInterBucketRecursion
2021/12/24 13:06:11 Deploying app: TestAllowInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:06:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
}
2021/12/24 13:06:12 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
} err 
2021/12/24 13:06:17 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/24 13:06:22 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/24 13:06:27 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/24 13:06:32 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/24 13:06:32 App: TestAllowInterBucketRecursion_function1 got deployed
2021/12/24 13:06:32 Deploying app: TestAllowInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:06:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
}
2021/12/24 13:06:33 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
} err 
2021/12/24 13:06:38 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/24 13:06:43 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/24 13:06:48 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/24 13:06:53 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/24 13:06:53 App: TestAllowInterBucketRecursion_function2 got deployed
2021/12/24 13:06:53 TestAllowInterBucketRecursion_function2 is deployed
2021/12/24 13:06:59 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/24 13:07:04 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/24 13:07:09 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/24 13:07:14 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/24 13:07:14 App: TestAllowInterBucketRecursion_function1 got un-deployed
2021/12/24 13:07:14 No eventing-con process running
2021/12/24 13:07:14 Function: TestAllowInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 deleting in background"
}
2021/12/24 13:07:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:07:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:07:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:07:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:07:33 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/24 13:07:38 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/24 13:07:43 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/24 13:07:48 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/24 13:07:48 App: TestAllowInterBucketRecursion_function2 got un-deployed
2021/12/24 13:07:48 No eventing-con process running
2021/12/24 13:07:48 Function: TestAllowInterBucketRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 deleting in background"
}
2021/12/24 13:07:49 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:07:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:07:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:08:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterBucketRecursion (115.28s)
=== RUN   TestInterBucketRecursion2
2021/12/24 13:08:07 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:08:13 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:08:19 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:08:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:08:30 Deploying app: TestInterBucketRecursion2_function1. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:08:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 stored in temp store"
}
2021/12/24 13:08:36 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/24 13:08:41 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/24 13:08:46 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/24 13:08:51 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/24 13:08:51 App: TestInterBucketRecursion2_function1 got deployed
2021/12/24 13:08:51 Deploying app: TestInterBucketRecursion2_function2. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:08:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 stored in temp store"
}
2021/12/24 13:08:57 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/24 13:09:02 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/24 13:09:07 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/24 13:09:12 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/24 13:09:12 App: TestInterBucketRecursion2_function2 got deployed
2021/12/24 13:09:12 Deploying app: TestInterBucketRecursion2_function3. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:09:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 stored in temp store"
}
2021/12/24 13:09:18 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/24 13:09:24 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/24 13:09:29 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/24 13:09:34 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/24 13:09:34 App: TestInterBucketRecursion2_function3 got deployed
2021/12/24 13:09:34 Deploying app: TestInterBucketRecursion2_function4. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:09:34 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion2_function4 causes a cycle involving functions: [TestInterBucketRecursion2_function1 TestInterBucketRecursion2_function2 TestInterBucketRecursion2_function3], hence deployment is disallowed"
}
2021/12/24 13:09:39 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/24 13:09:44 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/24 13:09:49 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/24 13:09:54 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/24 13:09:54 App: TestInterBucketRecursion2_function1 got un-deployed
2021/12/24 13:09:54 No eventing-con process running
2021/12/24 13:09:54 Function: TestInterBucketRecursion2_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 deleting in background"
}
2021/12/24 13:09:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:10:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:10:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:10:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:10:12 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/24 13:10:17 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/24 13:10:22 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/24 13:10:27 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/24 13:10:27 App: TestInterBucketRecursion2_function2 got un-deployed
2021/12/24 13:10:27 No eventing-con process running
2021/12/24 13:10:27 Function: TestInterBucketRecursion2_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 deleting in background"
}
2021/12/24 13:10:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:10:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:10:36 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:10:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:10:46 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/24 13:10:51 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/24 13:10:56 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/24 13:11:01 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/24 13:11:01 App: TestInterBucketRecursion2_function3 got un-deployed
2021/12/24 13:11:01 No eventing-con process running
2021/12/24 13:11:01 Function: TestInterBucketRecursion2_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 deleting in background"
}
2021/12/24 13:11:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:11:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:11:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:11:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:11:19 Waiting for app: TestInterBucketRecursion2_function4 to get un-deployed
2021/12/24 13:11:19 App: TestInterBucketRecursion2_function4 got un-deployed
2021/12/24 13:11:19 No eventing-con process running
2021/12/24 13:11:19 Function: TestInterBucketRecursion2_function4 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion2_function4 not found"
}
2021/12/24 13:11:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:11:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:11:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:11:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion2 (213.01s)
=== RUN   TestBucketDeleteWithRebOut
2021/12/24 13:11:39 Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/24 13:11:44 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2021/12/24 13:11:47 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 13:12:02 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 13:12:17 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 13:12:32 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 13:12:47 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 13:13:02 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 13:13:17 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 13:13:32 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 13:13:47 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:

vbucket curr owner:


2021/12/24 13:14:02 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:14:02 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 13:14:03 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 13:14:08 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2021/12/24 13:14:08 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:14:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 13:14:08 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 13:14:13 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2021/12/24 13:14:13 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:14:18 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2021/12/24 13:14:18 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2021/12/24 13:14:19 eventingSetup.go:46: No eventing-con process running
2021/12/24 13:14:19 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteWithRebOut not found"
}
2021/12/24 13:14:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:14:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:14:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:14:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:14:36 eventingSetup.go:125: Deploying app: TestBucketDeleteWithRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:14:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut stored in temp store"
}
2021/12/24 13:14:43 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/24 13:14:48 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/24 13:14:53 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/24 13:14:58 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/24 13:14:58 clusterSetup.go:354: App: TestBucketDeleteWithRebOut got deployed

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 172.31.2.134:9300	Node UUID: 9bea86fa17d5b93ea1a7a1f88eadb1d1
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
Producer node: 127.0.0.1:9303	Node UUID: 11e32af51c92adfd2c62d92f6cea93e0
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]
Producer node: 127.0.0.1:9302	Node UUID: aeff0917ae22f47cd27682b462d26cad
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]


2021/12/24 13:14:58 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:14:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 13:15:03 Rebalance progress: 29.16666666666666
2021/12/24 13:15:08 Rebalance progress: 29.16666666666666
2021/12/24 13:15:13 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: aeff0917ae22f47cd27682b462d26cad
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: 9bea86fa17d5b93ea1a7a1f88eadb1d1
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
Producer node: 127.0.0.1:9303	Node UUID: 11e32af51c92adfd2c62d92f6cea93e0
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]


2021/12/24 13:15:13 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:15:13 handler_test.go:1674: Deleting source bucket: default
2021/12/24 13:15:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 13:15:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 13:15:20 Rebalance progress: 29.16666666666666
2021/12/24 13:15:25 Rebalance progress: 29.16666666666666
2021/12/24 13:15:30 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: stopped
	len: 122
	vb list dump: [0, 4-5, 8, 14, 42, 50, 56, 70, 75, 77, 82, 105, 123, 129, 131, 164-166, 174, 177, 196-197, 202, 210, 216, 221, 223, 232, 236, 239-240, 255-256, 278, 296, 306, 311, 316, 326, 331, 343, 349, 354, 356, 390-391, 403, 421, 423, 429, 442-443, 446, 448, 465, 467, 470, 477-478, 481, 483, 498-499, 504-505, 508-509, 571, 583, 591, 599-601, 607, 624, 640, 653-654, 660, 662, 673, 684, 687, 695, 701, 708, 714, 731, 747, 754, 759, 768, 785, 788, 810, 821, 829, 831, 850, 859, 862, 864, 876, 878, 882, 901, 903, 921, 926, 929, 936, 940, 943, 950-951, 968-969, 975, 1004-1005, 1011]
	stream status: running
	len: 902
	vb list dump: [1-3, 6-7, 9-13, 15-41, 43-49, 51-55, 57-69, 71-74, 76, 78-81, 83-104, 106-122, 124-128, 130, 132-163, 167-173, 175-176, 178-195, 198-201, 203-209, 211-215, 217-220, 222, 224-231, 233-235, 237-238, 241-254, 257-277, 279-295, 297-305, 307-310, 312-315, 317-325, 327-330, 332-342, 344-348, 350-353, 355, 357-389, 392-402, 404-420, 422, 424-428, 430-441, 444-445, 447, 449-464, 466, 468-469, 471-476, 479-480, 482, 484-497, 500-503, 506-507, 510-570, 572-582, 584-590, 592-598, 602-606, 608-623, 625-639, 641-652, 655-659, 661, 663-672, 674-683, 685-686, 688-694, 696-700, 702-707, 709-713, 715-730, 732-746, 748-753, 755-758, 760-767, 769-784, 786-787, 789-809, 811-820, 822-828, 830, 832-849, 851-858, 860-861, 863, 865-875, 877, 879-881, 883-900, 902, 904-920, 922-925, 927-928, 930-935, 937-939, 941-942, 944-949, 952-967, 970-974, 976-1003, 1006-1010, 1012-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: aeff0917ae22f47cd27682b462d26cad
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [228-231, 233-235, 237-238, 241-254, 257-277, 279-295, 297-305, 307-310, 312-315, 317-325, 327-330, 332-341]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [1-3, 6-7, 9-13, 15-41, 43-49, 51-55, 57-69, 71-74, 76, 78-81, 83-104, 106-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 99
	v: [114-122, 124-128, 130, 132-163, 167-173, 175-176, 178-195, 198-201, 203-209, 211-215, 217-220, 222, 224-227]
Producer node: 172.31.2.134:9300	Node UUID: 9bea86fa17d5b93ea1a7a1f88eadb1d1
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 99
	v: [911-920, 922-925, 927-928, 930-935, 937-939, 941-942, 944-949, 952-967, 970-974, 976-1003, 1006-1010, 1012-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [683, 685-686, 688-694, 696-700, 702-707, 709-713, 715-730, 732-746, 748-753, 755-758, 760-767, 769-784, 786-787, 789-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [797-809, 811-820, 822-828, 830, 832-849, 851-858, 860-861, 863, 865-875, 877, 879-881, 883-900, 902, 904-910]
Producer node: 127.0.0.1:9303	Node UUID: 11e32af51c92adfd2c62d92f6cea93e0
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 100
	v: [342, 344-348, 350-353, 355, 357-389, 392-402, 404-420, 422, 424-428, 430-441, 444-445, 447, 449-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [456-464, 466, 468-469, 471-476, 479-480, 482, 484-497, 500-503, 506-507, 510-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 99
	v: [570, 572-582, 584-590, 592-598, 602-606, 608-623, 625-639, 641-652, 655-659, 661, 663-672, 674-682]


2021/12/24 13:15:30 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:15:35 eventingSetup.go:719: Waiting for function: TestBucketDeleteWithRebOut status to change to undeployed
2021/12/24 13:15:35 eventingSetup.go:727: Function: TestBucketDeleteWithRebOut status changed to undeployed
2021/12/24 13:15:41 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2021/12/24 13:15:41 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2021/12/24 13:15:41 eventingSetup.go:46: No eventing-con process running
2021/12/24 13:15:41 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut deleting in background"
}
2021/12/24 13:15:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:15:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:15:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:15:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:15:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/24 13:15:54 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 13:15:59 Rebalance progress: 100
--- PASS: TestBucketDeleteWithRebOut (267.69s)
=== RUN   TestN1QLRecursion
2021/12/24 13:16:02 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 13:16:02 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/24 13:16:02 Removing node(s): [] from the cluster
2021/12/24 13:16:07 Rebalance progress: 100
2021/12/24 13:16:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:16:19 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:16:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:16:30 Deploying app: TestN1QLRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:16:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
}
2021/12/24 13:16:32 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
} err 
2021/12/24 13:16:37 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/24 13:16:42 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/24 13:16:47 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/24 13:16:52 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/24 13:16:52 App: TestN1QLRecursion_function1 got deployed
2021/12/24 13:16:52 TestN1QLRecursion_function1 is deployed
2021/12/24 13:16:52 Deploying app: TestN1QLRecursion_function3. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:16:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
}
2021/12/24 13:16:53 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
} err 
2021/12/24 13:16:58 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/24 13:17:03 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/24 13:17:08 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/24 13:17:13 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/24 13:17:13 App: TestN1QLRecursion_function3 got deployed
2021/12/24 13:17:13 TestN1QLRecursion_function3 is deployed
2021/12/24 13:17:13 Deploying app: TestN1QLRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:17:13 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
}
2021/12/24 13:17:13 response body {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
} err 
2021/12/24 13:17:13 Success: TestN1QLRecursion_function2 is not deployed
2021/12/24 13:17:18 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/24 13:17:23 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/24 13:17:28 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/24 13:17:33 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/24 13:17:33 App: TestN1QLRecursion_function1 got un-deployed
2021/12/24 13:17:33 No eventing-con process running
2021/12/24 13:17:33 Function: TestN1QLRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 deleting in background"
}
2021/12/24 13:17:35 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:17:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:17:42 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:17:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:17:52 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/24 13:17:57 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/24 13:18:02 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/24 13:18:07 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/24 13:18:07 App: TestN1QLRecursion_function3 got un-deployed
2021/12/24 13:18:07 No eventing-con process running
2021/12/24 13:18:07 Function: TestN1QLRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 deleting in background"
}
2021/12/24 13:18:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:18:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:18:16 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:18:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:18:22 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 13:18:27 Rebalance progress: 100
--- PASS: TestN1QLRecursion (145.59s)
=== RUN   TestN1QLAllowRecursion
2021/12/24 13:18:27 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 13:18:28 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/24 13:18:28 Removing node(s): [] from the cluster
2021/12/24 13:18:33 Rebalance progress: 100
2021/12/24 13:18:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:18:45 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:18:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:18:56 Deploying app: TestN1QLAllowRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:18:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
}
2021/12/24 13:18:57 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
} err 
2021/12/24 13:19:02 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/24 13:19:07 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/24 13:19:12 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/24 13:19:17 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/24 13:19:17 App: TestN1QLAllowRecursion_function1 got deployed
2021/12/24 13:19:17 TestN1QLAllowRecursion_function1 is deployed
2021/12/24 13:19:17 Deploying app: TestN1QLAllowRecursion_function3. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:19:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
}
2021/12/24 13:19:18 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
} err 
2021/12/24 13:19:23 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/24 13:19:28 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/24 13:19:33 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/24 13:19:38 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/24 13:19:38 App: TestN1QLAllowRecursion_function3 got deployed
2021/12/24 13:19:38 TestN1QLAllowRecursion_function3 is deployed
2021/12/24 13:19:38 Deploying app: TestN1QLAllowRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:19:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
}
2021/12/24 13:19:40 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
} err 
2021/12/24 13:19:45 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/24 13:19:50 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/24 13:19:55 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/24 13:20:00 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/24 13:20:00 App: TestN1QLAllowRecursion_function2 got deployed
2021/12/24 13:20:00 Success: TestN1QLAllowRecursion_function2 is deployed after allow_interbucket_recursion
2021/12/24 13:20:05 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/24 13:20:10 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/24 13:20:15 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/24 13:20:20 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/24 13:20:20 App: TestN1QLAllowRecursion_function1 got un-deployed
2021/12/24 13:20:20 No eventing-con process running
2021/12/24 13:20:20 Function: TestN1QLAllowRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 deleting in background"
}
2021/12/24 13:20:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:20:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:20:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:20:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:20:39 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/24 13:20:44 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/24 13:20:49 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/24 13:20:54 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/24 13:20:54 App: TestN1QLAllowRecursion_function2 got un-deployed
2021/12/24 13:20:54 No eventing-con process running
2021/12/24 13:20:54 Function: TestN1QLAllowRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 deleting in background"
}
2021/12/24 13:20:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:21:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:21:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:21:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:21:13 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/24 13:21:18 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/24 13:21:23 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/24 13:21:23 App: TestN1QLAllowRecursion_function3 got un-deployed
2021/12/24 13:21:23 No eventing-con process running
2021/12/24 13:21:23 Function: TestN1QLAllowRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 deleting in background"
}
2021/12/24 13:21:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:21:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:21:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:21:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:21:38 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 13:21:43 Rebalance progress: 100
--- PASS: TestN1QLAllowRecursion (196.07s)
=== RUN   TestOnDeleteExpiryBucketOp
2021/12/24 13:21:43 Sleeping for some time
2021/12/24 13:21:54 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/24 13:21:54 App: TestOnDeleteExpiryBucketOp got un-deployed
2021/12/24 13:21:54 No eventing-con process running
2021/12/24 13:21:54 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteExpiryBucketOp not found"
}
2021/12/24 13:21:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:22:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:22:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:22:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:22:07 Deploying app: TestOnDeleteExpiryBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:22:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp stored in temp store"
}
2021/12/24 13:22:08 Starting bucket ops to source bucket
2021/12/24 13:22:57 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 13:23:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 13:23:07 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/24 13:23:07 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 13:23:07 Starting bucket ops to source bucket
2021/12/24 13:23:09 Starting bucket ops to source bucket
2021/12/24 13:24:14 Waiting for dst bucket item count to get to: 7000 curr count: 5000
2021/12/24 13:24:19 Waiting for dst bucket item count to get to: 7000 curr count: 5831
2021/12/24 13:24:24 Waiting for dst bucket item count to get to: 7000 curr count: 6831
2021/12/24 13:24:29 Waiting for dst bucket item count to get to: 7000 curr count: 6831
2021/12/24 13:24:29 src & dst bucket item count matched up. src bucket count: 7000 dst bucket count: 7000
2021/12/24 13:24:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:24:35 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/24 13:24:40 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/24 13:24:45 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/24 13:24:50 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/24 13:24:50 App: TestOnDeleteExpiryBucketOp got un-deployed
2021/12/24 13:24:50 No eventing-con process running
2021/12/24 13:24:50 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp deleting in background"
}
2021/12/24 13:24:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:25:02 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 13:25:07 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 13:25:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:25:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:25:19 Waiting for dst bucket item count to get to: 0 curr count: 5933
2021/12/24 13:25:24 Waiting for dst bucket item count to get to: 0 curr count: 2433
2021/12/24 13:25:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteExpiryBucketOp (220.03s)
=== RUN   TestTimerOverWriteSameReference
2021/12/24 13:25:29 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/24 13:25:29 App: TestTimerOverWriteSameReference got un-deployed
2021/12/24 13:25:29 No eventing-con process running
2021/12/24 13:25:29 Function: TestTimerOverWriteSameReference delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverWriteSameReference not found"
}
2021/12/24 13:25:30 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:25:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:25:37 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:25:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:25:42 Deploying app: TestTimerOverWriteSameReference. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:25:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference stored in temp store"
}
2021/12/24 13:25:48 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/24 13:25:53 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/24 13:25:58 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/24 13:26:03 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/24 13:26:03 App: TestTimerOverWriteSameReference got deployed
2021/12/24 13:26:13 Starting bucket ops to source bucket
2021/12/24 13:27:15 src & dst bucket item count matched up. src bucket count: 1 dst bucket count: 1
2021/12/24 13:27:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:27:30 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/24 13:27:35 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/24 13:27:40 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/24 13:27:45 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/24 13:27:45 App: TestTimerOverWriteSameReference got un-deployed
2021/12/24 13:27:45 No eventing-con process running
2021/12/24 13:27:45 Function: TestTimerOverWriteSameReference delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference deleting in background"
}
2021/12/24 13:27:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:27:57 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 13:27:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:27:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:28:08 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/24 13:28:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverWriteSameReference (164.95s)
=== RUN   TestCancelTimerBucketop
2021/12/24 13:28:13 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/24 13:28:13 App: TestCancelTimerBucketop got un-deployed
2021/12/24 13:28:14 No eventing-con process running
2021/12/24 13:28:14 Function: TestCancelTimerBucketop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCancelTimerBucketop not found"
}
2021/12/24 13:28:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:28:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:28:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:28:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:28:27 Deploying app: TestCancelTimerBucketop. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:28:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop stored in temp store"
}
2021/12/24 13:28:33 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/24 13:28:38 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/24 13:28:43 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/24 13:28:48 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/24 13:28:48 App: TestCancelTimerBucketop got deployed
2021/12/24 13:28:48 Starting bucket ops to source bucket
2021/12/24 13:28:56 Starting bucket ops to source bucket
2021/12/24 13:29:58 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/24 13:29:58 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:30:03 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/24 13:30:08 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/24 13:30:13 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/24 13:30:18 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/24 13:30:18 App: TestCancelTimerBucketop got un-deployed
2021/12/24 13:30:18 No eventing-con process running
2021/12/24 13:30:18 Function: TestCancelTimerBucketop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop deleting in background"
}
2021/12/24 13:30:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:30:30 Waiting for dst bucket item count to get to: 0 curr count: 625
2021/12/24 13:30:35 Waiting for dst bucket item count to get to: 0 curr count: 625
2021/12/24 13:30:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:30:37 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:30:47 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 13:30:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCancelTimerBucketop (158.31s)
=== RUN   TestJSExpiryDate
2021/12/24 13:30:52 Starting bucket ops to source bucket
2021/12/24 13:31:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 13:31:05 Deploying app: TestJSExpiryDate. Item count src bucket: 5000 dst bucket: 0
2021/12/24 13:31:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate stored in temp store"
}
2021/12/24 13:31:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:31:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:31:41 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/24 13:31:46 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/24 13:31:51 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/24 13:31:56 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/24 13:31:56 App: TestJSExpiryDate got un-deployed
2021/12/24 13:31:56 No eventing-con process running
2021/12/24 13:31:56 Function: TestJSExpiryDate delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate deleting in background"
}
2021/12/24 13:31:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:32:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:32:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:32:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestJSExpiryDate (83.81s)
=== RUN   TestBinaryDoc
2021/12/24 13:32:16 Starting bucket ops to source bucket
2021/12/24 13:32:16 Deploying app: TestBinaryDoc. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:32:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc stored in temp store"
}
2021/12/24 13:32:17 Starting bucket ops to source bucket
2021/12/24 13:32:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:32:17 Deleting source bucket docs now
2021/12/24 13:32:17 Starting bucket ops to source bucket
2021/12/24 13:32:54 Waiting for dst bucket item count to get to: 32 curr count: 21
2021/12/24 13:32:59 Waiting for dst bucket item count to get to: 32 curr count: 31
2021/12/24 13:33:04 Waiting for dst bucket item count to get to: 32 curr count: 31
2021/12/24 13:33:04 src & dst bucket item count matched up. src bucket count: 32 dst bucket count: 32
2021/12/24 13:33:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:33:09 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/24 13:33:14 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/24 13:33:19 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/24 13:33:24 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/24 13:33:24 App: TestBinaryDoc got un-deployed
2021/12/24 13:33:24 No eventing-con process running
2021/12/24 13:33:24 Function: TestBinaryDoc delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc deleting in background"
}
2021/12/24 13:33:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:33:36 Waiting for dst bucket item count to get to: 0 curr count: 32
2021/12/24 13:33:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:33:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:33:48 Waiting for dst bucket item count to get to: 0 curr count: 20
2021/12/24 13:33:53 Waiting for dst bucket item count to get to: 0 curr count: 4
2021/12/24 13:33:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBinaryDoc (102.35s)
=== RUN   TestConstantBindings
2021/12/24 13:33:53 Deploying app: TestConstantBindings. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:33:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings stored in temp store"
}
2021/12/24 13:33:54 Starting bucket ops to source bucket
2021/12/24 13:34:00 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/24 13:34:05 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/24 13:34:10 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/24 13:34:15 Waiting for dst bucket item count to get to: 6000 curr count: 1760
2021/12/24 13:34:20 Waiting for dst bucket item count to get to: 6000 curr count: 4760
2021/12/24 13:34:20 src & dst bucket item count matched up. src bucket count: 6000 dst bucket count: 6000
2021/12/24 13:34:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:34:25 Waiting for app: TestConstantBindings to get un-deployed
2021/12/24 13:34:30 Waiting for app: TestConstantBindings to get un-deployed
2021/12/24 13:34:35 Waiting for app: TestConstantBindings to get un-deployed
2021/12/24 13:34:40 Waiting for app: TestConstantBindings to get un-deployed
2021/12/24 13:34:40 App: TestConstantBindings got un-deployed
2021/12/24 13:34:40 No eventing-con process running
2021/12/24 13:34:40 Function: TestConstantBindings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings deleting in background"
}
2021/12/24 13:34:42 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:34:52 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 13:34:57 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 13:34:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:34:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:35:09 Waiting for dst bucket item count to get to: 0 curr count: 5454
2021/12/24 13:35:14 Waiting for dst bucket item count to get to: 0 curr count: 2454
2021/12/24 13:35:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestConstantBindings (80.74s)
=== RUN   TestCodeInsight
2021/12/24 13:35:19 Waiting for app: TestCodeInsight to get un-deployed
2021/12/24 13:35:19 App: TestCodeInsight got un-deployed
2021/12/24 13:35:19 No eventing-con process running
2021/12/24 13:35:19 Function: TestCodeInsight delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCodeInsight not found"
}
2021/12/24 13:35:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:35:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:35:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:35:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:35:32 Starting bucket ops to source bucket
2021/12/24 13:35:33 Deploying app: TestCodeInsight. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:35:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight stored in temp store"
}
2021/12/24 13:35:39 Waiting for app: TestCodeInsight to get deployed
2021/12/24 13:35:44 Waiting for app: TestCodeInsight to get deployed
2021/12/24 13:35:49 Waiting for app: TestCodeInsight to get deployed
2021/12/24 13:35:54 Waiting for app: TestCodeInsight to get deployed
2021/12/24 13:35:54 App: TestCodeInsight got deployed
2021/12/24 13:35:59 Waiting for dst bucket item count to get to: 1000 curr count: 850
2021/12/24 13:35:59 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/24 13:36:04 Waiting for app: TestCodeInsight to get un-deployed
2021/12/24 13:36:10 Waiting for app: TestCodeInsight to get un-deployed
2021/12/24 13:36:15 Waiting for app: TestCodeInsight to get un-deployed
2021/12/24 13:36:20 Waiting for app: TestCodeInsight to get un-deployed
2021/12/24 13:36:20 App: TestCodeInsight got un-deployed
2021/12/24 13:36:20 No eventing-con process running
2021/12/24 13:36:20 Function: TestCodeInsight delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight deleting in background"
}
2021/12/24 13:36:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:36:31 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 13:36:36 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 13:36:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:36:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:36:48 Waiting for dst bucket item count to get to: 0 curr count: 764
2021/12/24 13:36:53 Waiting for dst bucket item count to get to: 0 curr count: 264
2021/12/24 13:36:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCodeInsight (99.49s)
=== RUN   TestParserTransform
--- PASS: TestParserTransform (0.04s)
=== RUN   TestParserDetect
--- PASS: TestParserDetect (0.00s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	12752.647s

Functional tests took 3 hours, 32 minutes and 35 seconds.

N1ql tests

2021/12/24 13:37:03 Started n1ql
2021/12/24 13:37:12 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/24 13:37:12 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/24 13:37:12 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 13:37:12 Removing node(s): [] from the cluster
2021/12/24 13:37:17 Rebalance progress: 100
=== RUN   TestRecursiveMutationN1QL
2021/12/24 13:37:22 Waiting for app: TestRecursiveMutationN1QL to get un-deployed
2021/12/24 13:37:22 App: TestRecursiveMutationN1QL got un-deployed
2021/12/24 13:37:22 No eventing-con process running
2021/12/24 13:37:22 Function: TestRecursiveMutationN1QL delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestRecursiveMutationN1QL not found"
}
2021/12/24 13:37:24 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:37:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:37:31 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:37:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:37:36 Deploying app: TestRecursiveMutationN1QL. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:37:36 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Function: TestRecursiveMutationN1QL N1QL DML to source keyspace default:default"
}
--- PASS: TestRecursiveMutationN1QL (18.49s)
=== RUN   TestFlexReset1
2021/12/24 13:37:41 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/24 13:37:41 App: TestFlexReset1 got un-deployed
2021/12/24 13:37:41 No eventing-con process running
2021/12/24 13:37:41 Function: TestFlexReset1 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset1 not found"
}
2021/12/24 13:37:43 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:37:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:37:49 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:37:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:37:54 Starting bucket ops to source bucket
2021/12/24 13:37:55 Deploying app: TestFlexReset1. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:37:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 stored in temp store"
}
2021/12/24 13:38:01 Waiting for app: TestFlexReset1 to get deployed
2021/12/24 13:38:06 Waiting for app: TestFlexReset1 to get deployed
2021/12/24 13:38:11 Waiting for app: TestFlexReset1 to get deployed
2021/12/24 13:38:16 Waiting for app: TestFlexReset1 to get deployed
2021/12/24 13:38:16 App: TestFlexReset1 got deployed
2021/12/24 13:38:21 Waiting for dst bucket item count to get to: 1000 curr count: 158
2021/12/24 13:38:21 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/24 13:38:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:38:26 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/24 13:38:32 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/24 13:38:37 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/24 13:38:42 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/24 13:38:42 App: TestFlexReset1 got un-deployed
2021/12/24 13:38:42 No eventing-con process running
2021/12/24 13:38:42 Function: TestFlexReset1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 deleting in background"
}
2021/12/24 13:38:43 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:38:53 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 13:38:58 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/24 13:38:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:39:00 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:39:10 Waiting for dst bucket item count to get to: 0 curr count: 714
2021/12/24 13:39:15 Waiting for dst bucket item count to get to: 0 curr count: 714
2021/12/24 13:39:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset1 (99.38s)
=== RUN   TestFlexReset2
2021/12/24 13:39:20 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/24 13:39:20 App: TestFlexReset2 got un-deployed
2021/12/24 13:39:20 No eventing-con process running
2021/12/24 13:39:20 Function: TestFlexReset2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset2 not found"
}
2021/12/24 13:39:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:39:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:39:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:39:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:39:34 Starting bucket ops to source bucket
2021/12/24 13:39:34 Deploying app: TestFlexReset2. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:39:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 stored in temp store"
}
2021/12/24 13:39:41 Waiting for app: TestFlexReset2 to get deployed
2021/12/24 13:39:46 Waiting for app: TestFlexReset2 to get deployed
2021/12/24 13:39:51 Waiting for app: TestFlexReset2 to get deployed
2021/12/24 13:39:56 Waiting for app: TestFlexReset2 to get deployed
2021/12/24 13:39:56 App: TestFlexReset2 got deployed
2021/12/24 13:40:01 Waiting for dst bucket item count to get to: 1000 curr count: 258
2021/12/24 13:40:06 Waiting for dst bucket item count to get to: 1000 curr count: 750
2021/12/24 13:40:06 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/24 13:40:06 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:40:11 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/24 13:40:16 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/24 13:40:21 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/24 13:40:26 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/24 13:40:26 App: TestFlexReset2 got un-deployed
2021/12/24 13:40:26 No eventing-con process running
2021/12/24 13:40:26 Function: TestFlexReset2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 deleting in background"
}
2021/12/24 13:40:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:40:38 Waiting for dst bucket item count to get to: 0 curr count: 550
2021/12/24 13:40:43 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 13:40:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:40:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:40:54 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 13:40:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset2 (99.25s)
=== RUN   TestN1QLLabelledBreak
2021/12/24 13:40:59 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/24 13:40:59 App: TestN1QLLabelledBreak got un-deployed
2021/12/24 13:40:59 No eventing-con process running
2021/12/24 13:40:59 Function: TestN1QLLabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLLabelledBreak not found"
}
2021/12/24 13:41:01 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:41:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:41:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:41:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:41:13 Deploying app: TestN1QLLabelledBreak. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:41:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak stored in temp store"
}
2021/12/24 13:41:19 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/24 13:41:24 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/24 13:41:29 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/24 13:41:34 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/24 13:41:34 App: TestN1QLLabelledBreak got deployed
2021/12/24 13:41:34 Starting bucket ops to source bucket
2021/12/24 13:41:44 Waiting for dst bucket item count to get to: 10000 curr count: 0
2021/12/24 13:41:49 Waiting for dst bucket item count to get to: 10000 curr count: 200
2021/12/24 13:41:54 Waiting for dst bucket item count to get to: 10000 curr count: 631
2021/12/24 13:41:59 Waiting for dst bucket item count to get to: 10000 curr count: 2450
2021/12/24 13:42:04 Waiting for dst bucket item count to get to: 10000 curr count: 4489
2021/12/24 13:42:09 Waiting for dst bucket item count to get to: 10000 curr count: 6558
2021/12/24 13:42:14 Waiting for dst bucket item count to get to: 10000 curr count: 8596
2021/12/24 13:42:19 Waiting for dst bucket item count to get to: 10000 curr count: 9508
2021/12/24 13:42:19 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 13:42:19 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:42:24 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/24 13:42:29 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/24 13:42:34 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/24 13:42:39 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/24 13:42:39 App: TestN1QLLabelledBreak got un-deployed
2021/12/24 13:42:39 No eventing-con process running
2021/12/24 13:42:39 Function: TestN1QLLabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak deleting in background"
}
2021/12/24 13:42:41 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:42:51 Waiting for dst bucket item count to get to: 0 curr count: 4595
2021/12/24 13:42:56 Waiting for dst bucket item count to get to: 0 curr count: 4595
2021/12/24 13:42:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:42:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:43:08 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 13:43:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLLabelledBreak (133.16s)
=== RUN   TestN1QLUnlabelledBreak
2021/12/24 13:43:13 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/24 13:43:13 App: TestN1QLUnlabelledBreak got un-deployed
2021/12/24 13:43:13 No eventing-con process running
2021/12/24 13:43:13 Function: TestN1QLUnlabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLUnlabelledBreak not found"
}
2021/12/24 13:43:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:43:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:43:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:43:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:43:26 Deploying app: TestN1QLUnlabelledBreak. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:43:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak stored in temp store"
}
2021/12/24 13:43:32 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/24 13:43:37 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/24 13:43:42 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/24 13:43:47 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/24 13:43:47 App: TestN1QLUnlabelledBreak got deployed
2021/12/24 13:43:47 Starting bucket ops to source bucket
2021/12/24 13:43:57 Waiting for dst bucket item count to get to: 10000 curr count: 179
2021/12/24 13:44:02 Waiting for dst bucket item count to get to: 10000 curr count: 179
2021/12/24 13:44:07 Waiting for dst bucket item count to get to: 10000 curr count: 4517
2021/12/24 13:44:12 Waiting for dst bucket item count to get to: 10000 curr count: 4517
2021/12/24 13:44:17 Waiting for dst bucket item count to get to: 10000 curr count: 4517
2021/12/24 13:44:22 Waiting for dst bucket item count to get to: 10000 curr count: 9837
2021/12/24 13:44:27 Waiting for dst bucket item count to get to: 10000 curr count: 9837
2021/12/24 13:44:27 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 13:44:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:44:32 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/24 13:44:37 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/24 13:44:42 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/24 13:44:47 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/24 13:44:47 App: TestN1QLUnlabelledBreak got un-deployed
2021/12/24 13:44:47 No eventing-con process running
2021/12/24 13:44:48 Function: TestN1QLUnlabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak deleting in background"
}
2021/12/24 13:44:49 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:44:59 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 13:45:04 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 13:45:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:45:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:45:16 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 13:45:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLUnlabelledBreak (128.48s)
=== RUN   TestN1QLThrowStatement
2021/12/24 13:45:21 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/24 13:45:21 App: TestN1QLThrowStatement got un-deployed
2021/12/24 13:45:21 No eventing-con process running
2021/12/24 13:45:21 Function: TestN1QLThrowStatement delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLThrowStatement not found"
}
2021/12/24 13:45:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:45:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:45:30 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:45:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:45:35 Deploying app: TestN1QLThrowStatement. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:45:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement stored in temp store"
}
2021/12/24 13:45:41 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/24 13:45:46 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/24 13:45:51 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/24 13:45:56 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/24 13:45:56 App: TestN1QLThrowStatement got deployed
2021/12/24 13:45:56 Starting bucket ops to source bucket
2021/12/24 13:46:05 Waiting for dst bucket item count to get to: 10000 curr count: 316
2021/12/24 13:46:10 Waiting for dst bucket item count to get to: 10000 curr count: 316
2021/12/24 13:46:15 Waiting for dst bucket item count to get to: 10000 curr count: 316
2021/12/24 13:46:20 Waiting for dst bucket item count to get to: 10000 curr count: 3779
2021/12/24 13:46:25 Waiting for dst bucket item count to get to: 10000 curr count: 3779
2021/12/24 13:46:30 Waiting for dst bucket item count to get to: 10000 curr count: 7775
2021/12/24 13:46:35 Waiting for dst bucket item count to get to: 10000 curr count: 7775
2021/12/24 13:46:35 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 13:46:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:46:41 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/24 13:46:46 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/24 13:46:51 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/24 13:46:56 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/24 13:46:56 App: TestN1QLThrowStatement got un-deployed
2021/12/24 13:46:56 No eventing-con process running
2021/12/24 13:46:56 Function: TestN1QLThrowStatement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement deleting in background"
}
2021/12/24 13:46:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:47:07 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 13:47:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:47:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:47:19 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 13:47:24 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 13:47:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLThrowStatement (128.15s)
=== RUN   TestN1QLNestedForLoop
2021/12/24 13:47:29 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/24 13:47:29 App: TestN1QLNestedForLoop got un-deployed
2021/12/24 13:47:29 No eventing-con process running
2021/12/24 13:47:29 Function: TestN1QLNestedForLoop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLNestedForLoop not found"
}
2021/12/24 13:47:31 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:47:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:47:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:47:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:47:43 Deploying app: TestN1QLNestedForLoop. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:47:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop stored in temp store"
}
2021/12/24 13:47:49 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/24 13:47:54 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/24 13:47:59 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/24 13:48:04 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/24 13:48:04 App: TestN1QLNestedForLoop got deployed
2021/12/24 13:48:04 Starting bucket ops to source bucket
2021/12/24 13:48:14 Waiting for dst bucket item count to get to: 5000 curr count: 105
2021/12/24 13:48:19 Waiting for dst bucket item count to get to: 5000 curr count: 105
2021/12/24 13:48:24 Waiting for dst bucket item count to get to: 5000 curr count: 350
2021/12/24 13:48:29 Waiting for dst bucket item count to get to: 5000 curr count: 1419
2021/12/24 13:48:34 Waiting for dst bucket item count to get to: 5000 curr count: 2607
2021/12/24 13:48:39 Waiting for dst bucket item count to get to: 5000 curr count: 3797
2021/12/24 13:48:44 Waiting for dst bucket item count to get to: 5000 curr count: 4864
2021/12/24 13:48:44 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 13:48:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:48:49 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/24 13:48:54 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/24 13:48:59 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/24 13:49:04 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/24 13:49:04 App: TestN1QLNestedForLoop got un-deployed
2021/12/24 13:49:04 No eventing-con process running
2021/12/24 13:49:04 Function: TestN1QLNestedForLoop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop deleting in background"
}
2021/12/24 13:49:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:49:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 13:49:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:49:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:49:28 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 13:49:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLNestedForLoop (123.30s)
=== RUN   TestN1QLAutoClose
2021/12/24 13:49:33 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/24 13:49:33 App: TestN1QLAutoClose got un-deployed
2021/12/24 13:49:33 No eventing-con process running
2021/12/24 13:49:33 Function: TestN1QLAutoClose delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLAutoClose not found"
}
2021/12/24 13:49:34 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:49:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:49:41 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:49:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:49:46 Deploying app: TestN1QLAutoClose. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:49:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose stored in temp store"
}
2021/12/24 13:49:52 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/24 13:49:57 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/24 13:50:02 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/24 13:50:07 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/24 13:50:07 App: TestN1QLAutoClose got deployed
2021/12/24 13:50:07 Starting bucket ops to source bucket
2021/12/24 13:50:13 Waiting for dst bucket item count to get to: 500 curr count: 0
2021/12/24 13:50:18 Waiting for dst bucket item count to get to: 500 curr count: 1
2021/12/24 13:50:23 Waiting for dst bucket item count to get to: 500 curr count: 1
2021/12/24 13:50:28 Waiting for dst bucket item count to get to: 500 curr count: 22
2021/12/24 13:50:33 Waiting for dst bucket item count to get to: 500 curr count: 22
2021/12/24 13:50:38 Waiting for dst bucket item count to get to: 500 curr count: 45
2021/12/24 13:50:43 Waiting for dst bucket item count to get to: 500 curr count: 45
2021/12/24 13:50:48 Waiting for dst bucket item count to get to: 500 curr count: 68
2021/12/24 13:50:53 Waiting for dst bucket item count to get to: 500 curr count: 68
2021/12/24 13:50:58 Waiting for dst bucket item count to get to: 500 curr count: 89
2021/12/24 13:51:03 Waiting for dst bucket item count to get to: 500 curr count: 98
2021/12/24 13:51:08 Waiting for dst bucket item count to get to: 500 curr count: 110
2021/12/24 13:51:13 Waiting for dst bucket item count to get to: 500 curr count: 118
2021/12/24 13:51:18 Waiting for dst bucket item count to get to: 500 curr count: 118
2021/12/24 13:51:23 Waiting for dst bucket item count to get to: 500 curr count: 130
2021/12/24 13:51:28 Waiting for dst bucket item count to get to: 500 curr count: 141
2021/12/24 13:51:33 Waiting for dst bucket item count to get to: 500 curr count: 152
2021/12/24 13:51:38 Waiting for dst bucket item count to get to: 500 curr count: 162
2021/12/24 13:51:43 Waiting for dst bucket item count to get to: 500 curr count: 174
2021/12/24 13:51:48 Waiting for dst bucket item count to get to: 500 curr count: 184
2021/12/24 13:51:53 Waiting for dst bucket item count to get to: 500 curr count: 197
2021/12/24 13:51:58 Waiting for dst bucket item count to get to: 500 curr count: 209
2021/12/24 13:52:03 Waiting for dst bucket item count to get to: 500 curr count: 218
2021/12/24 13:52:08 Waiting for dst bucket item count to get to: 500 curr count: 227
2021/12/24 13:52:13 Waiting for dst bucket item count to get to: 500 curr count: 238
2021/12/24 13:52:18 Waiting for dst bucket item count to get to: 500 curr count: 248
2021/12/24 13:52:23 Waiting for dst bucket item count to get to: 500 curr count: 259
2021/12/24 13:52:28 Waiting for dst bucket item count to get to: 500 curr count: 269
2021/12/24 13:52:33 Waiting for dst bucket item count to get to: 500 curr count: 281
2021/12/24 13:52:38 Waiting for dst bucket item count to get to: 500 curr count: 302
2021/12/24 13:52:43 Waiting for dst bucket item count to get to: 500 curr count: 302
2021/12/24 13:52:48 Waiting for dst bucket item count to get to: 500 curr count: 323
2021/12/24 13:52:53 Waiting for dst bucket item count to get to: 500 curr count: 323
2021/12/24 13:52:58 Waiting for dst bucket item count to get to: 500 curr count: 345
2021/12/24 13:53:03 Waiting for dst bucket item count to get to: 500 curr count: 345
2021/12/24 13:53:08 Waiting for dst bucket item count to get to: 500 curr count: 363
2021/12/24 13:53:13 Waiting for dst bucket item count to get to: 500 curr count: 363
2021/12/24 13:53:18 Waiting for dst bucket item count to get to: 500 curr count: 385
2021/12/24 13:53:23 Waiting for dst bucket item count to get to: 500 curr count: 385
2021/12/24 13:53:28 Waiting for dst bucket item count to get to: 500 curr count: 406
2021/12/24 13:53:33 Waiting for dst bucket item count to get to: 500 curr count: 406
2021/12/24 13:53:38 Waiting for dst bucket item count to get to: 500 curr count: 426
2021/12/24 13:53:43 Waiting for dst bucket item count to get to: 500 curr count: 426
2021/12/24 13:53:48 Waiting for dst bucket item count to get to: 500 curr count: 448
2021/12/24 13:53:53 Waiting for dst bucket item count to get to: 500 curr count: 448
2021/12/24 13:53:58 Waiting for dst bucket item count to get to: 500 curr count: 470
2021/12/24 13:54:03 Waiting for dst bucket item count to get to: 500 curr count: 470
2021/12/24 13:54:08 Waiting for dst bucket item count to get to: 500 curr count: 490
2021/12/24 13:54:13 Waiting for dst bucket item count to get to: 500 curr count: 490
2021/12/24 13:54:13 src & dst bucket item count matched up. src bucket count: 500 dst bucket count: 500
2021/12/24 13:54:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:54:19 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/24 13:54:24 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/24 13:54:29 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/24 13:54:34 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/24 13:54:34 App: TestN1QLAutoClose got un-deployed
2021/12/24 13:54:34 No eventing-con process running
2021/12/24 13:54:34 Function: TestN1QLAutoClose delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose deleting in background"
}
2021/12/24 13:54:35 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:54:45 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/24 13:54:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:54:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:54:57 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/24 13:54:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLAutoClose (329.65s)
=== RUN   TestN1QLPosParams
2021/12/24 13:55:02 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/24 13:55:02 App: TestN1QLPosParams got un-deployed
2021/12/24 13:55:02 No eventing-con process running
2021/12/24 13:55:02 Function: TestN1QLPosParams delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLPosParams not found"
}
2021/12/24 13:55:04 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:55:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:55:11 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:55:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:55:16 Deploying app: TestN1QLPosParams. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:55:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams stored in temp store"
}
2021/12/24 13:55:22 Waiting for app: TestN1QLPosParams to get deployed
2021/12/24 13:55:27 Waiting for app: TestN1QLPosParams to get deployed
2021/12/24 13:55:32 Waiting for app: TestN1QLPosParams to get deployed
2021/12/24 13:55:37 Waiting for app: TestN1QLPosParams to get deployed
2021/12/24 13:55:37 App: TestN1QLPosParams got deployed
2021/12/24 13:55:37 Starting bucket ops to source bucket
2021/12/24 13:55:47 Waiting for dst bucket item count to get to: 5000 curr count: 353
2021/12/24 13:55:52 Waiting for dst bucket item count to get to: 5000 curr count: 353
2021/12/24 13:55:52 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 13:55:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:55:57 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/24 13:56:02 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/24 13:56:07 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/24 13:56:12 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/24 13:56:12 App: TestN1QLPosParams got un-deployed
2021/12/24 13:56:12 No eventing-con process running
2021/12/24 13:56:12 Function: TestN1QLPosParams delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams deleting in background"
}
2021/12/24 13:56:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:56:24 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 13:56:29 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 13:56:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:56:31 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:56:41 Waiting for dst bucket item count to get to: 0 curr count: 4200
2021/12/24 13:56:46 Waiting for dst bucket item count to get to: 0 curr count: 4200
2021/12/24 13:56:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLPosParams (108.38s)
=== RUN   TestN1QLExhaustConnPool
2021/12/24 13:56:51 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/24 13:56:51 App: TestN1QLExhaustConnPool got un-deployed
2021/12/24 13:56:51 No eventing-con process running
2021/12/24 13:56:51 Function: TestN1QLExhaustConnPool delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLExhaustConnPool not found"
}
2021/12/24 13:56:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:56:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:56:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:57:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:57:04 Deploying app: TestN1QLExhaustConnPool. Item count src bucket: 0 dst bucket: 0
2021/12/24 13:57:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool stored in temp store"
}
2021/12/24 13:57:10 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/24 13:57:15 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/24 13:57:20 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/24 13:57:25 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/24 13:57:25 App: TestN1QLExhaustConnPool got deployed
2021/12/24 13:57:25 Starting bucket ops to source bucket
2021/12/24 13:57:31 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 13:57:36 Waiting for dst bucket item count to get to: 100 curr count: 74
2021/12/24 13:57:41 Waiting for dst bucket item count to get to: 100 curr count: 74
2021/12/24 13:57:41 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 13:57:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 13:57:46 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/24 13:57:51 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/24 13:57:56 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/24 13:58:01 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/24 13:58:01 App: TestN1QLExhaustConnPool got un-deployed
2021/12/24 13:58:01 No eventing-con process running
2021/12/24 13:58:01 Function: TestN1QLExhaustConnPool delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool deleting in background"
}
2021/12/24 13:58:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:58:13 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 13:58:18 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 13:58:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:58:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:58:30 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 13:58:35 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 13:58:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLExhaustConnPool (108.95s)
=== RUN   TestN1QLGraceSufficientTimeOut
2021/12/24 13:58:40 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/24 13:58:40 App: TestN1QLGraceSufficientTimeOut got un-deployed
2021/12/24 13:58:40 No eventing-con process running
2021/12/24 13:58:40 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLGraceSufficientTimeOut not found"
}
2021/12/24 13:58:41 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:58:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:58:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 13:58:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 13:58:53 Starting bucket ops to source bucket
2021/12/24 13:59:10 Starting bucket ops to source bucket
2021/12/24 13:59:28 Deploying app: TestN1QLGraceSufficientTimeOut. Item count src bucket: 30000 dst bucket: 13937
2021/12/24 13:59:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut stored in temp store"
}
2021/12/24 13:59:34 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/24 13:59:39 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/24 13:59:44 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/24 13:59:49 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/24 13:59:49 App: TestN1QLGraceSufficientTimeOut got deployed
2021/12/24 13:59:49 Starting bucket ops to source bucket
2021/12/24 13:59:54 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 13:59:59 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 14:00:04 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 14:00:09 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 14:00:14 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 14:00:19 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 14:00:24 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 14:00:29 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 14:00:34 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 14:00:39 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 14:00:44 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 14:00:44 src & dst bucket item count matched up. src bucket count: 30001 dst bucket count: 30001
2021/12/24 14:00:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 14:00:49 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/24 14:00:54 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/24 14:00:59 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/24 14:01:04 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/24 14:01:04 App: TestN1QLGraceSufficientTimeOut got un-deployed
2021/12/24 14:01:04 No eventing-con process running
2021/12/24 14:01:04 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut deleting in background"
}
2021/12/24 14:01:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 14:01:16 Waiting for dst bucket item count to get to: 0 curr count: 30000
2021/12/24 14:01:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:01:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 14:01:28 Waiting for dst bucket item count to get to: 0 curr count: 20213
2021/12/24 14:01:33 Waiting for dst bucket item count to get to: 0 curr count: 5213
2021/12/24 14:01:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLGraceSufficientTimeOut (178.36s)
=== RUN   TestN1QLQueryConsistency
2021/12/24 14:01:38 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/24 14:01:38 App: n1qlquery_consistency got un-deployed
2021/12/24 14:01:38 No eventing-con process running
2021/12/24 14:01:38 Function: n1qlquery_consistency delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: n1qlquery_consistency not found"
}
2021/12/24 14:01:40 Context: Bucket flush, response code: 200 dump: 
2021/12/24 14:01:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:01:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 14:01:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:01:52 Starting bucket ops to source bucket
2021/12/24 14:01:54 Deploying app: n1qlquery_consistency. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:01:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency stored in temp store"
}
2021/12/24 14:02:01 Waiting for app: n1qlquery_consistency to get deployed
2021/12/24 14:02:06 Waiting for app: n1qlquery_consistency to get deployed
2021/12/24 14:02:11 Waiting for app: n1qlquery_consistency to get deployed
2021/12/24 14:02:16 Waiting for app: n1qlquery_consistency to get deployed
2021/12/24 14:02:16 App: n1qlquery_consistency got deployed
2021/12/24 14:02:21 Waiting for dst bucket item count to get to: 5000 curr count: 305
2021/12/24 14:02:26 Waiting for dst bucket item count to get to: 5000 curr count: 305
2021/12/24 14:02:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 14:02:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 14:02:31 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/24 14:02:36 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/24 14:02:41 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/24 14:02:46 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/24 14:02:46 App: n1qlquery_consistency got un-deployed
2021/12/24 14:02:46 No eventing-con process running
2021/12/24 14:02:46 Function: n1qlquery_consistency delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency deleting in background"
}
2021/12/24 14:02:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 14:02:58 Waiting for dst bucket item count to get to: 0 curr count: 3195
2021/12/24 14:03:03 Waiting for dst bucket item count to get to: 0 curr count: 695
2021/12/24 14:03:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:03:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 14:03:15 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 14:03:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLQueryConsistency (101.84s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	1568.069s

N1ql tests took 0 hours, 26 minutes and 12 seconds.

Starting server
Starting server: attempt 1

Rebalance tests

2021/12/24 14:04:50 Started rebalance
=== RUN   TestDuplicateWithEventingRebIn
2021/12/24 14:05:07 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
running apps fetch error json: cannot unmarshal number into Go value of type string
2021/12/24 14:05:12 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/24 14:05:12 App: TestDuplicateWithEventingRebIn got un-deployed
2021/12/24 14:05:12 No eventing-con process running
2021/12/24 14:05:12 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebIn not found"
}
2021/12/24 14:05:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:05:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:05:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:05:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:05:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:05:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:05:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:05:31 Deploying app: TestDuplicateWithEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:05:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn stored in temp store"
}
2021/12/24 14:05:37 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/24 14:05:42 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/24 14:05:47 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/24 14:05:52 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/24 14:05:52 App: TestDuplicateWithEventingRebIn got deployed
2021/12/24 14:05:52 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:05:52 Starting bucket ops to source bucket
2021/12/24 14:06:06 Removing node(s): [] from the cluster
2021/12/24 14:06:11 Rebalance progress: 0
2021/12/24 14:06:16 Rebalance progress: 0
2021/12/24 14:06:21 Rebalance progress: 25
2021/12/24 14:06:26 Rebalance progress: 25
2021/12/24 14:06:31 Rebalance progress: 25
2021/12/24 14:06:36 Rebalance progress: 25
2021/12/24 14:06:41 Rebalance progress: 25
2021/12/24 14:06:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:06:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:06:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:06:46 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/24 14:06:46 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:06:46 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:06:51 Rebalance progress: 25
2021/12/24 14:06:56 Rebalance progress: 25
2021/12/24 14:07:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:07:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:07:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:07:01 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/24 14:07:01 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:07:01 Waiting for src bucket item count to get to: 200000 curr count: 93434
2021/12/24 14:07:06 Waiting for src bucket item count to get to: 200000 curr count: 110158
2021/12/24 14:07:11 Waiting for src bucket item count to get to: 200000 curr count: 110158
2021/12/24 14:07:16 Waiting for src bucket item count to get to: 200000 curr count: 126809
2021/12/24 14:07:21 Waiting for src bucket item count to get to: 200000 curr count: 126809
2021/12/24 14:07:26 Waiting for src bucket item count to get to: 200000 curr count: 143664
2021/12/24 14:07:31 Waiting for src bucket item count to get to: 200000 curr count: 143664
2021/12/24 14:07:36 Waiting for src bucket item count to get to: 200000 curr count: 160337
2021/12/24 14:07:41 Waiting for src bucket item count to get to: 200000 curr count: 160337
2021/12/24 14:07:46 Waiting for src bucket item count to get to: 200000 curr count: 176910
2021/12/24 14:07:51 Waiting for src bucket item count to get to: 200000 curr count: 176910
2021/12/24 14:07:56 Waiting for src bucket item count to get to: 200000 curr count: 193787
2021/12/24 14:08:01 Waiting for src bucket item count to get to: 200000 curr count: 193787
2021/12/24 14:08:11 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 14:08:16 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 14:08:21 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 14:08:26 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 14:08:31 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 14:08:36 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 14:08:41 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 14:08:46 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 14:08:51 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 14:08:56 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 14:08:56 Post SET ops. Expected item count: 200000 got 200001
2021/12/24 14:09:01 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/24 14:09:06 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/24 14:09:11 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/24 14:09:16 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/24 14:09:16 App: TestDuplicateWithEventingRebIn got un-deployed
2021/12/24 14:09:16 No eventing-con process running
2021/12/24 14:09:16 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn deleting in background"
}
2021/12/24 14:09:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:09:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:09:28 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 14:09:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:09:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:09:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:09:40 Waiting for dst bucket item count to get to: 0 curr count: 7457
2021/12/24 14:09:45 Waiting for dst bucket item count to get to: 0 curr count: 7457
2021/12/24 14:09:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebIn (287.65s)
=== RUN   TestDuplicateWithEventingRebOut
2021/12/24 14:09:50 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:09:50 Removing node(s): [] from the cluster
2021/12/24 14:09:55 Rebalance progress: 100
2021/12/24 14:10:00 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/24 14:10:00 App: TestDuplicateWithEventingRebOut got un-deployed
2021/12/24 14:10:00 No eventing-con process running
2021/12/24 14:10:00 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebOut not found"
}
2021/12/24 14:10:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:10:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:10:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:10:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:10:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:10:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:10:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:10:19 Deploying app: TestDuplicateWithEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:10:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut stored in temp store"
}
2021/12/24 14:10:25 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/24 14:10:30 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/24 14:10:35 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/24 14:10:40 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/24 14:10:40 App: TestDuplicateWithEventingRebOut got deployed
2021/12/24 14:10:40 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:10:40 Starting bucket ops to source bucket
2021/12/24 14:10:45 Rebalance progress: 25
2021/12/24 14:10:50 Rebalance progress: 25
2021/12/24 14:10:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:10:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:10:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:10:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/24 14:10:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:10:55 Waiting for src bucket item count to get to: 200000 curr count: 14985
2021/12/24 14:11:00 Waiting for src bucket item count to get to: 200000 curr count: 31473
2021/12/24 14:11:05 Waiting for src bucket item count to get to: 200000 curr count: 31473
2021/12/24 14:11:10 Waiting for src bucket item count to get to: 200000 curr count: 48360
2021/12/24 14:11:15 Waiting for src bucket item count to get to: 200000 curr count: 48360
2021/12/24 14:11:20 Waiting for src bucket item count to get to: 200000 curr count: 64766
2021/12/24 14:11:25 Waiting for src bucket item count to get to: 200000 curr count: 64766
2021/12/24 14:11:30 Waiting for src bucket item count to get to: 200000 curr count: 64766
2021/12/24 14:11:35 Waiting for src bucket item count to get to: 200000 curr count: 81089
2021/12/24 14:11:40 Waiting for src bucket item count to get to: 200000 curr count: 81089
2021/12/24 14:11:45 Waiting for src bucket item count to get to: 200000 curr count: 97235
2021/12/24 14:11:50 Waiting for src bucket item count to get to: 200000 curr count: 97235
2021/12/24 14:11:55 Waiting for src bucket item count to get to: 200000 curr count: 113747
2021/12/24 14:12:00 Waiting for src bucket item count to get to: 200000 curr count: 113747
2021/12/24 14:12:05 Waiting for src bucket item count to get to: 200000 curr count: 130258
2021/12/24 14:12:10 Waiting for src bucket item count to get to: 200000 curr count: 130258
2021/12/24 14:12:15 Waiting for src bucket item count to get to: 200000 curr count: 147171
2021/12/24 14:12:20 Waiting for src bucket item count to get to: 200000 curr count: 147171
2021/12/24 14:12:25 Waiting for src bucket item count to get to: 200000 curr count: 163994
2021/12/24 14:12:30 Waiting for src bucket item count to get to: 200000 curr count: 163994
2021/12/24 14:12:35 Waiting for src bucket item count to get to: 200000 curr count: 180281
2021/12/24 14:12:40 Waiting for src bucket item count to get to: 200000 curr count: 180281
2021/12/24 14:12:45 Waiting for src bucket item count to get to: 200000 curr count: 196990
2021/12/24 14:12:50 Waiting for src bucket item count to get to: 200000 curr count: 196990
2021/12/24 14:12:55 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 14:12:55 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 14:13:00 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/24 14:13:05 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/24 14:13:10 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/24 14:13:15 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/24 14:13:15 App: TestDuplicateWithEventingRebOut got un-deployed
2021/12/24 14:13:15 No eventing-con process running
2021/12/24 14:13:15 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut deleting in background"
}
2021/12/24 14:13:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:13:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:13:27 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 14:13:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:13:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:13:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:13:39 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 14:13:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebOut (233.80s)
=== RUN   TestDuplicateWithEventingSwapReb
2021/12/24 14:13:49 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/24 14:13:49 App: TestDuplicateWithEventingSwapReb got un-deployed
2021/12/24 14:13:49 No eventing-con process running
2021/12/24 14:13:49 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingSwapReb not found"
}
2021/12/24 14:13:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:13:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:13:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:13:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:14:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:14:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:14:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:14:07 Deploying app: TestDuplicateWithEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:14:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb stored in temp store"
}
2021/12/24 14:14:13 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/24 14:14:18 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/24 14:14:23 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/24 14:14:28 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/24 14:14:28 App: TestDuplicateWithEventingSwapReb got deployed
2021/12/24 14:14:28 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:14:28 Starting bucket ops to source bucket
2021/12/24 14:14:29 Removing node(s): [] from the cluster
2021/12/24 14:14:34 Rebalance progress: 25
2021/12/24 14:14:39 Rebalance progress: 25
2021/12/24 14:14:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:14:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:14:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:14:44 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/24 14:14:44 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:14:44 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:14:51 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:14:56 Rebalance progress: 16.66666666666667
2021/12/24 14:15:01 Rebalance progress: 16.66666666666667
2021/12/24 14:15:06 Rebalance progress: 16.66666666666667
2021/12/24 14:15:11 Rebalance progress: 51.55993431855501
2021/12/24 14:15:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:15:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:15:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:15:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:15:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 14:15:21 Rebalance progress: 16.66666666666667
2021/12/24 14:15:26 Rebalance progress: 16.66666666666667
2021/12/24 14:15:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:15:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:15:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:15:31 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:15:31 Waiting for src bucket item count to get to: 200000 curr count: 76951
2021/12/24 14:15:36 Waiting for src bucket item count to get to: 200000 curr count: 93559
2021/12/24 14:15:41 Waiting for src bucket item count to get to: 200000 curr count: 93559
2021/12/24 14:15:46 Waiting for src bucket item count to get to: 200000 curr count: 109677
2021/12/24 14:15:51 Waiting for src bucket item count to get to: 200000 curr count: 109677
2021/12/24 14:15:56 Waiting for src bucket item count to get to: 200000 curr count: 126373
2021/12/24 14:16:01 Waiting for src bucket item count to get to: 200000 curr count: 126373
2021/12/24 14:16:06 Waiting for src bucket item count to get to: 200000 curr count: 143069
2021/12/24 14:16:11 Waiting for src bucket item count to get to: 200000 curr count: 143069
2021/12/24 14:16:16 Waiting for src bucket item count to get to: 200000 curr count: 159585
2021/12/24 14:16:21 Waiting for src bucket item count to get to: 200000 curr count: 159585
2021/12/24 14:16:26 Waiting for src bucket item count to get to: 200000 curr count: 175710
2021/12/24 14:16:31 Waiting for src bucket item count to get to: 200000 curr count: 192253
2021/12/24 14:16:36 Waiting for src bucket item count to get to: 200000 curr count: 192253
2021/12/24 14:16:41 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 14:16:41 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 14:16:46 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/24 14:16:52 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/24 14:16:57 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/24 14:17:02 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/24 14:17:02 App: TestDuplicateWithEventingSwapReb got un-deployed
2021/12/24 14:17:02 No eventing-con process running
2021/12/24 14:17:02 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb deleting in background"
}
2021/12/24 14:17:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:17:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:17:13 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 14:17:18 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 14:17:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:17:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:17:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:17:30 Waiting for dst bucket item count to get to: 0 curr count: 35105
2021/12/24 14:17:35 Waiting for dst bucket item count to get to: 0 curr count: 35105
2021/12/24 14:17:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingSwapReb (236.32s)
=== RUN   TestDuplicateWithKVRebIn
2021/12/24 14:17:45 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/24 14:17:45 App: TestDuplicateWithKVRebIn got un-deployed
2021/12/24 14:17:45 No eventing-con process running
2021/12/24 14:17:45 Function: TestDuplicateWithKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebIn not found"
}
2021/12/24 14:17:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:17:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:17:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:17:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:17:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:17:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:18:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:18:04 Deploying app: TestDuplicateWithKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:18:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn stored in temp store"
}
2021/12/24 14:18:10 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/24 14:18:15 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/24 14:18:20 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/24 14:18:25 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/24 14:18:25 App: TestDuplicateWithKVRebIn got deployed
2021/12/24 14:18:25 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 14:18:25 Starting bucket ops to source bucket
2021/12/24 14:18:25 Removing node(s): [] from the cluster
2021/12/24 14:18:30 Rebalance progress: 16.66666666666667
2021/12/24 14:18:35 Rebalance progress: 16.66666666666667
2021/12/24 14:18:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:18:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:18:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:18:40 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:18:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:18:45 Rebalance progress: 16.66666666666667
2021/12/24 14:18:50 Rebalance progress: 16.66666666666667
2021/12/24 14:18:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:18:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:18:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:18:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:18:55 Waiting for src bucket item count to get to: 200000 curr count: 39162
2021/12/24 14:19:00 Waiting for src bucket item count to get to: 200000 curr count: 55562
2021/12/24 14:19:05 Waiting for src bucket item count to get to: 200000 curr count: 55562
2021/12/24 14:19:10 Waiting for src bucket item count to get to: 200000 curr count: 71970
2021/12/24 14:19:15 Waiting for src bucket item count to get to: 200000 curr count: 71970
2021/12/24 14:19:20 Waiting for src bucket item count to get to: 200000 curr count: 87581
2021/12/24 14:19:25 Waiting for src bucket item count to get to: 200000 curr count: 87581
2021/12/24 14:19:30 Waiting for src bucket item count to get to: 200000 curr count: 104297
2021/12/24 14:19:35 Waiting for src bucket item count to get to: 200000 curr count: 104297
2021/12/24 14:19:40 Waiting for src bucket item count to get to: 200000 curr count: 104297
2021/12/24 14:19:45 Waiting for src bucket item count to get to: 200000 curr count: 120787
2021/12/24 14:19:50 Waiting for src bucket item count to get to: 200000 curr count: 120787
2021/12/24 14:19:55 Waiting for src bucket item count to get to: 200000 curr count: 137465
2021/12/24 14:20:00 Waiting for src bucket item count to get to: 200000 curr count: 137465
2021/12/24 14:20:05 Waiting for src bucket item count to get to: 200000 curr count: 153747
2021/12/24 14:20:10 Waiting for src bucket item count to get to: 200000 curr count: 153747
2021/12/24 14:20:15 Waiting for src bucket item count to get to: 200000 curr count: 170395
2021/12/24 14:20:20 Waiting for src bucket item count to get to: 200000 curr count: 170395
2021/12/24 14:20:25 Waiting for src bucket item count to get to: 200000 curr count: 186208
2021/12/24 14:20:30 Waiting for src bucket item count to get to: 200000 curr count: 186208
2021/12/24 14:20:35 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 14:20:35 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 14:20:40 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/24 14:20:45 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/24 14:20:50 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/24 14:20:55 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/24 14:20:55 App: TestDuplicateWithKVRebIn got un-deployed
2021/12/24 14:20:55 No eventing-con process running
2021/12/24 14:20:56 Function: TestDuplicateWithKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn deleting in background"
}
2021/12/24 14:20:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:21:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:21:07 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 14:21:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:21:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:21:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:21:19 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 14:21:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebIn (223.99s)
=== RUN   TestDuplicateWithKVRebOut
2021/12/24 14:21:24 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 14:21:24 Removing node(s): [] from the cluster
2021/12/24 14:21:29 Rebalance progress: 100
2021/12/24 14:21:34 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/24 14:21:34 App: TestDuplicateWithKVRebOut got un-deployed
2021/12/24 14:21:34 No eventing-con process running
2021/12/24 14:21:34 Function: TestDuplicateWithKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebOut not found"
}
2021/12/24 14:21:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:21:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:21:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:21:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:21:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:21:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:21:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:21:53 Deploying app: TestDuplicateWithKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:21:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut stored in temp store"
}
2021/12/24 14:21:59 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/24 14:22:04 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/24 14:22:09 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/24 14:22:14 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/24 14:22:14 App: TestDuplicateWithKVRebOut got deployed
2021/12/24 14:22:14 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:22:14 Starting bucket ops to source bucket
2021/12/24 14:22:19 Rebalance progress: 16.66666666666667
2021/12/24 14:22:24 Rebalance progress: 16.66666666666667
2021/12/24 14:22:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:22:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:22:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:22:29 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:22:29 Waiting for src bucket item count to get to: 200000 curr count: 7819
2021/12/24 14:22:34 Waiting for src bucket item count to get to: 200000 curr count: 24306
2021/12/24 14:22:39 Waiting for src bucket item count to get to: 200000 curr count: 24306
2021/12/24 14:22:44 Waiting for src bucket item count to get to: 200000 curr count: 41071
2021/12/24 14:22:49 Waiting for src bucket item count to get to: 200000 curr count: 41071
2021/12/24 14:22:54 Waiting for src bucket item count to get to: 200000 curr count: 57833
2021/12/24 14:22:59 Waiting for src bucket item count to get to: 200000 curr count: 57833
2021/12/24 14:23:04 Waiting for src bucket item count to get to: 200000 curr count: 57833
2021/12/24 14:23:09 Waiting for src bucket item count to get to: 200000 curr count: 74508
2021/12/24 14:23:14 Waiting for src bucket item count to get to: 200000 curr count: 74508
2021/12/24 14:23:19 Waiting for src bucket item count to get to: 200000 curr count: 89828
2021/12/24 14:23:24 Waiting for src bucket item count to get to: 200000 curr count: 89828
2021/12/24 14:23:29 Waiting for src bucket item count to get to: 200000 curr count: 106539
2021/12/24 14:23:34 Waiting for src bucket item count to get to: 200000 curr count: 123241
2021/12/24 14:23:39 Waiting for src bucket item count to get to: 200000 curr count: 123241
2021/12/24 14:23:44 Waiting for src bucket item count to get to: 200000 curr count: 140105
2021/12/24 14:23:49 Waiting for src bucket item count to get to: 200000 curr count: 140105
2021/12/24 14:23:54 Waiting for src bucket item count to get to: 200000 curr count: 156809
2021/12/24 14:23:59 Waiting for src bucket item count to get to: 200000 curr count: 156809
2021/12/24 14:24:04 Waiting for src bucket item count to get to: 200000 curr count: 173532
2021/12/24 14:24:09 Waiting for src bucket item count to get to: 200000 curr count: 173532
2021/12/24 14:24:14 Waiting for src bucket item count to get to: 200000 curr count: 189129
2021/12/24 14:24:19 Waiting for src bucket item count to get to: 200000 curr count: 189129
2021/12/24 14:24:24 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 14:24:24 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 14:24:29 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/24 14:24:34 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/24 14:24:39 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/24 14:24:44 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/24 14:24:44 App: TestDuplicateWithKVRebOut got un-deployed
2021/12/24 14:24:44 No eventing-con process running
2021/12/24 14:24:44 Function: TestDuplicateWithKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut deleting in background"
}
2021/12/24 14:24:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:24:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:24:56 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 14:24:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:24:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:25:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:25:08 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 14:25:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebOut (228.89s)
=== RUN   TestDuplicateWithKVSwapReb
2021/12/24 14:25:18 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/24 14:25:18 App: TestDuplicateWithKVSwapReb got un-deployed
2021/12/24 14:25:18 No eventing-con process running
2021/12/24 14:25:18 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVSwapReb not found"
}
2021/12/24 14:25:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:25:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:25:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:25:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:25:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:25:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:25:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:25:36 Deploying app: TestDuplicateWithKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:25:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb stored in temp store"
}
2021/12/24 14:25:43 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/24 14:25:48 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/24 14:25:53 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/24 14:25:58 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/24 14:25:58 App: TestDuplicateWithKVSwapReb got deployed
2021/12/24 14:25:58 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 14:25:58 Starting bucket ops to source bucket
2021/12/24 14:25:58 Removing node(s): [] from the cluster
2021/12/24 14:26:03 Rebalance progress: 16.66666666666667
2021/12/24 14:26:08 Rebalance progress: 16.66666666666667
2021/12/24 14:26:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:26:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:26:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:26:13 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:26:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 14:26:13 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:26:18 Rebalance progress: 16.66666666666667
2021/12/24 14:26:23 Rebalance progress: 16.66666666666667
2021/12/24 14:26:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:26:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:26:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:26:28 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:26:28 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 14:26:33 Rebalance progress: 16.66666666666667
2021/12/24 14:26:38 Rebalance progress: 16.66666666666667
2021/12/24 14:26:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:26:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:26:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:26:43 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:26:43 Waiting for src bucket item count to get to: 200000 curr count: 66485
2021/12/24 14:26:48 Waiting for src bucket item count to get to: 200000 curr count: 66485
2021/12/24 14:26:53 Waiting for src bucket item count to get to: 200000 curr count: 81782
2021/12/24 14:26:58 Waiting for src bucket item count to get to: 200000 curr count: 81782
2021/12/24 14:27:03 Waiting for src bucket item count to get to: 200000 curr count: 98481
2021/12/24 14:27:08 Waiting for src bucket item count to get to: 200000 curr count: 98481
2021/12/24 14:27:13 Waiting for src bucket item count to get to: 200000 curr count: 115145
2021/12/24 14:27:19 Waiting for src bucket item count to get to: 200000 curr count: 115145
2021/12/24 14:27:24 Waiting for src bucket item count to get to: 200000 curr count: 131766
2021/12/24 14:27:29 Waiting for src bucket item count to get to: 200000 curr count: 131766
2021/12/24 14:27:34 Waiting for src bucket item count to get to: 200000 curr count: 131766
2021/12/24 14:27:39 Waiting for src bucket item count to get to: 200000 curr count: 148507
2021/12/24 14:27:44 Waiting for src bucket item count to get to: 200000 curr count: 148507
2021/12/24 14:27:49 Waiting for src bucket item count to get to: 200000 curr count: 165010
2021/12/24 14:27:54 Waiting for src bucket item count to get to: 200000 curr count: 165010
2021/12/24 14:27:59 Waiting for src bucket item count to get to: 200000 curr count: 180560
2021/12/24 14:28:04 Waiting for src bucket item count to get to: 200000 curr count: 180560
2021/12/24 14:28:09 Waiting for src bucket item count to get to: 200000 curr count: 197340
2021/12/24 14:28:14 Waiting for src bucket item count to get to: 200000 curr count: 197340
2021/12/24 14:28:19 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 14:28:19 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 14:28:24 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/24 14:28:29 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/24 14:28:34 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/24 14:28:39 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/24 14:28:39 App: TestDuplicateWithKVSwapReb got un-deployed
2021/12/24 14:28:39 No eventing-con process running
2021/12/24 14:28:39 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb deleting in background"
}
2021/12/24 14:28:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:28:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:28:50 Waiting for dst bucket item count to get to: 0 curr count: 111709
2021/12/24 14:28:55 Waiting for dst bucket item count to get to: 0 curr count: 111709
2021/12/24 14:28:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:28:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:29:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:29:07 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 14:29:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVSwapReb (239.29s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpOneByOne
2021/12/24 14:29:17 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 14:29:17 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 14:29:17 No eventing-con process running
2021/12/24 14:29:17 Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/24 14:29:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:29:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:29:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:29:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:29:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:29:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:29:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:29:36 Deploying app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:29:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/24 14:29:42 Starting bucket ops to source bucket
2021/12/24 14:29:47 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 14:29:52 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 14:29:57 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 14:29:57 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:29:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:29:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:29:57 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:29:57 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:29:57 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:30:02 Rebalance progress: 16.66666666666667
2021/12/24 14:30:07 Rebalance progress: 16.66666666666667
2021/12/24 14:30:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:30:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:30:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:30:12 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:30:12 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:30:12 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:30:18 Rebalance progress: 16.66666666666667
2021/12/24 14:30:23 Rebalance progress: 16.66666666666667
2021/12/24 14:30:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:30:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:30:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:30:28 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 14:30:28 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 14:30:33 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:30:38 Rebalance progress: 12.5
2021/12/24 14:30:43 Rebalance progress: 12.5
2021/12/24 14:30:48 Rebalance progress: 12.5
2021/12/24 14:30:53 Rebalance progress: 98.58870967741935
2021/12/24 14:30:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:30:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:30:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:30:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:31:03 Rebalance progress: 12.5
2021/12/24 14:31:08 Rebalance progress: 12.5
2021/12/24 14:31:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:31:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:31:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:31:13 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 14:31:18 Rebalance progress: 12.5
2021/12/24 14:31:23 Rebalance progress: 12.5
2021/12/24 14:31:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:31:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:31:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:31:28 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 14:31:33 Rebalance progress: 12.5
2021/12/24 14:31:38 Rebalance progress: 12.5
2021/12/24 14:31:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:31:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:31:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:31:48 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 14:31:53 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 14:31:58 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 14:32:03 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 14:32:03 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 14:32:03 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:32:03 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/24 14:32:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:32:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:32:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12120
2021/12/24 14:32:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:32:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:32:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:32:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12120
2021/12/24 14:32:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpOneByOne (199.62s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce
2021/12/24 14:32:37 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/24 14:32:37 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2021/12/24 14:32:37 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:32:37 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce not found"
}
2021/12/24 14:32:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:32:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:32:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:32:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:32:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:32:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:32:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:32:55 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:32:56 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce stored in temp store"
}
2021/12/24 14:33:01 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 14:33:06 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/24 14:33:12 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/24 14:33:17 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/24 14:33:17 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:33:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:33:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:33:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:33:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:33:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 14:33:17 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:33:22 Rebalance progress: 12.5
2021/12/24 14:33:27 Rebalance progress: 12.5
2021/12/24 14:33:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:33:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:33:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:33:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/24 14:33:38 Rebalance progress: 12.5
2021/12/24 14:33:43 Rebalance progress: 12.5
2021/12/24 14:33:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:33:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:33:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:33:53 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/24 14:33:58 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/24 14:34:03 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/24 14:34:08 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/24 14:34:08 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2021/12/24 14:34:08 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:34:08 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce deleting in background"
}
2021/12/24 14:34:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:34:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:34:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:34:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:34:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:34:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4590
2021/12/24 14:34:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce (119.50s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings
2021/12/24 14:34:36 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 14:34:36 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/24 14:34:36 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:34:36 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings not found"
}
2021/12/24 14:34:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:34:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:34:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:34:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:34:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:34:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:34:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:34:55 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:34:56 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2021/12/24 14:35:01 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 14:35:06 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/24 14:35:11 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/24 14:35:16 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/24 14:35:16 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:35:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:35:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:35:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:35:16 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:35:21 Rebalance progress: 12.5
2021/12/24 14:35:26 Rebalance progress: 12.5
2021/12/24 14:35:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:35:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:35:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:35:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:35:32 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:35:37 Rebalance progress: 12.5
2021/12/24 14:35:42 Rebalance progress: 12.5
2021/12/24 14:35:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:35:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:35:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:35:47 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 14:35:47 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:35:52 Rebalance progress: 12.5
2021/12/24 14:35:57 Rebalance progress: 12.5
2021/12/24 14:36:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:36:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:36:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:36:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:36:07 Rebalance progress: 12.5
2021/12/24 14:36:12 Rebalance progress: 12.5
2021/12/24 14:36:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:36:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:36:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:36:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 14:36:22 Rebalance progress: 12.5
2021/12/24 14:36:27 Rebalance progress: 12.5
2021/12/24 14:36:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:36:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:36:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:36:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 14:36:38 Rebalance progress: 12.5
2021/12/24 14:36:43 Rebalance progress: 12.5
2021/12/24 14:36:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:36:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:36:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:36:53 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 14:36:58 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 14:37:03 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 14:37:08 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 14:37:08 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/24 14:37:08 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:37:08 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2021/12/24 14:37:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:37:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:37:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:37:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:37:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:37:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10627
2021/12/24 14:37:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings (179.93s)
=== RUN   TestEventingSwapRebOnUpdateBucketOp
2021/12/24 14:37:36 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/24 14:37:36 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2021/12/24 14:37:36 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:37:36 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebOnUpdateBucketOp not found"
}
2021/12/24 14:37:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:37:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:37:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:37:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:37:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:37:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:37:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:37:50 eventingSetup.go:125: Deploying app: TestEventingSwapRebOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:37:51 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp stored in temp store"
}
2021/12/24 14:37:56 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 14:38:01 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/24 14:38:06 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/24 14:38:11 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/24 14:38:11 clusterSetup.go:354: App: TestEventingSwapRebOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:38:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:38:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:38:11 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:38:11 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:38:16 Rebalance progress: 12.5
2021/12/24 14:38:21 Rebalance progress: 12.5
2021/12/24 14:38:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:38:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:38:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:38:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:38:27 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:38:32 Rebalance progress: 12.5
2021/12/24 14:38:37 Rebalance progress: 12.5
2021/12/24 14:38:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:38:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:38:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:38:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 14:38:47 Rebalance progress: 12.5
2021/12/24 14:38:52 Rebalance progress: 12.5
2021/12/24 14:38:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:38:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:38:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:39:02 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/24 14:39:07 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/24 14:39:12 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/24 14:39:17 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/24 14:39:17 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2021/12/24 14:39:17 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:39:17 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp deleting in background"
}
2021/12/24 14:39:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:39:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:39:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6085
2021/12/24 14:39:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:39:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:39:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:39:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4868
2021/12/24 14:39:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4868
2021/12/24 14:39:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebOnUpdateBucketOp (139.48s)
=== RUN   TestMetaRollbackWithEventingReb
2021/12/24 14:39:51 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:39:51 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:39:56 Rebalance progress: 100
2021/12/24 14:40:01 Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/24 14:40:01 App: TestMetaRollbackWithEventingReb got un-deployed
2021/12/24 14:40:01 No eventing-con process running
2021/12/24 14:40:01 Function: TestMetaRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaRollbackWithEventingReb not found"
}
2021/12/24 14:40:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:40:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:40:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:40:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:40:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:40:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:40:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:40:15 Deploying app: TestMetaRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:40:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb stored in temp store"
}
2021/12/24 14:40:21 Starting bucket ops to source bucket
2021/12/24 14:40:26 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/24 14:40:31 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/24 14:40:36 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/24 14:40:36 App: TestMetaRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:40:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:40:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:40:36 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:40:36 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:40:41 Rebalance progress: 12.5
2021/12/24 14:40:46 Rebalance progress: 12.5
2021/12/24 14:40:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:40:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:40:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:40:51 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/24 14:40:51 bucketOps.go:134: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/24 14:40:56 Rebalance progress: 12.5
2021/12/24 14:41:01 Rebalance progress: 12.5
2021/12/24 14:41:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:41:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:41:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:41:12 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/24 14:41:17 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/24 14:41:22 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/24 14:41:27 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/24 14:41:27 clusterSetup.go:405: App: TestMetaRollbackWithEventingReb got un-deployed
2021/12/24 14:41:27 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:41:27 eventingSetup.go:418: Function: TestMetaRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb deleting in background"
}
2021/12/24 14:41:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:41:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:41:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4568
2021/12/24 14:41:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:41:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:41:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:41:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1717
2021/12/24 14:41:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1717
2021/12/24 14:41:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaRollbackWithEventingReb (129.51s)
=== RUN   TestMetaPartialRollbackWithEventingReb
2021/12/24 14:42:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:42:01 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:42:06 Rebalance progress: 100
2021/12/24 14:42:11 Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/24 14:42:11 App: TestMetaPartialRollbackWithEventingReb got un-deployed
2021/12/24 14:42:11 No eventing-con process running
2021/12/24 14:42:11 Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaPartialRollbackWithEventingReb not found"
}
2021/12/24 14:42:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:42:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:42:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:42:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:42:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:42:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:42:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:42:24 Deploying app: TestMetaPartialRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:42:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb stored in temp store"
}
2021/12/24 14:42:30 Starting bucket ops to source bucket
2021/12/24 14:42:35 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/24 14:42:40 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/24 14:42:45 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/24 14:42:45 App: TestMetaPartialRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:42:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:42:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:42:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:42:46 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:42:51 Rebalance progress: 12.5
2021/12/24 14:42:56 Rebalance progress: 12.5
2021/12/24 14:43:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:43:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:43:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:43:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/24 14:43:01 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/24 14:43:06 Rebalance progress: 12.5
2021/12/24 14:43:11 Rebalance progress: 12.5
2021/12/24 14:43:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:43:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:43:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:43:16 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/24 14:43:21 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/24 14:43:26 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/24 14:43:31 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/24 14:43:36 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/24 14:43:36 clusterSetup.go:405: App: TestMetaPartialRollbackWithEventingReb got un-deployed
2021/12/24 14:43:36 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:43:36 eventingSetup.go:418: Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb deleting in background"
}
2021/12/24 14:43:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:43:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:43:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 37709
2021/12/24 14:43:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:43:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:43:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:43:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaPartialRollbackWithEventingReb (119.58s)
=== RUN   TestEventingRebMultipleHandlersOneByOne
2021/12/24 14:44:05 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/24 14:44:05 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2021/12/24 14:44:05 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:44:05 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op not found"
}
2021/12/24 14:44:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:44:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:44:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:44:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:44:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:44:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:44:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:44:23 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:44:24 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:44:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:44:24 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:44:26 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update stored in temp store"
}
2021/12/24 14:44:31 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 14:44:36 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/24 14:44:41 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/24 14:44:46 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/24 14:44:46 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got deployed
2021/12/24 14:44:51 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/24 14:44:56 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/24 14:45:01 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/24 14:45:01 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:45:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:45:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:45:01 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:45:01 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:45:06 Rebalance progress: 12.5
2021/12/24 14:45:11 Rebalance progress: 12.5
2021/12/24 14:45:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:45:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:45:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:45:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:45:17 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:45:22 Rebalance progress: 12.5
2021/12/24 14:45:27 Rebalance progress: 12.5
2021/12/24 14:45:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:45:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:45:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:45:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 14:45:32 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:45:37 Rebalance progress: 12.5
2021/12/24 14:45:42 Rebalance progress: 12.5
2021/12/24 14:45:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:45:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:45:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:45:47 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:45:52 Rebalance progress: 12.5
2021/12/24 14:45:57 Rebalance progress: 12.5
2021/12/24 14:46:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:46:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:46:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:46:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 14:46:07 Rebalance progress: 12.5
2021/12/24 14:46:12 Rebalance progress: 12.5
2021/12/24 14:46:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:46:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:46:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:46:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 14:46:22 Rebalance progress: 12.5
2021/12/24 14:46:27 Rebalance progress: 12.5
2021/12/24 14:46:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:46:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:46:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:46:37 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/24 14:46:43 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/24 14:46:48 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/24 14:46:53 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/24 14:46:53 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2021/12/24 14:46:53 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:46:53 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op deleting in background"
}
2021/12/24 14:46:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:47:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:47:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12166
2021/12/24 14:47:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:47:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:47:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:47:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12166
2021/12/24 14:47:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:47:22 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/24 14:47:28 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/24 14:47:33 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/24 14:47:38 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/24 14:47:38 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got un-deployed
2021/12/24 14:47:38 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:47:38 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update deleting in background"
}
2021/12/24 14:47:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:47:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:47:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:47:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:47:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:47:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersOneByOne (236.26s)
=== RUN   TestEventingRebMultipleHandlersAllAtOnce
2021/12/24 14:48:01 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/24 14:48:01 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2021/12/24 14:48:01 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:48:01 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op not found"
}
2021/12/24 14:48:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:48:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:48:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:48:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:48:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:48:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:48:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:48:20 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:48:21 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:48:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:48:21 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:48:22 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update stored in temp store"
}
2021/12/24 14:48:27 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 14:48:32 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/24 14:48:37 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/24 14:48:42 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/24 14:48:42 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got deployed
2021/12/24 14:48:47 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/24 14:48:52 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/24 14:48:57 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/24 14:48:57 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:48:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:48:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:48:57 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:48:57 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:48:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 14:48:58 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:49:03 Rebalance progress: 12.5
2021/12/24 14:49:08 Rebalance progress: 12.5
2021/12/24 14:49:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:49:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:49:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:49:13 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/24 14:49:18 Rebalance progress: 12.5
2021/12/24 14:49:23 Rebalance progress: 12.5
2021/12/24 14:49:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:49:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:49:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:49:33 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/24 14:49:38 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/24 14:49:43 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/24 14:49:48 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/24 14:49:48 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2021/12/24 14:49:48 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:49:48 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op deleting in background"
}
2021/12/24 14:49:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:49:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:50:02 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3875
2021/12/24 14:50:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3875
2021/12/24 14:50:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:50:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:50:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:50:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6103
2021/12/24 14:50:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:50:24 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/24 14:50:30 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/24 14:50:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/24 14:50:40 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/24 14:50:40 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got un-deployed
2021/12/24 14:50:40 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:50:40 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update deleting in background"
}
2021/12/24 14:50:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:50:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:50:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:50:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:50:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:50:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersAllAtOnce (182.01s)
=== RUN   TestEventingSwapRebMultipleHandlers
2021/12/24 14:51:03 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/24 14:51:03 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2021/12/24 14:51:03 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:51:03 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update not found"
}
2021/12/24 14:51:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:51:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:51:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:51:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:51:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:51:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:51:22 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/24 14:51:22 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2021/12/24 14:51:22 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:51:22 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op not found"
}
2021/12/24 14:51:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:51:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:51:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:51:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:51:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:51:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:51:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:51:35 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlersbucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:51:36 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:51:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:51:36 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:51:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op stored in temp store"
}
2021/12/24 14:51:43 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 14:51:48 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/24 14:51:53 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/24 14:51:58 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/24 14:51:58 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got deployed
2021/12/24 14:52:03 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/24 14:52:08 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/24 14:52:13 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/24 14:52:13 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:52:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:52:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:52:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:52:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:52:19 Rebalance progress: 12.5
2021/12/24 14:52:24 Rebalance progress: 12.5
2021/12/24 14:52:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:52:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:52:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:52:29 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:52:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:52:34 Rebalance progress: 12.5
2021/12/24 14:52:39 Rebalance progress: 12.5
2021/12/24 14:52:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:52:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:52:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:52:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 14:52:49 Rebalance progress: 12.5
2021/12/24 14:52:54 Rebalance progress: 12.5
2021/12/24 14:52:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:52:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:52:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:53:04 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/24 14:53:09 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/24 14:53:14 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/24 14:53:19 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/24 14:53:19 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2021/12/24 14:53:19 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:53:19 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update deleting in background"
}
2021/12/24 14:53:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:53:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:53:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7660
2021/12/24 14:53:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7660
2021/12/24 14:53:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:53:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:53:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:53:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:53:49 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/24 14:53:55 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/24 14:54:00 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/24 14:54:05 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/24 14:54:05 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2021/12/24 14:54:05 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:54:05 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op deleting in background"
}
2021/12/24 14:54:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:54:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:54:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:54:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:54:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:54:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebMultipleHandlers (205.03s)
=== RUN   TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/24 14:54:28 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 14:54:28 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 14:54:28 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:54:28 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/24 14:54:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:54:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:54:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:54:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:54:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:54:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:54:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:54:47 eventingSetup.go:125: Deploying app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:54:48 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/24 14:54:53 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 14:54:58 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 14:55:03 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 14:55:08 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 14:55:08 clusterSetup.go:354: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:55:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:55:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:55:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:55:08 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:55:28 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:55:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:55:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:55:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:55:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:55:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:56:04 Rebalance progress: 12.5
2021/12/24 14:56:09 Rebalance progress: 12.5
2021/12/24 14:56:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:56:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:56:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:56:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 14:56:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 14:56:20 Rebalance progress: 12.5
2021/12/24 14:56:25 Rebalance progress: 12.5
2021/12/24 14:56:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:56:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:56:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:56:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 14:56:35 Rebalance progress: 12.5
2021/12/24 14:56:40 Rebalance progress: 12.5
2021/12/24 14:56:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:56:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:56:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:56:50 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 14:56:55 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 14:57:00 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 14:57:00 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 14:57:00 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:57:00 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/24 14:57:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:57:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:57:12 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11186
2021/12/24 14:57:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11186
2021/12/24 14:57:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:57:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:57:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:57:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11186
2021/12/24 14:57:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne (190.54s)
=== RUN   TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/24 14:57:39 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 14:57:39 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 14:57:39 eventingSetup.go:46: No eventing-con process running
2021/12/24 14:57:39 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/24 14:57:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:57:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:57:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 14:57:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:57:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:57:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:57:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 14:57:57 eventingSetup.go:125: Deploying app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/24 14:57:58 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/24 14:58:03 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 14:58:08 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 14:58:13 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 14:58:18 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 14:58:18 clusterSetup.go:354: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:58:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:58:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:58:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:58:19 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:58:39 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:58:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:58:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:58:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:58:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:58:49 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:58:49 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:59:10 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:59:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:59:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:59:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:59:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:59:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:59:20 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 14:59:40 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:59:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:59:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:59:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 14:59:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 14:59:51 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 14:59:51 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 15:00:11 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:00:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:00:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:00:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:00:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:00:22 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 15:00:22 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 15:00:43 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:00:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:00:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:00:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:00:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:00:53 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 15:00:58 Rebalance progress: 12.5
2021/12/24 15:01:03 Rebalance progress: 12.5
2021/12/24 15:01:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:01:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:01:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:01:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 15:01:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:01:14 Rebalance progress: 12.5
2021/12/24 15:01:19 Rebalance progress: 12.5
2021/12/24 15:01:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:01:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:01:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:01:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 15:01:29 Rebalance progress: 12.5
2021/12/24 15:01:34 Rebalance progress: 12.5
2021/12/24 15:01:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:01:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:01:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:01:44 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 15:01:49 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 15:01:54 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 15:01:59 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 15:01:59 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 15:01:59 eventingSetup.go:46: No eventing-con process running
2021/12/24 15:01:59 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/24 15:02:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:02:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:02:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 19676
2021/12/24 15:02:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 19676
2021/12/24 15:02:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:02:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:02:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:02:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21534
2021/12/24 15:02:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne (298.91s)
=== RUN   TestEventingFailoverOnUpdateBucketOp
2021/12/24 15:02:38 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/24 15:02:38 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2021/12/24 15:02:38 eventingSetup.go:46: No eventing-con process running
2021/12/24 15:02:38 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingFailoverOnUpdateBucketOp not found"
}
2021/12/24 15:02:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:02:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:02:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:02:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:02:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:02:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:02:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:02:56 eventingSetup.go:125: Deploying app: TestEventingFailoverOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 15:02:57 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp stored in temp store"
}
2021/12/24 15:03:02 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 15:03:07 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/24 15:03:12 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/24 15:03:17 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/24 15:03:17 clusterSetup.go:354: App: TestEventingFailoverOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:03:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:03:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:03:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 15:03:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 15:03:23 Rebalance progress: 12.5
2021/12/24 15:03:28 Rebalance progress: 12.5
2021/12/24 15:03:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:03:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:03:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:03:33 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:03:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:03:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:03:43 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 15:03:48 Rebalance progress: 12.5
2021/12/24 15:03:53 Rebalance progress: 12.5
2021/12/24 15:03:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:03:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:03:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:03:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 15:03:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:04:03 Rebalance progress: 12.5
2021/12/24 15:04:08 Rebalance progress: 12.5
2021/12/24 15:04:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:04:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:04:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:04:13 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 15:04:18 Rebalance progress: 12.5
2021/12/24 15:04:23 Rebalance progress: 12.5
2021/12/24 15:04:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:04:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:04:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:04:33 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/24 15:04:39 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/24 15:04:44 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/24 15:04:49 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/24 15:04:49 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2021/12/24 15:04:49 eventingSetup.go:46: No eventing-con process running
2021/12/24 15:04:49 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp deleting in background"
}
2021/12/24 15:04:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:04:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:05:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4371
2021/12/24 15:05:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4371
2021/12/24 15:05:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:05:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:05:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:05:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8593
2021/12/24 15:05:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingFailoverOnUpdateBucketOp (169.56s)
=== RUN   TestEventingKVRebalanceOnUpdateBucketOp
2021/12/24 15:05:27 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/24 15:05:27 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2021/12/24 15:05:27 eventingSetup.go:46: No eventing-con process running
2021/12/24 15:05:27 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingKVRebalanceOnUpdateBucketOp not found"
}
2021/12/24 15:05:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:05:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:05:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:05:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:05:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:05:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:05:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:05:46 eventingSetup.go:125: Deploying app: TestEventingKVRebalanceOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 15:05:47 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp stored in temp store"
}
2021/12/24 15:05:52 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 15:05:57 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/24 15:06:02 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/24 15:06:07 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/24 15:06:07 clusterSetup.go:354: App: TestEventingKVRebalanceOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:06:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:06:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:06:07 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing,kv to the cluster
2021/12/24 15:06:07 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 15:06:12 Rebalance progress: 12.5
2021/12/24 15:06:17 Rebalance progress: 12.5
2021/12/24 15:06:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:06:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:06:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:06:22 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing,kv to the cluster
2021/12/24 15:06:22 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:06:28 Rebalance progress: 12.5
2021/12/24 15:06:33 Rebalance progress: 12.5
2021/12/24 15:06:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:06:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:06:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:06:38 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 15:06:43 Rebalance progress: 12.5
2021/12/24 15:06:48 Rebalance progress: 12.5
2021/12/24 15:06:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:06:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:06:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:06:58 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/24 15:07:03 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/24 15:07:08 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/24 15:07:13 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/24 15:07:13 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2021/12/24 15:07:13 eventingSetup.go:46: No eventing-con process running
2021/12/24 15:07:13 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp deleting in background"
}
2021/12/24 15:07:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:07:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:07:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6078
2021/12/24 15:07:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:07:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:07:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:07:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6078
2021/12/24 15:07:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingKVRebalanceOnUpdateBucketOp (139.34s)
=== RUN   TestEventingRebInWithOps
2021/12/24 15:07:47 clusterSetup.go:397: Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/24 15:07:47 clusterSetup.go:405: App: TestEventingRebInWithOps got un-deployed
2021/12/24 15:07:47 eventingSetup.go:46: No eventing-con process running
2021/12/24 15:07:47 eventingSetup.go:418: Function: TestEventingRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithOps not found"
}
2021/12/24 15:07:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:07:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:07:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:07:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:08:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:08:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:08:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:08:05 eventingSetup.go:125: Deploying app: TestEventingRebInWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 15:08:06 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps stored in temp store"
}
2021/12/24 15:08:11 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/24 15:08:16 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/24 15:08:21 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/24 15:08:26 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/24 15:08:26 clusterSetup.go:354: App: TestEventingRebInWithOps got deployed
2021/12/24 15:08:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 15:08:26 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 15:08:27 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 15:08:32 Rebalance progress: 12.5
2021/12/24 15:08:37 Rebalance progress: 12.5
2021/12/24 15:08:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:08:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:08:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:08:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:08:47 Rebalance progress: 12.5
2021/12/24 15:08:52 Rebalance progress: 12.5
2021/12/24 15:08:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:08:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:08:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:08:57 Waiting for src bucket item count to get to: 200000 curr count: 35126
2021/12/24 15:09:02 Waiting for src bucket item count to get to: 200000 curr count: 50869
2021/12/24 15:09:07 Waiting for src bucket item count to get to: 200000 curr count: 50869
2021/12/24 15:09:12 Waiting for src bucket item count to get to: 200000 curr count: 66697
2021/12/24 15:09:17 Waiting for src bucket item count to get to: 200000 curr count: 66697
2021/12/24 15:09:22 Waiting for src bucket item count to get to: 200000 curr count: 81414
2021/12/24 15:09:27 Waiting for src bucket item count to get to: 200000 curr count: 81414
2021/12/24 15:09:32 Waiting for src bucket item count to get to: 200000 curr count: 97649
2021/12/24 15:09:37 Waiting for src bucket item count to get to: 200000 curr count: 97649
2021/12/24 15:09:42 Waiting for src bucket item count to get to: 200000 curr count: 113794
2021/12/24 15:09:47 Waiting for src bucket item count to get to: 200000 curr count: 113794
2021/12/24 15:09:52 Waiting for src bucket item count to get to: 200000 curr count: 129804
2021/12/24 15:09:57 Waiting for src bucket item count to get to: 200000 curr count: 129804
2021/12/24 15:10:02 Waiting for src bucket item count to get to: 200000 curr count: 129804
2021/12/24 15:10:07 Waiting for src bucket item count to get to: 200000 curr count: 145977
2021/12/24 15:10:12 Waiting for src bucket item count to get to: 200000 curr count: 145977
2021/12/24 15:10:17 Waiting for src bucket item count to get to: 200000 curr count: 161901
2021/12/24 15:10:22 Waiting for src bucket item count to get to: 200000 curr count: 161901
2021/12/24 15:10:27 Waiting for src bucket item count to get to: 200000 curr count: 176601
2021/12/24 15:10:32 Waiting for src bucket item count to get to: 200000 curr count: 176601
2021/12/24 15:10:37 Waiting for src bucket item count to get to: 200000 curr count: 193071
2021/12/24 15:10:42 Waiting for src bucket item count to get to: 200000 curr count: 193071
2021/12/24 15:10:47 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 15:10:47 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 15:10:47 Starting bucket ops to source bucket
2021/12/24 15:14:32 Waiting for dst bucket item count to get to: 0 curr count: 15205
2021/12/24 15:14:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:14:32 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 15:14:38 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/24 15:14:43 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/24 15:14:48 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/24 15:14:53 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/24 15:14:53 App: TestEventingRebInWithOps got un-deployed
2021/12/24 15:14:53 No eventing-con process running
2021/12/24 15:14:53 Function: TestEventingRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps deleting in background"
}
2021/12/24 15:14:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:14:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:14:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:15:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:15:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:15:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithOps (449.76s)
=== RUN   TestEventingRebOutWithOps
2021/12/24 15:15:11 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 15:15:12 Removing node(s): [] from the cluster
2021/12/24 15:15:17 Rebalance progress: 100
2021/12/24 15:15:22 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/24 15:15:22 App: TestEventingRebOutWithOps got un-deployed
2021/12/24 15:15:22 No eventing-con process running
2021/12/24 15:15:22 Function: TestEventingRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithOps not found"
}
2021/12/24 15:15:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:15:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:15:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:15:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:15:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:15:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:15:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:15:40 Deploying app: TestEventingRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 15:15:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps stored in temp store"
}
2021/12/24 15:15:46 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/24 15:15:51 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/24 15:15:56 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/24 15:16:01 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/24 15:16:01 App: TestEventingRebOutWithOps got deployed
2021/12/24 15:16:01 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:16:01 Starting bucket ops to source bucket
2021/12/24 15:16:07 Rebalance progress: 12.5
2021/12/24 15:16:12 Rebalance progress: 12.5
2021/12/24 15:16:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:16:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:16:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:16:17 Waiting for src bucket item count to get to: 200000 curr count: 11891
2021/12/24 15:16:22 Waiting for src bucket item count to get to: 200000 curr count: 28029
2021/12/24 15:16:27 Waiting for src bucket item count to get to: 200000 curr count: 28029
2021/12/24 15:16:32 Waiting for src bucket item count to get to: 200000 curr count: 44427
2021/12/24 15:16:37 Waiting for src bucket item count to get to: 200000 curr count: 44427
2021/12/24 15:16:42 Waiting for src bucket item count to get to: 200000 curr count: 60993
2021/12/24 15:16:47 Waiting for src bucket item count to get to: 200000 curr count: 60993
2021/12/24 15:16:52 Waiting for src bucket item count to get to: 200000 curr count: 60993
2021/12/24 15:16:57 Waiting for src bucket item count to get to: 200000 curr count: 76492
2021/12/24 15:17:02 Waiting for src bucket item count to get to: 200000 curr count: 76492
2021/12/24 15:17:07 Waiting for src bucket item count to get to: 200000 curr count: 92567
2021/12/24 15:17:12 Waiting for src bucket item count to get to: 200000 curr count: 92567
2021/12/24 15:17:17 Waiting for src bucket item count to get to: 200000 curr count: 109003
2021/12/24 15:17:22 Waiting for src bucket item count to get to: 200000 curr count: 109003
2021/12/24 15:17:27 Waiting for src bucket item count to get to: 200000 curr count: 125394
2021/12/24 15:17:32 Waiting for src bucket item count to get to: 200000 curr count: 125394
2021/12/24 15:17:37 Waiting for src bucket item count to get to: 200000 curr count: 141734
2021/12/24 15:17:42 Waiting for src bucket item count to get to: 200000 curr count: 141734
2021/12/24 15:17:47 Waiting for src bucket item count to get to: 200000 curr count: 158148
2021/12/24 15:17:52 Waiting for src bucket item count to get to: 200000 curr count: 158148
2021/12/24 15:17:57 Waiting for src bucket item count to get to: 200000 curr count: 173148
2021/12/24 15:18:02 Waiting for src bucket item count to get to: 200000 curr count: 173148
2021/12/24 15:18:07 Waiting for src bucket item count to get to: 200000 curr count: 189021
2021/12/24 15:18:12 Waiting for src bucket item count to get to: 200000 curr count: 189021
2021/12/24 15:18:17 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 15:18:17 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 15:18:17 Starting bucket ops to source bucket
2021/12/24 15:22:02 Waiting for dst bucket item count to get to: 0 curr count: 14095
2021/12/24 15:22:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:22:02 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 15:22:07 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/24 15:22:12 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/24 15:22:17 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/24 15:22:17 App: TestEventingRebOutWithOps got un-deployed
2021/12/24 15:22:17 No eventing-con process running
2021/12/24 15:22:17 Function: TestEventingRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps deleting in background"
}
2021/12/24 15:22:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:22:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:22:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:22:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:22:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:22:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithOps (444.50s)
=== RUN   TestEventingSwapRebWithOps
2021/12/24 15:22:41 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/24 15:22:41 App: TestEventingSwapRebWithOps got un-deployed
2021/12/24 15:22:41 No eventing-con process running
2021/12/24 15:22:41 Function: TestEventingSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithOps not found"
}
2021/12/24 15:22:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:22:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:22:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:22:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:22:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:22:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:22:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:22:59 Deploying app: TestEventingSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 15:23:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps stored in temp store"
}
2021/12/24 15:23:05 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/24 15:23:11 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/24 15:23:16 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/24 15:23:21 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/24 15:23:21 App: TestEventingSwapRebWithOps got deployed
2021/12/24 15:23:21 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 15:23:21 Starting bucket ops to source bucket
2021/12/24 15:23:21 Removing node(s): [] from the cluster
2021/12/24 15:23:26 Rebalance progress: 12.5
2021/12/24 15:23:31 Rebalance progress: 12.5
2021/12/24 15:23:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:23:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:23:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:23:36 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 15:23:37 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:23:42 Rebalance progress: 12.5
2021/12/24 15:23:47 Rebalance progress: 12.5
2021/12/24 15:23:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:23:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:23:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:23:52 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 15:23:57 Rebalance progress: 12.5
2021/12/24 15:24:02 Rebalance progress: 12.5
2021/12/24 15:24:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:24:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:24:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:24:07 Waiting for src bucket item count to get to: 200000 curr count: 59640
2021/12/24 15:24:12 Waiting for src bucket item count to get to: 200000 curr count: 74680
2021/12/24 15:24:17 Waiting for src bucket item count to get to: 200000 curr count: 74680
2021/12/24 15:24:22 Waiting for src bucket item count to get to: 200000 curr count: 90783
2021/12/24 15:24:27 Waiting for src bucket item count to get to: 200000 curr count: 90783
2021/12/24 15:24:32 Waiting for src bucket item count to get to: 200000 curr count: 107130
2021/12/24 15:24:37 Waiting for src bucket item count to get to: 200000 curr count: 107130
2021/12/24 15:24:42 Waiting for src bucket item count to get to: 200000 curr count: 123356
2021/12/24 15:24:47 Waiting for src bucket item count to get to: 200000 curr count: 123356
2021/12/24 15:24:52 Waiting for src bucket item count to get to: 200000 curr count: 139430
2021/12/24 15:24:57 Waiting for src bucket item count to get to: 200000 curr count: 139430
2021/12/24 15:25:02 Waiting for src bucket item count to get to: 200000 curr count: 155687
2021/12/24 15:25:07 Waiting for src bucket item count to get to: 200000 curr count: 155687
2021/12/24 15:25:12 Waiting for src bucket item count to get to: 200000 curr count: 170633
2021/12/24 15:25:17 Waiting for src bucket item count to get to: 200000 curr count: 170633
2021/12/24 15:25:22 Waiting for src bucket item count to get to: 200000 curr count: 186429
2021/12/24 15:25:27 Waiting for src bucket item count to get to: 200000 curr count: 186429
2021/12/24 15:25:32 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 15:25:32 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 15:25:32 Starting bucket ops to source bucket
2021/12/24 15:29:18 Waiting for dst bucket item count to get to: 0 curr count: 5755
2021/12/24 15:29:23 Waiting for dst bucket item count to get to: 0 curr count: 5755
2021/12/24 15:29:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:29:23 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 15:29:28 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/24 15:29:33 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/24 15:29:38 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/24 15:29:43 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/24 15:29:43 App: TestEventingSwapRebWithOps got un-deployed
2021/12/24 15:29:43 No eventing-con process running
2021/12/24 15:29:43 Function: TestEventingSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps deleting in background"
}
2021/12/24 15:29:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:29:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:29:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:29:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:29:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:29:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithOps (445.57s)
=== RUN   TestKVRebInWithOps
2021/12/24 15:30:06 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 15:30:06 App: TestKVRebInWithOps got un-deployed
2021/12/24 15:30:06 No eventing-con process running
2021/12/24 15:30:06 Function: TestKVRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithOps not found"
}
2021/12/24 15:30:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:30:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:30:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:30:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:30:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:30:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:30:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:30:25 Deploying app: TestKVRebInWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 15:30:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps stored in temp store"
}
2021/12/24 15:30:31 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/24 15:30:36 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/24 15:30:41 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/24 15:30:46 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/24 15:30:46 App: TestKVRebInWithOps got deployed
2021/12/24 15:30:46 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 15:30:46 Starting bucket ops to source bucket
2021/12/24 15:30:47 Removing node(s): [] from the cluster
2021/12/24 15:30:52 Rebalance progress: 12.5
2021/12/24 15:30:57 Rebalance progress: 12.5
2021/12/24 15:31:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:31:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:31:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:31:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:31:07 Rebalance progress: 12.5
2021/12/24 15:31:12 Rebalance progress: 12.5
2021/12/24 15:31:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:31:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:31:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:31:17 Waiting for src bucket item count to get to: 200000 curr count: 35689
2021/12/24 15:31:22 Waiting for src bucket item count to get to: 200000 curr count: 51630
2021/12/24 15:31:27 Waiting for src bucket item count to get to: 200000 curr count: 51630
2021/12/24 15:31:32 Waiting for src bucket item count to get to: 200000 curr count: 67736
2021/12/24 15:31:37 Waiting for src bucket item count to get to: 200000 curr count: 67736
2021/12/24 15:31:42 Waiting for src bucket item count to get to: 200000 curr count: 82661
2021/12/24 15:31:47 Waiting for src bucket item count to get to: 200000 curr count: 82661
2021/12/24 15:31:52 Waiting for src bucket item count to get to: 200000 curr count: 99039
2021/12/24 15:31:57 Waiting for src bucket item count to get to: 200000 curr count: 99039
2021/12/24 15:32:02 Waiting for src bucket item count to get to: 200000 curr count: 115419
2021/12/24 15:32:07 Waiting for src bucket item count to get to: 200000 curr count: 115419
2021/12/24 15:32:12 Waiting for src bucket item count to get to: 200000 curr count: 131610
2021/12/24 15:32:17 Waiting for src bucket item count to get to: 200000 curr count: 131610
2021/12/24 15:32:22 Waiting for src bucket item count to get to: 200000 curr count: 131610
2021/12/24 15:32:27 Waiting for src bucket item count to get to: 200000 curr count: 148265
2021/12/24 15:32:32 Waiting for src bucket item count to get to: 200000 curr count: 148265
2021/12/24 15:32:37 Waiting for src bucket item count to get to: 200000 curr count: 165013
2021/12/24 15:32:42 Waiting for src bucket item count to get to: 200000 curr count: 165013
2021/12/24 15:32:47 Waiting for src bucket item count to get to: 200000 curr count: 180253
2021/12/24 15:32:52 Waiting for src bucket item count to get to: 200000 curr count: 180253
2021/12/24 15:32:57 Waiting for src bucket item count to get to: 200000 curr count: 196705
2021/12/24 15:33:02 Waiting for src bucket item count to get to: 200000 curr count: 196705
2021/12/24 15:33:07 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 15:33:07 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 15:33:07 Starting bucket ops to source bucket
2021/12/24 15:36:53 Waiting for dst bucket item count to get to: 0 curr count: 15578
2021/12/24 15:36:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:36:53 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 15:36:58 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 15:37:03 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 15:37:08 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 15:37:13 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 15:37:13 App: TestKVRebInWithOps got un-deployed
2021/12/24 15:37:13 No eventing-con process running
2021/12/24 15:37:13 Function: TestKVRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps deleting in background"
}
2021/12/24 15:37:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:37:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:37:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:37:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:37:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:37:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithOps (450.10s)
=== RUN   TestKVRebOutWithOps
2021/12/24 15:37:31 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 15:37:32 Removing node(s): [] from the cluster
2021/12/24 15:37:37 Rebalance progress: 100
2021/12/24 15:37:42 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 15:37:42 App: TestKVRebOutWithOps got un-deployed
2021/12/24 15:37:42 No eventing-con process running
2021/12/24 15:37:42 Function: TestKVRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithOps not found"
}
2021/12/24 15:37:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:37:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:37:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:37:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:37:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:37:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:38:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:38:00 Deploying app: TestKVRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 15:38:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps stored in temp store"
}
2021/12/24 15:38:07 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 15:38:12 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 15:38:17 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 15:38:22 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 15:38:22 App: TestKVRebOutWithOps got deployed
2021/12/24 15:38:22 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:38:22 Starting bucket ops to source bucket
2021/12/24 15:38:27 Rebalance progress: 12.5
2021/12/24 15:38:32 Rebalance progress: 12.5
2021/12/24 15:38:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:38:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:38:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:38:37 Waiting for src bucket item count to get to: 200000 curr count: 11648
2021/12/24 15:38:42 Waiting for src bucket item count to get to: 200000 curr count: 27951
2021/12/24 15:38:47 Waiting for src bucket item count to get to: 200000 curr count: 27951
2021/12/24 15:38:52 Waiting for src bucket item count to get to: 200000 curr count: 44312
2021/12/24 15:38:57 Waiting for src bucket item count to get to: 200000 curr count: 44312
2021/12/24 15:39:02 Waiting for src bucket item count to get to: 200000 curr count: 60449
2021/12/24 15:39:07 Waiting for src bucket item count to get to: 200000 curr count: 60449
2021/12/24 15:39:12 Waiting for src bucket item count to get to: 200000 curr count: 60449
2021/12/24 15:39:17 Waiting for src bucket item count to get to: 200000 curr count: 75709
2021/12/24 15:39:22 Waiting for src bucket item count to get to: 200000 curr count: 75709
2021/12/24 15:39:27 Waiting for src bucket item count to get to: 200000 curr count: 91620
2021/12/24 15:39:32 Waiting for src bucket item count to get to: 200000 curr count: 91620
2021/12/24 15:39:37 Waiting for src bucket item count to get to: 200000 curr count: 107710
2021/12/24 15:39:42 Waiting for src bucket item count to get to: 200000 curr count: 107710
2021/12/24 15:39:47 Waiting for src bucket item count to get to: 200000 curr count: 123811
2021/12/24 15:39:52 Waiting for src bucket item count to get to: 200000 curr count: 123811
2021/12/24 15:39:57 Waiting for src bucket item count to get to: 200000 curr count: 139840
2021/12/24 15:40:02 Waiting for src bucket item count to get to: 200000 curr count: 139840
2021/12/24 15:40:07 Waiting for src bucket item count to get to: 200000 curr count: 156207
2021/12/24 15:40:12 Waiting for src bucket item count to get to: 200000 curr count: 156207
2021/12/24 15:40:17 Waiting for src bucket item count to get to: 200000 curr count: 171762
2021/12/24 15:40:22 Waiting for src bucket item count to get to: 200000 curr count: 171762
2021/12/24 15:40:27 Waiting for src bucket item count to get to: 200000 curr count: 188118
2021/12/24 15:40:32 Waiting for src bucket item count to get to: 200000 curr count: 188118
2021/12/24 15:40:37 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 15:40:37 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 15:40:37 Starting bucket ops to source bucket
2021/12/24 15:44:23 Waiting for dst bucket item count to get to: 0 curr count: 15437
2021/12/24 15:44:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:44:23 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 15:44:28 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 15:44:33 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 15:44:38 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 15:44:43 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 15:44:43 App: TestKVRebOutWithOps got un-deployed
2021/12/24 15:44:43 No eventing-con process running
2021/12/24 15:44:43 Function: TestKVRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps deleting in background"
}
2021/12/24 15:44:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:44:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:44:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:44:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:44:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:44:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithOps (449.99s)
=== RUN   TestKVSwapRebWithOps
2021/12/24 15:45:06 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 15:45:06 App: TestKVSwapRebWithOps got un-deployed
2021/12/24 15:45:06 No eventing-con process running
2021/12/24 15:45:06 Function: TestKVSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithOps not found"
}
2021/12/24 15:45:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:45:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:45:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:45:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:45:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:45:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:45:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:45:25 Deploying app: TestKVSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 15:45:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps stored in temp store"
}
2021/12/24 15:45:31 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 15:45:36 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 15:45:41 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 15:45:46 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 15:45:46 App: TestKVSwapRebWithOps got deployed
2021/12/24 15:45:46 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 15:45:46 Starting bucket ops to source bucket
2021/12/24 15:45:46 Removing node(s): [] from the cluster
2021/12/24 15:45:51 Rebalance progress: 12.5
2021/12/24 15:45:56 Rebalance progress: 12.5
2021/12/24 15:46:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:46:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:46:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:46:02 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 15:46:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:46:07 Rebalance progress: 12.5
2021/12/24 15:46:12 Rebalance progress: 12.5
2021/12/24 15:46:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:46:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:46:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:46:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 15:46:22 Rebalance progress: 12.5
2021/12/24 15:46:27 Rebalance progress: 12.5
2021/12/24 15:46:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:46:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:46:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:46:32 Waiting for src bucket item count to get to: 200000 curr count: 67261
2021/12/24 15:46:37 Waiting for src bucket item count to get to: 200000 curr count: 67261
2021/12/24 15:46:42 Waiting for src bucket item count to get to: 200000 curr count: 81981
2021/12/24 15:46:47 Waiting for src bucket item count to get to: 200000 curr count: 81981
2021/12/24 15:46:52 Waiting for src bucket item count to get to: 200000 curr count: 98347
2021/12/24 15:46:57 Waiting for src bucket item count to get to: 200000 curr count: 98347
2021/12/24 15:47:02 Waiting for src bucket item count to get to: 200000 curr count: 114978
2021/12/24 15:47:07 Waiting for src bucket item count to get to: 200000 curr count: 114978
2021/12/24 15:47:12 Waiting for src bucket item count to get to: 200000 curr count: 131253
2021/12/24 15:47:17 Waiting for src bucket item count to get to: 200000 curr count: 131253
2021/12/24 15:47:22 Waiting for src bucket item count to get to: 200000 curr count: 147962
2021/12/24 15:47:27 Waiting for src bucket item count to get to: 200000 curr count: 147962
2021/12/24 15:47:32 Waiting for src bucket item count to get to: 200000 curr count: 147962
2021/12/24 15:47:37 Waiting for src bucket item count to get to: 200000 curr count: 164584
2021/12/24 15:47:42 Waiting for src bucket item count to get to: 200000 curr count: 164584
2021/12/24 15:47:47 Waiting for src bucket item count to get to: 200000 curr count: 179669
2021/12/24 15:47:52 Waiting for src bucket item count to get to: 200000 curr count: 179669
2021/12/24 15:47:57 Waiting for src bucket item count to get to: 200000 curr count: 196228
2021/12/24 15:48:02 Waiting for src bucket item count to get to: 200000 curr count: 196228
2021/12/24 15:48:07 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 15:48:07 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 15:48:07 Starting bucket ops to source bucket
2021/12/24 15:51:53 Waiting for dst bucket item count to get to: 0 curr count: 15850
2021/12/24 15:51:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:51:53 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 15:51:58 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 15:52:03 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 15:52:08 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 15:52:13 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 15:52:13 App: TestKVSwapRebWithOps got un-deployed
2021/12/24 15:52:13 No eventing-con process running
2021/12/24 15:52:13 Function: TestKVSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps deleting in background"
}
2021/12/24 15:52:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:52:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:52:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:52:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:52:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:52:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithOps (450.03s)
=== RUN   TestEventingRebInWithTimers
2021/12/24 15:52:36 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 15:52:36 App: TestEventingRebInWithTimers got un-deployed
2021/12/24 15:52:37 No eventing-con process running
2021/12/24 15:52:37 Function: TestEventingRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithTimers not found"
}
2021/12/24 15:52:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:52:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:52:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:52:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:52:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:52:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:52:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:52:55 Deploying app: TestEventingRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 15:52:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers stored in temp store"
}
2021/12/24 15:53:01 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 15:53:06 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 15:53:11 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 15:53:16 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 15:53:16 App: TestEventingRebInWithTimers got deployed
2021/12/24 15:53:16 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 15:53:16 Starting bucket ops to source bucket
2021/12/24 15:53:17 Removing node(s): [] from the cluster
2021/12/24 15:53:22 Rebalance progress: 12.5
2021/12/24 15:53:27 Rebalance progress: 12.5
2021/12/24 15:53:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:53:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:53:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:53:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:53:37 Rebalance progress: 12.5
2021/12/24 15:53:42 Rebalance progress: 12.5
2021/12/24 15:53:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:53:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:53:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:53:47 Waiting for src bucket item count to get to: 50000 curr count: 27531
2021/12/24 15:53:52 Waiting for src bucket item count to get to: 50000 curr count: 39385
2021/12/24 15:53:57 Waiting for src bucket item count to get to: 50000 curr count: 39385
2021/12/24 15:54:07 Waiting for dst bucket item count to get to: 50000 curr count: 39079
2021/12/24 15:54:12 Waiting for dst bucket item count to get to: 50000 curr count: 39079
2021/12/24 15:54:17 Waiting for dst bucket item count to get to: 50000 curr count: 48956
2021/12/24 15:54:22 Waiting for dst bucket item count to get to: 50000 curr count: 48956
2021/12/24 15:54:22 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 15:54:22 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 15:54:22 Starting bucket ops to source bucket
2021/12/24 15:55:32 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 15:55:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 15:55:42 Waiting for dst bucket item count to get to: 0 curr count: 46461
2021/12/24 15:55:47 Waiting for dst bucket item count to get to: 0 curr count: 46461
2021/12/24 15:55:52 Waiting for dst bucket item count to get to: 0 curr count: 37588
2021/12/24 15:55:57 Waiting for dst bucket item count to get to: 0 curr count: 37588
2021/12/24 15:56:02 Waiting for dst bucket item count to get to: 0 curr count: 24130
2021/12/24 15:56:07 Waiting for dst bucket item count to get to: 0 curr count: 24130
2021/12/24 15:56:12 Waiting for dst bucket item count to get to: 0 curr count: 519
2021/12/24 15:56:17 Waiting for dst bucket item count to get to: 0 curr count: 519
2021/12/24 15:56:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:56:17 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 15:56:22 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 15:56:27 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 15:56:32 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 15:56:37 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 15:56:37 App: TestEventingRebInWithTimers got un-deployed
2021/12/24 15:56:37 No eventing-con process running
2021/12/24 15:56:37 Function: TestEventingRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers deleting in background"
}
2021/12/24 15:56:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:56:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:56:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:56:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:56:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:56:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithTimers (264.09s)
=== RUN   TestEventingRebOutWithTimers
2021/12/24 15:56:56 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 15:56:56 Removing node(s): [] from the cluster
2021/12/24 15:57:01 Rebalance progress: 100
2021/12/24 15:57:06 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 15:57:06 App: TestEventingRebOutWithTimers got un-deployed
2021/12/24 15:57:06 No eventing-con process running
2021/12/24 15:57:06 Function: TestEventingRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithTimers not found"
}
2021/12/24 15:57:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:57:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:57:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 15:57:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:57:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:57:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:57:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 15:57:24 Deploying app: TestEventingRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 15:57:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers stored in temp store"
}
2021/12/24 15:57:30 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 15:57:35 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 15:57:40 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 15:57:46 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 15:57:46 App: TestEventingRebOutWithTimers got deployed
2021/12/24 15:57:46 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 15:57:46 Starting bucket ops to source bucket
2021/12/24 15:57:51 Rebalance progress: 12.5
2021/12/24 15:57:56 Rebalance progress: 12.5
2021/12/24 15:58:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:58:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 15:58:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 15:58:01 Waiting for src bucket item count to get to: 50000 curr count: 19474
2021/12/24 15:58:06 Waiting for src bucket item count to get to: 50000 curr count: 19474
2021/12/24 15:58:11 Waiting for src bucket item count to get to: 50000 curr count: 30649
2021/12/24 15:58:16 Waiting for src bucket item count to get to: 50000 curr count: 30649
2021/12/24 15:58:21 Waiting for src bucket item count to get to: 50000 curr count: 42444
2021/12/24 15:58:26 Waiting for src bucket item count to get to: 50000 curr count: 42444
2021/12/24 15:58:36 Waiting for dst bucket item count to get to: 50000 curr count: 38118
2021/12/24 15:58:41 Waiting for dst bucket item count to get to: 50000 curr count: 38118
2021/12/24 15:58:46 Waiting for dst bucket item count to get to: 50000 curr count: 38118
2021/12/24 15:58:51 Waiting for dst bucket item count to get to: 50000 curr count: 46946
2021/12/24 15:58:56 Waiting for dst bucket item count to get to: 50000 curr count: 46946
2021/12/24 15:58:56 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 15:58:56 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 15:58:56 Starting bucket ops to source bucket
2021/12/24 16:00:05 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:00:10 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:00:15 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:00:20 Waiting for dst bucket item count to get to: 0 curr count: 47609
2021/12/24 16:00:25 Waiting for dst bucket item count to get to: 0 curr count: 47609
2021/12/24 16:00:30 Waiting for dst bucket item count to get to: 0 curr count: 35070
2021/12/24 16:00:35 Waiting for dst bucket item count to get to: 0 curr count: 35070
2021/12/24 16:00:40 Waiting for dst bucket item count to get to: 0 curr count: 13417
2021/12/24 16:00:45 Waiting for dst bucket item count to get to: 0 curr count: 13417
2021/12/24 16:00:50 Waiting for dst bucket item count to get to: 0 curr count: 1370
2021/12/24 16:00:55 Waiting for dst bucket item count to get to: 0 curr count: 1370
2021/12/24 16:00:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:00:55 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 16:01:00 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 16:01:06 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 16:01:11 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 16:01:16 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 16:01:16 App: TestEventingRebOutWithTimers got un-deployed
2021/12/24 16:01:16 No eventing-con process running
2021/12/24 16:01:16 Function: TestEventingRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers deleting in background"
}
2021/12/24 16:01:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:01:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:01:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:01:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:01:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:01:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithTimers (278.61s)
=== RUN   TestEventingSwapRebWithTimers
2021/12/24 16:01:39 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 16:01:39 App: TestEventingSwapRebWithTimers got un-deployed
2021/12/24 16:01:39 No eventing-con process running
2021/12/24 16:01:39 Function: TestEventingSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithTimers not found"
}
2021/12/24 16:01:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:01:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:01:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:01:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:01:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:01:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:01:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:01:58 Deploying app: TestEventingSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:01:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers stored in temp store"
}
2021/12/24 16:02:04 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 16:02:09 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 16:02:14 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 16:02:19 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 16:02:19 App: TestEventingSwapRebWithTimers got deployed
2021/12/24 16:02:19 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 16:02:19 Starting bucket ops to source bucket
2021/12/24 16:02:19 Removing node(s): [] from the cluster
2021/12/24 16:02:24 Rebalance progress: 12.5
2021/12/24 16:02:29 Rebalance progress: 12.5
2021/12/24 16:02:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:02:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:02:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:02:34 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 16:02:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:02:40 Rebalance progress: 12.5
2021/12/24 16:02:45 Rebalance progress: 12.5
2021/12/24 16:02:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:02:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:02:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:02:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 16:02:55 Rebalance progress: 12.5
2021/12/24 16:03:00 Rebalance progress: 12.5
2021/12/24 16:03:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:03:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:03:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:03:05 Waiting for src bucket item count to get to: 50000 curr count: 48214
2021/12/24 16:03:10 Waiting for src bucket item count to get to: 50000 curr count: 48214
2021/12/24 16:03:20 Waiting for dst bucket item count to get to: 50000 curr count: 43562
2021/12/24 16:03:25 Waiting for dst bucket item count to get to: 50000 curr count: 43562
2021/12/24 16:03:25 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:03:25 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:03:25 Starting bucket ops to source bucket
2021/12/24 16:04:34 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:04:39 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:04:44 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:04:49 Waiting for dst bucket item count to get to: 0 curr count: 45617
2021/12/24 16:04:54 Waiting for dst bucket item count to get to: 0 curr count: 45617
2021/12/24 16:04:59 Waiting for dst bucket item count to get to: 0 curr count: 30473
2021/12/24 16:05:04 Waiting for dst bucket item count to get to: 0 curr count: 30473
2021/12/24 16:05:09 Waiting for dst bucket item count to get to: 0 curr count: 17883
2021/12/24 16:05:14 Waiting for dst bucket item count to get to: 0 curr count: 17883
2021/12/24 16:05:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:05:14 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 16:05:19 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 16:05:24 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 16:05:29 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 16:05:34 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 16:05:34 App: TestEventingSwapRebWithTimers got un-deployed
2021/12/24 16:05:34 No eventing-con process running
2021/12/24 16:05:34 Function: TestEventingSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers deleting in background"
}
2021/12/24 16:05:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:05:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:05:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:05:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:05:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:05:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithTimers (258.71s)
=== RUN   TestKVRebInWithTimers
2021/12/24 16:05:58 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/24 16:05:58 App: TestKVRebInWithTimers got un-deployed
2021/12/24 16:05:58 No eventing-con process running
2021/12/24 16:05:58 Function: TestKVRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithTimers not found"
}
2021/12/24 16:06:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:06:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:06:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:06:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:06:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:06:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:06:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:06:16 Deploying app: TestKVRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:06:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers stored in temp store"
}
2021/12/24 16:06:23 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/24 16:06:28 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/24 16:06:33 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/24 16:06:38 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/24 16:06:38 App: TestKVRebInWithTimers got deployed
2021/12/24 16:06:38 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:06:38 Starting bucket ops to source bucket
2021/12/24 16:06:38 Removing node(s): [] from the cluster
2021/12/24 16:06:43 Rebalance progress: 12.5
2021/12/24 16:06:48 Rebalance progress: 12.5
2021/12/24 16:06:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:06:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:06:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:06:53 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:06:58 Rebalance progress: 12.5
2021/12/24 16:07:03 Rebalance progress: 12.5
2021/12/24 16:07:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:07:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:07:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:07:08 Waiting for src bucket item count to get to: 50000 curr count: 27890
2021/12/24 16:07:13 Waiting for src bucket item count to get to: 50000 curr count: 37602
2021/12/24 16:07:18 Waiting for src bucket item count to get to: 50000 curr count: 37602
2021/12/24 16:07:28 Waiting for dst bucket item count to get to: 50000 curr count: 29547
2021/12/24 16:07:33 Waiting for dst bucket item count to get to: 50000 curr count: 29547
2021/12/24 16:07:38 Waiting for dst bucket item count to get to: 50000 curr count: 44716
2021/12/24 16:07:43 Waiting for dst bucket item count to get to: 50000 curr count: 44716
2021/12/24 16:07:43 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:07:43 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:07:43 Starting bucket ops to source bucket
2021/12/24 16:08:53 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:08:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:09:03 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:09:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:09:13 Waiting for dst bucket item count to get to: 0 curr count: 40560
2021/12/24 16:09:18 Waiting for dst bucket item count to get to: 0 curr count: 40560
2021/12/24 16:09:23 Waiting for dst bucket item count to get to: 0 curr count: 30897
2021/12/24 16:09:28 Waiting for dst bucket item count to get to: 0 curr count: 12465
2021/12/24 16:09:33 Waiting for dst bucket item count to get to: 0 curr count: 12465
2021/12/24 16:09:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:09:33 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 16:09:38 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/24 16:09:44 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/24 16:09:49 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/24 16:09:54 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/24 16:09:54 App: TestKVRebInWithTimers got un-deployed
2021/12/24 16:09:54 No eventing-con process running
2021/12/24 16:09:54 Function: TestKVRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers deleting in background"
}
2021/12/24 16:09:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:10:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:10:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:10:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:10:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:10:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithTimers (259.32s)
=== RUN   TestKVRebOutWithTimers
2021/12/24 16:10:12 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:10:13 Removing node(s): [] from the cluster
2021/12/24 16:10:18 Rebalance progress: 100
2021/12/24 16:10:23 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/24 16:10:23 App: TestKVRebOutWithTimers got un-deployed
2021/12/24 16:10:23 No eventing-con process running
2021/12/24 16:10:23 Function: TestKVRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithTimers not found"
}
2021/12/24 16:10:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:10:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:10:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:10:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:10:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:10:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:10:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:10:41 Deploying app: TestKVRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:10:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers stored in temp store"
}
2021/12/24 16:10:47 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/24 16:10:52 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/24 16:10:57 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/24 16:11:02 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/24 16:11:02 App: TestKVRebOutWithTimers got deployed
2021/12/24 16:11:02 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:11:02 Starting bucket ops to source bucket
2021/12/24 16:11:07 Rebalance progress: 12.5
2021/12/24 16:11:12 Rebalance progress: 12.5
2021/12/24 16:11:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:11:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:11:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:11:17 Waiting for src bucket item count to get to: 50000 curr count: 9229
2021/12/24 16:11:22 Waiting for src bucket item count to get to: 50000 curr count: 22120
2021/12/24 16:11:27 Waiting for src bucket item count to get to: 50000 curr count: 22120
2021/12/24 16:11:32 Waiting for src bucket item count to get to: 50000 curr count: 33917
2021/12/24 16:11:37 Waiting for src bucket item count to get to: 50000 curr count: 33917
2021/12/24 16:11:42 Waiting for src bucket item count to get to: 50000 curr count: 43714
2021/12/24 16:11:47 Waiting for src bucket item count to get to: 50000 curr count: 43714
2021/12/24 16:11:52 Waiting for src bucket item count to get to: 50000 curr count: 43714
2021/12/24 16:12:02 Waiting for dst bucket item count to get to: 50000 curr count: 38849
2021/12/24 16:12:07 Waiting for dst bucket item count to get to: 50000 curr count: 38849
2021/12/24 16:12:07 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:12:07 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:12:07 Starting bucket ops to source bucket
2021/12/24 16:13:17 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:13:22 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:13:27 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:13:32 Waiting for dst bucket item count to get to: 0 curr count: 48408
2021/12/24 16:13:37 Waiting for dst bucket item count to get to: 0 curr count: 48408
2021/12/24 16:13:42 Waiting for dst bucket item count to get to: 0 curr count: 36575
2021/12/24 16:13:47 Waiting for dst bucket item count to get to: 0 curr count: 36575
2021/12/24 16:13:52 Waiting for dst bucket item count to get to: 0 curr count: 14645
2021/12/24 16:13:57 Waiting for dst bucket item count to get to: 0 curr count: 14645
2021/12/24 16:14:02 Waiting for dst bucket item count to get to: 0 curr count: 2646
2021/12/24 16:14:07 Waiting for dst bucket item count to get to: 0 curr count: 2646
2021/12/24 16:14:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:14:07 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 16:14:12 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/24 16:14:17 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/24 16:14:22 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/24 16:14:28 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/24 16:14:28 App: TestKVRebOutWithTimers got un-deployed
2021/12/24 16:14:28 No eventing-con process running
2021/12/24 16:14:28 Function: TestKVRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers deleting in background"
}
2021/12/24 16:14:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:14:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:14:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:14:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:14:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:14:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithTimers (273.78s)
=== RUN   TestKVSwapRebWithTimers
2021/12/24 16:14:51 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 16:14:51 App: TestKVSwapRebWithTimers got un-deployed
2021/12/24 16:14:51 No eventing-con process running
2021/12/24 16:14:51 Function: TestKVSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithTimers not found"
}
2021/12/24 16:14:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:14:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:14:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:15:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:15:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:15:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:15:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:15:10 Deploying app: TestKVSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:15:11 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers stored in temp store"
}
2021/12/24 16:15:16 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/24 16:15:21 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/24 16:15:26 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/24 16:15:31 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/24 16:15:31 App: TestKVSwapRebWithTimers got deployed
2021/12/24 16:15:31 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:15:31 Starting bucket ops to source bucket
2021/12/24 16:15:31 Removing node(s): [] from the cluster
2021/12/24 16:15:36 Rebalance progress: 12.5
2021/12/24 16:15:41 Rebalance progress: 12.5
2021/12/24 16:15:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:15:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:15:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:15:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 16:15:47 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:15:52 Rebalance progress: 12.5
2021/12/24 16:15:57 Rebalance progress: 12.5
2021/12/24 16:16:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:16:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:16:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:16:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 16:16:07 Rebalance progress: 12.5
2021/12/24 16:16:12 Rebalance progress: 12.5
2021/12/24 16:16:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:16:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:16:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:16:17 Waiting for src bucket item count to get to: 50000 curr count: 45150
2021/12/24 16:16:27 Waiting for dst bucket item count to get to: 50000 curr count: 35257
2021/12/24 16:16:32 Waiting for dst bucket item count to get to: 50000 curr count: 35257
2021/12/24 16:16:32 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:16:32 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:16:32 Starting bucket ops to source bucket
2021/12/24 16:17:42 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:17:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:17:52 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:17:57 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:18:02 Waiting for dst bucket item count to get to: 0 curr count: 44019
2021/12/24 16:18:07 Waiting for dst bucket item count to get to: 0 curr count: 44019
2021/12/24 16:18:12 Waiting for dst bucket item count to get to: 0 curr count: 24420
2021/12/24 16:18:17 Waiting for dst bucket item count to get to: 0 curr count: 24420
2021/12/24 16:18:22 Waiting for dst bucket item count to get to: 0 curr count: 12314
2021/12/24 16:18:27 Waiting for dst bucket item count to get to: 0 curr count: 12314
2021/12/24 16:18:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:18:27 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 16:18:32 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 16:18:37 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 16:18:42 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 16:18:47 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 16:18:52 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 16:18:52 App: TestKVSwapRebWithTimers got un-deployed
2021/12/24 16:18:52 No eventing-con process running
2021/12/24 16:18:52 Function: TestKVSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers deleting in background"
}
2021/12/24 16:18:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:18:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:18:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:19:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:19:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:19:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithTimers (264.56s)
=== RUN   TestDuplicateTimerCreationEventingRebIn
2021/12/24 16:19:16 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 16:19:16 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2021/12/24 16:19:16 No eventing-con process running
2021/12/24 16:19:16 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebIn not found"
}
2021/12/24 16:19:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:19:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:19:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:19:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:19:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:19:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:19:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:19:34 Deploying app: TestDuplicateTimerCreationEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:19:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn stored in temp store"
}
2021/12/24 16:19:40 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/24 16:19:45 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/24 16:19:50 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/24 16:19:55 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/24 16:19:55 App: TestDuplicateTimerCreationEventingRebIn got deployed
2021/12/24 16:19:55 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 16:19:55 Starting bucket ops to source bucket
2021/12/24 16:19:56 Removing node(s): [] from the cluster
2021/12/24 16:20:01 Rebalance progress: 12.5
2021/12/24 16:20:06 Rebalance progress: 12.5
2021/12/24 16:20:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:20:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:20:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:20:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:20:16 Rebalance progress: 12.5
2021/12/24 16:20:21 Rebalance progress: 12.5
2021/12/24 16:20:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:20:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:20:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:20:26 Waiting for src bucket item count to get to: 50000 curr count: 31668
2021/12/24 16:20:31 Waiting for src bucket item count to get to: 50000 curr count: 42889
2021/12/24 16:20:36 Waiting for src bucket item count to get to: 50000 curr count: 42889
2021/12/24 16:20:46 Waiting for dst bucket item count to get to: 50000 curr count: 30501
2021/12/24 16:20:51 Waiting for dst bucket item count to get to: 50000 curr count: 30501
2021/12/24 16:20:56 Waiting for dst bucket item count to get to: 50000 curr count: 36403
2021/12/24 16:21:01 Waiting for dst bucket item count to get to: 50000 curr count: 36403
2021/12/24 16:21:06 Waiting for dst bucket item count to get to: 50000 curr count: 49972
2021/12/24 16:21:11 Waiting for dst bucket item count to get to: 50000 curr count: 49972
2021/12/24 16:21:11 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:21:11 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:21:16 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 16:21:21 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 16:21:26 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 16:21:31 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 16:21:36 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 16:21:41 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 16:21:41 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2021/12/24 16:21:41 No eventing-con process running
2021/12/24 16:21:41 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn deleting in background"
}
2021/12/24 16:21:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:21:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:21:53 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:21:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:21:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:22:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:22:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:22:10 Waiting for dst bucket item count to get to: 0 curr count: 104
2021/12/24 16:22:15 Waiting for dst bucket item count to get to: 0 curr count: 104
2021/12/24 16:22:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebIn (189.32s)
=== RUN   TestDuplicateTimerCreationEventingRebOut
2021/12/24 16:22:20 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 16:22:20 Removing node(s): [] from the cluster
2021/12/24 16:22:26 Rebalance progress: 100
2021/12/24 16:22:31 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 16:22:31 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2021/12/24 16:22:31 No eventing-con process running
2021/12/24 16:22:31 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebOut not found"
}
2021/12/24 16:22:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:22:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:22:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:22:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:22:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:22:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:22:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:22:49 Deploying app: TestDuplicateTimerCreationEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:22:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut stored in temp store"
}
2021/12/24 16:22:55 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/24 16:23:00 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/24 16:23:05 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/24 16:23:10 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/24 16:23:10 App: TestDuplicateTimerCreationEventingRebOut got deployed
2021/12/24 16:23:10 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:23:10 Starting bucket ops to source bucket
2021/12/24 16:23:15 Rebalance progress: 12.5
2021/12/24 16:23:20 Rebalance progress: 12.5
2021/12/24 16:23:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:23:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:23:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:23:25 Waiting for src bucket item count to get to: 50000 curr count: 11710
2021/12/24 16:23:30 Waiting for src bucket item count to get to: 50000 curr count: 25854
2021/12/24 16:23:35 Waiting for src bucket item count to get to: 50000 curr count: 25854
2021/12/24 16:23:40 Waiting for src bucket item count to get to: 50000 curr count: 37054
2021/12/24 16:23:45 Waiting for src bucket item count to get to: 50000 curr count: 37054
2021/12/24 16:23:50 Waiting for src bucket item count to get to: 50000 curr count: 46808
2021/12/24 16:23:55 Waiting for src bucket item count to get to: 50000 curr count: 46808
2021/12/24 16:24:05 Waiting for dst bucket item count to get to: 50000 curr count: 35343
2021/12/24 16:24:10 Waiting for dst bucket item count to get to: 50000 curr count: 35343
2021/12/24 16:24:15 Waiting for dst bucket item count to get to: 50000 curr count: 35343
2021/12/24 16:24:20 Waiting for dst bucket item count to get to: 50000 curr count: 45633
2021/12/24 16:24:25 Waiting for dst bucket item count to get to: 50000 curr count: 45633
2021/12/24 16:24:25 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:24:25 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:24:30 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 16:24:36 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 16:24:41 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 16:24:46 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 16:24:51 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 16:24:51 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2021/12/24 16:24:51 No eventing-con process running
2021/12/24 16:24:51 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut deleting in background"
}
2021/12/24 16:24:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:24:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:25:03 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:25:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:25:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:25:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:25:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:25:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebOut (179.74s)
=== RUN   TestDuplicateTimerCreationEventingSwapReb
2021/12/24 16:25:25 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 16:25:25 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2021/12/24 16:25:25 No eventing-con process running
2021/12/24 16:25:25 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingSwapReb not found"
}
2021/12/24 16:25:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:25:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:25:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:25:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:25:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:25:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:25:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:25:43 Deploying app: TestDuplicateTimerCreationEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:25:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb stored in temp store"
}
2021/12/24 16:25:49 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/24 16:25:54 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/24 16:25:59 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/24 16:26:04 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/24 16:26:04 App: TestDuplicateTimerCreationEventingSwapReb got deployed
2021/12/24 16:26:04 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 16:26:04 Starting bucket ops to source bucket
2021/12/24 16:26:05 Removing node(s): [] from the cluster
2021/12/24 16:26:10 Rebalance progress: 12.5
2021/12/24 16:26:15 Rebalance progress: 12.5
2021/12/24 16:26:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:26:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:26:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:26:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 16:26:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:26:26 Rebalance progress: 12.5
2021/12/24 16:26:31 Rebalance progress: 12.5
2021/12/24 16:26:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:26:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:26:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:26:36 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 16:26:41 Rebalance progress: 12.5
2021/12/24 16:26:46 Rebalance progress: 12.5
2021/12/24 16:26:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:26:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:26:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:26:51 Waiting for src bucket item count to get to: 50000 curr count: 41689
2021/12/24 16:27:01 Waiting for dst bucket item count to get to: 50000 curr count: 32066
2021/12/24 16:27:06 Waiting for dst bucket item count to get to: 50000 curr count: 32066
2021/12/24 16:27:11 Waiting for dst bucket item count to get to: 50000 curr count: 38480
2021/12/24 16:27:11 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:27:11 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:27:16 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 16:27:21 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 16:27:26 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 16:27:31 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 16:27:36 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 16:27:36 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2021/12/24 16:27:36 No eventing-con process running
2021/12/24 16:27:36 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb deleting in background"
}
2021/12/24 16:27:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:27:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:27:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:27:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:27:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:27:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:27:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingSwapReb (160.24s)
=== RUN   TestDuplicateTimerCreationKVRebIn
2021/12/24 16:28:05 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 16:28:05 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2021/12/24 16:28:05 No eventing-con process running
2021/12/24 16:28:05 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebIn not found"
}
2021/12/24 16:28:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:28:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:28:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:28:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:28:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:28:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:28:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:28:23 Deploying app: TestDuplicateTimerCreationKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:28:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn stored in temp store"
}
2021/12/24 16:28:30 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/24 16:28:35 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/24 16:28:40 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/24 16:28:45 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/24 16:28:45 App: TestDuplicateTimerCreationKVRebIn got deployed
2021/12/24 16:28:45 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:28:45 Starting bucket ops to source bucket
2021/12/24 16:28:45 Removing node(s): [] from the cluster
2021/12/24 16:28:50 Rebalance progress: 12.5
2021/12/24 16:28:55 Rebalance progress: 12.5
2021/12/24 16:29:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:29:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:29:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:29:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:29:05 Rebalance progress: 12.5
2021/12/24 16:29:10 Rebalance progress: 12.5
2021/12/24 16:29:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:29:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:29:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:29:15 Waiting for src bucket item count to get to: 50000 curr count: 30757
2021/12/24 16:29:20 Waiting for src bucket item count to get to: 50000 curr count: 30757
2021/12/24 16:29:25 Waiting for src bucket item count to get to: 50000 curr count: 41341
2021/12/24 16:29:35 Waiting for dst bucket item count to get to: 50000 curr count: 32364
2021/12/24 16:29:40 Waiting for dst bucket item count to get to: 50000 curr count: 32364
2021/12/24 16:29:45 Waiting for dst bucket item count to get to: 50000 curr count: 39098
2021/12/24 16:29:50 Waiting for dst bucket item count to get to: 50000 curr count: 39098
2021/12/24 16:29:50 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:29:50 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:29:55 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 16:30:00 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 16:30:06 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 16:30:11 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 16:30:16 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 16:30:16 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2021/12/24 16:30:16 No eventing-con process running
2021/12/24 16:30:16 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn deleting in background"
}
2021/12/24 16:30:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:30:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:30:28 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:30:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:30:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:30:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:30:39 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:30:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebIn (164.47s)
=== RUN   TestDuplicateTimerCreationKVRebOut
2021/12/24 16:30:44 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:30:45 Removing node(s): [] from the cluster
2021/12/24 16:30:50 Rebalance progress: 100
2021/12/24 16:30:55 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 16:30:55 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2021/12/24 16:30:55 No eventing-con process running
2021/12/24 16:30:55 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebOut not found"
}
2021/12/24 16:30:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:31:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:31:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:31:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:31:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:31:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:31:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:31:13 Deploying app: TestDuplicateTimerCreationKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:31:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut stored in temp store"
}
2021/12/24 16:31:19 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/24 16:31:24 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/24 16:31:29 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/24 16:31:34 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/24 16:31:35 App: TestDuplicateTimerCreationKVRebOut got deployed
2021/12/24 16:31:35 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:31:35 Starting bucket ops to source bucket
2021/12/24 16:31:40 Rebalance progress: 12.5
2021/12/24 16:31:45 Rebalance progress: 12.5
2021/12/24 16:31:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:31:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:31:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:31:50 Waiting for src bucket item count to get to: 50000 curr count: 5965
2021/12/24 16:31:55 Waiting for src bucket item count to get to: 50000 curr count: 20265
2021/12/24 16:32:00 Waiting for src bucket item count to get to: 50000 curr count: 20265
2021/12/24 16:32:05 Waiting for src bucket item count to get to: 50000 curr count: 33631
2021/12/24 16:32:10 Waiting for src bucket item count to get to: 50000 curr count: 33631
2021/12/24 16:32:15 Waiting for src bucket item count to get to: 50000 curr count: 44536
2021/12/24 16:32:25 Waiting for dst bucket item count to get to: 50000 curr count: 32460
2021/12/24 16:32:30 Waiting for dst bucket item count to get to: 50000 curr count: 32460
2021/12/24 16:32:35 Waiting for dst bucket item count to get to: 50000 curr count: 32460
2021/12/24 16:32:40 Waiting for dst bucket item count to get to: 50000 curr count: 38565
2021/12/24 16:32:45 Waiting for dst bucket item count to get to: 50000 curr count: 38565
2021/12/24 16:32:45 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:32:45 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:32:50 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 16:32:55 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 16:33:00 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 16:33:05 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 16:33:10 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 16:33:15 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 16:33:15 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2021/12/24 16:33:15 No eventing-con process running
2021/12/24 16:33:15 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut deleting in background"
}
2021/12/24 16:33:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:33:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:33:27 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:33:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:33:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:33:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:33:39 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:33:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebOut (179.54s)
=== RUN   TestDuplicateTimerCreationKVSwapReb
2021/12/24 16:33:49 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 16:33:49 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2021/12/24 16:33:49 No eventing-con process running
2021/12/24 16:33:49 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVSwapReb not found"
}
2021/12/24 16:33:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:33:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:33:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:33:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:34:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:34:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:34:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:34:07 Deploying app: TestDuplicateTimerCreationKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:34:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb stored in temp store"
}
2021/12/24 16:34:14 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/24 16:34:19 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/24 16:34:24 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/24 16:34:29 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/24 16:34:29 App: TestDuplicateTimerCreationKVSwapReb got deployed
2021/12/24 16:34:29 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:34:29 Starting bucket ops to source bucket
2021/12/24 16:34:29 Removing node(s): [] from the cluster
2021/12/24 16:34:34 Rebalance progress: 12.5
2021/12/24 16:34:39 Rebalance progress: 12.5
2021/12/24 16:34:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:34:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:34:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:34:44 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 16:34:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:34:50 Rebalance progress: 12.5
2021/12/24 16:34:55 Rebalance progress: 12.5
2021/12/24 16:35:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:35:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:35:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:35:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 16:35:05 Rebalance progress: 12.5
2021/12/24 16:35:10 Rebalance progress: 12.5
2021/12/24 16:35:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:35:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:35:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:35:15 Waiting for src bucket item count to get to: 50000 curr count: 47845
2021/12/24 16:35:20 Waiting for src bucket item count to get to: 50000 curr count: 47845
2021/12/24 16:35:30 Waiting for dst bucket item count to get to: 50000 curr count: 38521
2021/12/24 16:35:35 Waiting for dst bucket item count to get to: 50000 curr count: 38521
2021/12/24 16:35:40 Waiting for dst bucket item count to get to: 50000 curr count: 45252
2021/12/24 16:35:45 Waiting for dst bucket item count to get to: 50000 curr count: 45252
2021/12/24 16:35:45 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:35:45 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:35:50 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 16:35:55 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 16:36:01 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 16:36:06 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 16:36:11 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 16:36:11 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2021/12/24 16:36:11 No eventing-con process running
2021/12/24 16:36:11 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb deleting in background"
}
2021/12/24 16:36:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:36:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:36:23 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:36:28 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:36:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:36:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:36:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:36:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVSwapReb (175.52s)
=== RUN   TestDuplicateTimerFiringEventingRebIn
2021/12/24 16:36:44 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 16:36:44 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2021/12/24 16:36:44 No eventing-con process running
2021/12/24 16:36:44 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebIn not found"
}
2021/12/24 16:36:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:36:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:36:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:36:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:36:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:36:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:37:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:37:03 Deploying app: TestDuplicateTimerFiringEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:37:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn stored in temp store"
}
2021/12/24 16:37:09 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/24 16:37:14 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/24 16:37:19 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/24 16:37:24 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/24 16:37:24 App: TestDuplicateTimerFiringEventingRebIn got deployed
2021/12/24 16:37:24 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 16:37:24 Starting bucket ops to source bucket
2021/12/24 16:37:25 Removing node(s): [] from the cluster
2021/12/24 16:37:30 Rebalance progress: 12.5
2021/12/24 16:37:35 Rebalance progress: 12.5
2021/12/24 16:37:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:37:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:37:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:37:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:37:45 Rebalance progress: 12.5
2021/12/24 16:37:50 Rebalance progress: 12.5
2021/12/24 16:37:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:37:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:37:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:37:55 Waiting for src bucket item count to get to: 50000 curr count: 29867
2021/12/24 16:38:00 Waiting for src bucket item count to get to: 50000 curr count: 29867
2021/12/24 16:38:05 Waiting for src bucket item count to get to: 50000 curr count: 41552
2021/12/24 16:38:10 Waiting for src bucket item count to get to: 50000 curr count: 41552
2021/12/24 16:38:20 Waiting for dst bucket item count to get to: 50000 curr count: 38121
2021/12/24 16:38:25 Waiting for dst bucket item count to get to: 50000 curr count: 38121
2021/12/24 16:38:30 Waiting for dst bucket item count to get to: 50000 curr count: 46316
2021/12/24 16:38:35 Waiting for dst bucket item count to get to: 50000 curr count: 46316
2021/12/24 16:38:35 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:38:35 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:38:40 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 16:38:45 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 16:38:50 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 16:38:55 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 16:39:00 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 16:39:00 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2021/12/24 16:39:00 No eventing-con process running
2021/12/24 16:39:00 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn deleting in background"
}
2021/12/24 16:39:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:39:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:39:12 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:39:17 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:39:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:39:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:39:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:39:29 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:39:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebIn (174.64s)
=== RUN   TestDuplicateTimerFiringEventingRebOut
2021/12/24 16:39:34 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 16:39:34 Removing node(s): [] from the cluster
2021/12/24 16:39:39 Rebalance progress: 100
2021/12/24 16:39:44 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 16:39:44 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2021/12/24 16:39:44 No eventing-con process running
2021/12/24 16:39:44 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebOut not found"
}
2021/12/24 16:39:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:39:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:39:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:39:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:39:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:39:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:40:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:40:03 Deploying app: TestDuplicateTimerFiringEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:40:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut stored in temp store"
}
2021/12/24 16:40:09 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/24 16:40:14 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/24 16:40:19 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/24 16:40:24 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/24 16:40:24 App: TestDuplicateTimerFiringEventingRebOut got deployed
2021/12/24 16:40:24 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:40:24 Starting bucket ops to source bucket
2021/12/24 16:40:29 Rebalance progress: 12.5
2021/12/24 16:40:34 Rebalance progress: 12.5
2021/12/24 16:40:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:40:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:40:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:40:39 Waiting for src bucket item count to get to: 50000 curr count: 6734
2021/12/24 16:40:44 Waiting for src bucket item count to get to: 50000 curr count: 20149
2021/12/24 16:40:49 Waiting for src bucket item count to get to: 50000 curr count: 20149
2021/12/24 16:40:54 Waiting for src bucket item count to get to: 50000 curr count: 30160
2021/12/24 16:40:59 Waiting for src bucket item count to get to: 50000 curr count: 30160
2021/12/24 16:41:04 Waiting for src bucket item count to get to: 50000 curr count: 42181
2021/12/24 16:41:09 Waiting for src bucket item count to get to: 50000 curr count: 42181
2021/12/24 16:41:14 Waiting for src bucket item count to get to: 50000 curr count: 42181
2021/12/24 16:41:24 Waiting for dst bucket item count to get to: 50000 curr count: 41524
2021/12/24 16:41:29 Waiting for dst bucket item count to get to: 50000 curr count: 41524
2021/12/24 16:41:34 Waiting for dst bucket item count to get to: 50000 curr count: 49858
2021/12/24 16:41:34 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:41:34 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:41:39 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 16:41:45 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 16:41:50 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 16:41:55 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 16:42:00 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 16:42:00 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2021/12/24 16:42:00 No eventing-con process running
2021/12/24 16:42:00 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut deleting in background"
}
2021/12/24 16:42:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:42:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:42:12 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:42:17 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:42:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:42:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:42:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:42:29 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:42:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebOut (179.63s)
=== RUN   TestDuplicateTimerFiringEventingSwapReb
2021/12/24 16:42:39 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 16:42:39 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2021/12/24 16:42:39 No eventing-con process running
2021/12/24 16:42:39 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingSwapReb not found"
}
2021/12/24 16:42:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:42:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:42:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:42:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:42:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:42:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:42:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:42:57 Deploying app: TestDuplicateTimerFiringEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:42:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb stored in temp store"
}
2021/12/24 16:43:03 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/24 16:43:08 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/24 16:43:13 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/24 16:43:18 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/24 16:43:18 App: TestDuplicateTimerFiringEventingSwapReb got deployed
2021/12/24 16:43:18 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 16:43:18 Starting bucket ops to source bucket
2021/12/24 16:43:19 Removing node(s): [] from the cluster
2021/12/24 16:43:24 Rebalance progress: 12.5
2021/12/24 16:43:29 Rebalance progress: 12.5
2021/12/24 16:43:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:43:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:43:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:43:34 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 16:43:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:43:40 Rebalance progress: 12.5
2021/12/24 16:43:45 Rebalance progress: 12.5
2021/12/24 16:43:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:43:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:43:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:43:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 16:43:55 Rebalance progress: 12.5
2021/12/24 16:44:00 Rebalance progress: 12.5
2021/12/24 16:44:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:44:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:44:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:44:05 Waiting for src bucket item count to get to: 50000 curr count: 46117
2021/12/24 16:44:10 Waiting for src bucket item count to get to: 50000 curr count: 46117
2021/12/24 16:44:20 Waiting for dst bucket item count to get to: 50000 curr count: 46676
2021/12/24 16:44:25 Waiting for dst bucket item count to get to: 50000 curr count: 46676
2021/12/24 16:44:25 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:44:25 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:44:30 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 16:44:35 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 16:44:41 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 16:44:46 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 16:44:51 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 16:44:51 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2021/12/24 16:44:51 No eventing-con process running
2021/12/24 16:44:51 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb deleting in background"
}
2021/12/24 16:44:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:44:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:45:03 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:45:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:45:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:45:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:45:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:45:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingSwapReb (165.83s)
=== RUN   TestDuplicateTimerFiringKVRebIn
2021/12/24 16:45:24 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 16:45:25 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2021/12/24 16:45:25 No eventing-con process running
2021/12/24 16:45:25 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebIn not found"
}
2021/12/24 16:45:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:45:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:45:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:45:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:45:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:45:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:45:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:45:43 Deploying app: TestDuplicateTimerFiringKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:45:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn stored in temp store"
}
2021/12/24 16:45:49 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/24 16:45:54 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/24 16:45:59 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/24 16:46:04 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/24 16:46:04 App: TestDuplicateTimerFiringKVRebIn got deployed
2021/12/24 16:46:04 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:46:04 Starting bucket ops to source bucket
2021/12/24 16:46:05 Removing node(s): [] from the cluster
2021/12/24 16:46:10 Rebalance progress: 12.5
2021/12/24 16:46:15 Rebalance progress: 12.5
2021/12/24 16:46:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:46:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:46:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:46:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:46:25 Rebalance progress: 12.5
2021/12/24 16:46:30 Rebalance progress: 12.5
2021/12/24 16:46:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:46:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:46:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:46:35 Waiting for src bucket item count to get to: 50000 curr count: 30520
2021/12/24 16:46:40 Waiting for src bucket item count to get to: 50000 curr count: 30520
2021/12/24 16:46:45 Waiting for src bucket item count to get to: 50000 curr count: 41811
2021/12/24 16:46:50 Waiting for src bucket item count to get to: 50000 curr count: 41811
2021/12/24 16:47:00 Waiting for dst bucket item count to get to: 50000 curr count: 34016
2021/12/24 16:47:05 Waiting for dst bucket item count to get to: 50000 curr count: 34016
2021/12/24 16:47:10 Waiting for dst bucket item count to get to: 50000 curr count: 44047
2021/12/24 16:47:15 Waiting for dst bucket item count to get to: 50000 curr count: 44047
2021/12/24 16:47:15 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:47:15 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:47:20 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 16:47:25 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 16:47:30 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 16:47:35 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 16:47:41 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 16:47:41 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2021/12/24 16:47:41 No eventing-con process running
2021/12/24 16:47:41 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn deleting in background"
}
2021/12/24 16:47:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:47:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:47:52 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:47:57 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:47:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:47:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:48:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:48:09 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:48:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebIn (174.69s)
=== RUN   TestDuplicateTimerFiringKVRebOut
2021/12/24 16:48:14 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:48:14 Removing node(s): [] from the cluster
2021/12/24 16:48:19 Rebalance progress: 100
2021/12/24 16:48:24 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 16:48:24 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2021/12/24 16:48:24 No eventing-con process running
2021/12/24 16:48:24 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebOut not found"
}
2021/12/24 16:48:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:48:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:48:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:48:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:48:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:48:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:48:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:48:43 Deploying app: TestDuplicateTimerFiringKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:48:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut stored in temp store"
}
2021/12/24 16:48:49 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/24 16:48:54 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/24 16:48:59 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/24 16:49:04 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/24 16:49:04 App: TestDuplicateTimerFiringKVRebOut got deployed
2021/12/24 16:49:04 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:49:04 Starting bucket ops to source bucket
2021/12/24 16:49:09 Rebalance progress: 12.5
2021/12/24 16:49:14 Rebalance progress: 12.5
2021/12/24 16:49:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:49:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:49:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:49:19 Waiting for src bucket item count to get to: 50000 curr count: 6469
2021/12/24 16:49:24 Waiting for src bucket item count to get to: 50000 curr count: 19149
2021/12/24 16:49:29 Waiting for src bucket item count to get to: 50000 curr count: 19149
2021/12/24 16:49:34 Waiting for src bucket item count to get to: 50000 curr count: 30039
2021/12/24 16:49:39 Waiting for src bucket item count to get to: 50000 curr count: 30039
2021/12/24 16:49:44 Waiting for src bucket item count to get to: 50000 curr count: 41298
2021/12/24 16:49:49 Waiting for src bucket item count to get to: 50000 curr count: 41298
2021/12/24 16:49:59 Waiting for dst bucket item count to get to: 50000 curr count: 38010
2021/12/24 16:50:04 Waiting for dst bucket item count to get to: 50000 curr count: 38010
2021/12/24 16:50:09 Waiting for dst bucket item count to get to: 50000 curr count: 38010
2021/12/24 16:50:14 Waiting for dst bucket item count to get to: 50000 curr count: 46228
2021/12/24 16:50:19 Waiting for dst bucket item count to get to: 50000 curr count: 46228
2021/12/24 16:50:19 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:50:19 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:50:24 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 16:50:29 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 16:50:35 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 16:50:40 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 16:50:45 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 16:50:50 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 16:50:50 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2021/12/24 16:50:50 No eventing-con process running
2021/12/24 16:50:50 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut deleting in background"
}
2021/12/24 16:50:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:50:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:51:02 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:51:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:51:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:51:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:51:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:51:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:51:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebOut (189.31s)
=== RUN   TestDuplicateTimerFiringKVSwapReb
2021/12/24 16:51:28 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 16:51:28 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2021/12/24 16:51:29 No eventing-con process running
2021/12/24 16:51:29 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVSwapReb not found"
}
2021/12/24 16:51:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:51:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:51:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:51:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:51:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:51:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:51:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:51:47 Deploying app: TestDuplicateTimerFiringKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:51:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb stored in temp store"
}
2021/12/24 16:51:53 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/24 16:51:58 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/24 16:52:03 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/24 16:52:08 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/24 16:52:08 App: TestDuplicateTimerFiringKVSwapReb got deployed
2021/12/24 16:52:08 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:52:08 Starting bucket ops to source bucket
2021/12/24 16:52:09 Removing node(s): [] from the cluster
2021/12/24 16:52:14 Rebalance progress: 12.5
2021/12/24 16:52:19 Rebalance progress: 12.5
2021/12/24 16:52:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:52:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:52:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:52:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 16:52:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:52:29 Rebalance progress: 12.5
2021/12/24 16:52:34 Rebalance progress: 12.5
2021/12/24 16:52:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:52:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:52:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:52:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 16:52:44 Rebalance progress: 12.5
2021/12/24 16:52:49 Rebalance progress: 12.5
2021/12/24 16:52:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:52:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:52:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:52:54 Waiting for src bucket item count to get to: 50000 curr count: 48876
2021/12/24 16:52:59 Waiting for src bucket item count to get to: 50000 curr count: 48876
2021/12/24 16:53:09 Waiting for dst bucket item count to get to: 50000 curr count: 43166
2021/12/24 16:53:14 Waiting for dst bucket item count to get to: 50000 curr count: 43166
2021/12/24 16:53:14 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 16:53:14 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 16:53:19 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 16:53:24 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 16:53:29 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 16:53:35 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 16:53:40 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 16:53:40 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2021/12/24 16:53:40 No eventing-con process running
2021/12/24 16:53:40 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb deleting in background"
}
2021/12/24 16:53:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:53:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:53:51 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:53:56 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:53:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:53:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:54:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:54:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 16:54:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVSwapReb (169.83s)
=== RUN   TestKVRebOnUpdateBucketOpOneByOne
2021/12/24 16:54:18 Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:54:18 App: bucket_op_on_update got un-deployed
2021/12/24 16:54:18 No eventing-con process running
2021/12/24 16:54:18 Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 16:54:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:54:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:54:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:54:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:54:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:54:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:54:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:54:37 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:54:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 16:54:43 Starting bucket ops to source bucket
2021/12/24 16:54:48 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 16:54:53 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 16:54:58 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 16:54:58 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:54:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:54:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:54:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:54:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 16:55:04 Rebalance progress: 12.5
2021/12/24 16:55:09 Rebalance progress: 12.5
2021/12/24 16:55:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:55:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:55:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:55:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 16:55:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 16:55:19 Rebalance progress: 12.5
2021/12/24 16:55:24 Rebalance progress: 12.5
2021/12/24 16:55:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:55:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:55:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:55:29 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/24 16:55:29 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 16:55:34 Rebalance progress: 12.5
2021/12/24 16:55:39 Rebalance progress: 12.5
2021/12/24 16:55:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:55:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:55:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:55:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 16:55:49 Rebalance progress: 12.5
2021/12/24 16:55:54 Rebalance progress: 12.5
2021/12/24 16:55:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:55:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:55:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:55:59 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 16:56:04 Rebalance progress: 12.5
2021/12/24 16:56:09 Rebalance progress: 12.5
2021/12/24 16:56:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:56:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:56:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:56:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 16:56:20 Rebalance progress: 12.5
2021/12/24 16:56:25 Rebalance progress: 12.5
2021/12/24 16:56:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:56:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:56:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:56:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:56:40 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:56:45 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:56:50 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:56:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:56:55 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 16:56:55 eventingSetup.go:46: No eventing-con process running
2021/12/24 16:56:55 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 16:56:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:57:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:57:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10650
2021/12/24 16:57:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:57:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:57:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:57:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10650
2021/12/24 16:57:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpOneByOne (190.50s)
=== RUN   TestKVForceFailover
2021/12/24 16:57:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:57:34 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 16:57:34 eventingSetup.go:46: No eventing-con process running
2021/12/24 16:57:34 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 16:57:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:57:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:57:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:57:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:57:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:57:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:57:47 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 16:57:47 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 16:57:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:57:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:57:53 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 16:57:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 16:57:54 Starting bucket ops to source bucket
2021/12/24 16:57:59 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 16:58:04 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 16:58:09 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 16:58:14 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 16:58:14 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:58:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:58:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:58:14 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2021/12/24 16:58:34 clusterSetup.go:237: Kicking off failover recovery, type: full
2021/12/24 16:58:34 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 16:58:39 Rebalance progress: 12.5
2021/12/24 16:58:44 Rebalance progress: 12.5
2021/12/24 16:58:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:58:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:58:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:58:49 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/24 16:58:54 Rebalance progress: 12.5
2021/12/24 16:58:59 Rebalance progress: 12.5
2021/12/24 16:59:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:59:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:59:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 16:59:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:59:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:59:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:59:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:59:30 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 16:59:30 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 16:59:30 eventingSetup.go:46: No eventing-con process running
2021/12/24 16:59:30 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 16:59:32 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:59:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:59:42 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7038
2021/12/24 16:59:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7038
2021/12/24 16:59:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 16:59:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 16:59:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 16:59:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7038
2021/12/24 16:59:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVForceFailover (159.53s)
=== RUN   TestKVHardFailoverRecovery
2021/12/24 17:00:08 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:00:08 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:00:08 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:00:08 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 17:00:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:00:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:00:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:00:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:00:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:00:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:00:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:00:27 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 17:00:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 17:00:33 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 17:00:38 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:00:43 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:00:48 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:00:48 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:00:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:00:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:00:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 17:00:48 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:00:53 Rebalance progress: 12.5
2021/12/24 17:00:58 Rebalance progress: 12.5
2021/12/24 17:01:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:01:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:01:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:01:03 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2021/12/24 17:02:03 clusterSetup.go:237: Kicking off failover recovery, type: full
2021/12/24 17:02:08 Rebalance progress: 12.5
2021/12/24 17:02:14 Rebalance progress: 12.5
2021/12/24 17:02:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:02:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:02:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:02:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 17:02:24 Rebalance progress: 12.5
2021/12/24 17:02:29 Rebalance progress: 12.5
2021/12/24 17:02:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:02:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:02:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:02:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:02:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:02:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:02:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:02:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:02:59 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:02:59 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:02:59 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 17:03:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:03:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:03:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11843
2021/12/24 17:03:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11843
2021/12/24 17:03:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:03:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:03:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:03:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12041
2021/12/24 17:03:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVHardFailoverRecovery (209.46s)
=== RUN   TestKVRebOnUpdateBucketOpAllAtOnce
2021/12/24 17:03:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:03:38 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:03:38 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:03:38 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 17:03:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:03:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:03:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:03:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:03:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:03:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:03:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:03:56 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 17:03:57 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 17:04:02 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 17:04:07 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:04:12 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:04:17 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:04:17 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:04:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:04:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:04:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 17:04:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 17:04:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/24 17:04:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:04:24 Rebalance progress: 12.5
2021/12/24 17:04:29 Rebalance progress: 12.5
2021/12/24 17:04:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:04:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:04:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:04:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/24 17:04:39 Rebalance progress: 12.5
2021/12/24 17:04:44 Rebalance progress: 12.5
2021/12/24 17:04:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:04:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:04:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:04:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:04:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:05:04 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:05:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:05:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:05:15 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:05:15 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:05:15 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 17:05:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:05:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:05:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4612
2021/12/24 17:05:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:05:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:05:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:05:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4612
2021/12/24 17:05:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpAllAtOnce (130.30s)
=== RUN   TestKVSwapRebOnUpdateBucketOp
2021/12/24 17:05:48 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:05:48 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:05:48 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:05:48 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 17:05:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:05:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:05:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:05:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:06:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:06:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:06:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:06:02 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 17:06:03 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 17:06:08 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 17:06:13 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:06:18 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:06:23 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:06:23 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:06:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:06:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:06:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 17:06:23 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:06:29 Rebalance progress: 12.5
2021/12/24 17:06:34 Rebalance progress: 12.5
2021/12/24 17:06:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:06:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:06:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:06:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 17:06:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 17:06:44 Rebalance progress: 12.5
2021/12/24 17:06:49 Rebalance progress: 12.5
2021/12/24 17:06:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:06:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:06:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:06:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 17:06:59 Rebalance progress: 12.5
2021/12/24 17:07:04 Rebalance progress: 12.5
2021/12/24 17:07:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:07:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:07:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:07:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:07:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:07:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:07:30 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:07:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:07:35 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:07:35 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:07:35 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 17:07:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:07:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:07:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6131
2021/12/24 17:07:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:07:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:07:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:07:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6131
2021/12/24 17:07:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:08:03 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:08:03 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:08:03 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:08:03 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 17:08:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:08:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:08:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:08:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:08:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:08:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebOnUpdateBucketOp (158.79s)
=== RUN   TestKVRebalanceWithMultipleHandlers
2021/12/24 17:08:27 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:08:27 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:08:27 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:08:27 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 17:08:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:08:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:08:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:08:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:08:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:08:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:08:45 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:08:45 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/24 17:08:45 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:08:45 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2021/12/24 17:08:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:08:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:08:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:08:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:08:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:08:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:08:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:08:59 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 17:09:00 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:09:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:09:00 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 17:09:01 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2021/12/24 17:09:06 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 17:09:11 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:09:16 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:09:21 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:09:21 clusterSetup.go:354: App: bucket_op_on_update got deployed
2021/12/24 17:09:26 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 17:09:31 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 17:09:36 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 17:09:36 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:09:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:09:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:09:37 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 17:09:37 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:09:42 Rebalance progress: 12.5
2021/12/24 17:09:47 Rebalance progress: 12.5
2021/12/24 17:09:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:09:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:09:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:09:52 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 17:09:52 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:09:57 Rebalance progress: 12.5
2021/12/24 17:10:02 Rebalance progress: 12.5
2021/12/24 17:10:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:10:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:10:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:10:07 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/24 17:10:08 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:10:13 Rebalance progress: 12.5
2021/12/24 17:10:18 Rebalance progress: 12.5
2021/12/24 17:10:23 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:10:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:10:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:10:23 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 17:10:28 Rebalance progress: 12.5
2021/12/24 17:10:33 Rebalance progress: 12.5
2021/12/24 17:10:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:10:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:10:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:10:38 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 17:10:43 Rebalance progress: 12.5
2021/12/24 17:10:48 Rebalance progress: 12.5
2021/12/24 17:10:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:10:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:10:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:10:53 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 17:10:59 Rebalance progress: 12.5
2021/12/24 17:11:04 Rebalance progress: 12.5
2021/12/24 17:11:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:11:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:11:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:11:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:11:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:11:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:11:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:11:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:11:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:11:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:11:44 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:11:44 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:11:44 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 17:11:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:11:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:11:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:11:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:12:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:12:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12207
2021/12/24 17:12:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:12:11 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:12:17 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:12:22 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:12:27 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:12:32 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:12:32 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/24 17:12:32 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:12:32 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2021/12/24 17:12:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:12:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:12:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:12:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:12:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:12:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebalanceWithMultipleHandlers (268.64s)
=== RUN   TestKVSwapRebalanceWithMultipleHandlers
2021/12/24 17:12:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:12:56 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:12:56 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:12:56 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 17:12:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:13:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:13:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:13:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:13:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:13:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:13:14 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:13:14 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/24 17:13:14 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:13:14 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2021/12/24 17:13:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:13:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:13:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:13:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:13:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:13:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:13:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:13:28 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 17:13:29 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:13:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:13:29 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 17:13:30 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2021/12/24 17:13:35 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 17:13:40 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:13:45 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:13:50 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:13:50 clusterSetup.go:354: App: bucket_op_on_update got deployed
2021/12/24 17:13:55 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 17:14:00 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 17:14:05 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 17:14:05 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:14:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:14:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:14:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 17:14:06 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:14:11 Rebalance progress: 12.5
2021/12/24 17:14:16 Rebalance progress: 12.5
2021/12/24 17:14:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:14:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:14:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:14:21 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 17:14:21 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 17:14:26 Rebalance progress: 12.5
2021/12/24 17:14:31 Rebalance progress: 12.5
2021/12/24 17:14:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:14:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:14:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:14:36 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 17:14:41 Rebalance progress: 12.5
2021/12/24 17:14:46 Rebalance progress: 12.5
2021/12/24 17:14:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:14:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:14:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:14:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:15:01 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:15:07 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:15:12 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:15:17 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:15:17 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:15:17 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:15:17 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 17:15:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:15:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:15:31 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1176
2021/12/24 17:15:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1176
2021/12/24 17:15:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:15:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:15:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:15:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7632
2021/12/24 17:15:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:15:53 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:15:58 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:16:03 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:16:08 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:16:14 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 17:16:14 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/24 17:16:14 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:16:14 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2021/12/24 17:16:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:16:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:16:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:16:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:16:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:16:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebalanceWithMultipleHandlers (221.64s)
=== RUN   TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/24 17:16:37 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:16:37 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:16:37 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:16:37 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 17:16:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:16:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:16:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:16:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:16:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:16:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:16:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:16:56 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 17:16:57 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 17:17:02 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 17:17:07 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:17:12 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:17:17 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:17:17 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:17:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:17:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:17:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 17:17:17 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:17:38 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:17:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:17:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:17:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:17:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:17:48 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:17:53 Rebalance progress: 12.5
2021/12/24 17:17:58 Rebalance progress: 12.5
2021/12/24 17:18:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:18:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:18:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:18:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 17:18:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 17:18:09 Rebalance progress: 12.5
2021/12/24 17:18:14 Rebalance progress: 12.5
2021/12/24 17:18:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:18:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:18:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:18:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 17:18:24 Rebalance progress: 12.5
2021/12/24 17:18:29 Rebalance progress: 12.5
2021/12/24 17:18:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:18:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:18:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:18:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:18:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:18:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:18:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:18:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:18:59 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:18:59 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:18:59 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 17:19:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:19:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:19:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9188
2021/12/24 17:19:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9188
2021/12/24 17:19:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:19:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:19:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:19:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9188
2021/12/24 17:19:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne (180.83s)
=== RUN   TestKVFailoverOnUpdateBucketOp
2021/12/24 17:19:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:19:38 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:19:38 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:19:38 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 17:19:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:19:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:19:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:19:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:19:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:19:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:19:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:19:57 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 17:19:58 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 17:20:03 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 17:20:08 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:20:13 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:20:18 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:20:18 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:20:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:20:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:20:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 17:20:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:20:23 Rebalance progress: 12.5
2021/12/24 17:20:28 Rebalance progress: 12.5
2021/12/24 17:20:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:20:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:20:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:20:33 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:20:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:20:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:20:43 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:20:48 Rebalance progress: 12.5
2021/12/24 17:20:53 Rebalance progress: 12.5
2021/12/24 17:20:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:20:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:20:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:20:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 17:20:59 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 17:21:04 Rebalance progress: 12.5
2021/12/24 17:21:09 Rebalance progress: 12.5
2021/12/24 17:21:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:21:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:21:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:21:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 17:21:19 Rebalance progress: 12.5
2021/12/24 17:21:24 Rebalance progress: 12.5
2021/12/24 17:21:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:21:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:21:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:21:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:21:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:21:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:21:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:21:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:21:54 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:21:54 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:21:55 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 17:21:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:22:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:22:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8612
2021/12/24 17:22:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:22:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:22:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:22:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8612
2021/12/24 17:22:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVFailoverOnUpdateBucketOp (170.07s)
=== RUN   TestBootstrapAfterKVHardFailover
2021/12/24 17:22:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 17:22:23 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 17:22:28 Rebalance progress: 100
2021/12/24 17:22:28 Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:22:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:22:59 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 17:23:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 17:23:05 Removing node(s): [] from the cluster
2021/12/24 17:23:05 Starting bucket ops to source bucket
2021/12/24 17:23:10 Rebalance failed. See logs for detailed reason. You can try again.
2021/12/24 17:23:15 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:23:20 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 17:23:20 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:23:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:23:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 17:23:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:23:30 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:23:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:23:40 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:23:46 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 17:23:46 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 17:23:46 eventingSetup.go:46: No eventing-con process running
2021/12/24 17:23:46 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 17:23:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:23:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:23:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1509
2021/12/24 17:23:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 17:23:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 17:24:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 17:24:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1509
2021/12/24 17:24:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBootstrapAfterKVHardFailover (111.06s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	11957.501s

Rebalance tests took 3 hours, 19 minutes and 19 seconds.

Testing Succeeded


Version: versions-24.12.2021-09.48.cfg
Build Log: make-24.12.2021-09.48.log
Server Log: logs-24.12.2021-09.48.tar.gz

Finished