Building

Started building at 2021/12/22 11:50:16
Calculating base
Updating mirror
Basing run on 7.1.0-1965 034b5ef43
Updating tree for run 22.12.2021-11.50
gocb is at 635fa6c, changes since last good build: none
libcouchbase is at f6822fc, changes since last good build: none
indexing is at 07fafb9, changes since last good build: 
 07fafb93 Merge remote-tracking branch 'couchbase/unstable' into HEAD
 dfed9f77 MB-50165 Do not force snapshot if initFlushTs is greater than mergeTs
 e01dcd7b MB-50143 Clear event manager book-keeping on notifications
 b8ab9263 MB-50143 Log more information when calls to ns_server fails
 451687a1 MB-47254 (7.1.0 1910) Avoid log flooding from watcherServer connect fail
 1a8c34a0 Merge remote-tracking branch 'couchbase/unstable' into HEAD
 7d0d14c7 MB-31421: Implement indexer queryport auth
 6ae7c4ce MB-43886 : Add ability to hot swap from cinfo to cinfo lite
 1fe9f393 MB-43886 : Integrate ClusterInfoProvider into Projector and LifeCycleMgr
 ccffe8f3 MB-43886 : Add ClusterInfoProvider Interface
 bcfff5cd Merge remote-tracking branch 'couchbase/unstable' into master
 d1864d3a MB-48897: Add plasma zstd directories to cmake file
 c6652ed1 MB-48897: Change default in-memory compression to zstd
 eb7756ac MB-48897: Add plasma zstd unit tests to CI
 51de785a MB-100 Remove analytics service from building
 e08c9d6f MB-50008 Log OSO HWT for pending builds
kv_engine is at cda4535, changes since last good build: 
 cda4535d8 MB-50169: Remove invalid Expects in PDM
 05a967e46 MB-49767: Add extra logging and expects to ADM::ctor(PDM)
 8617c6b7e audit_generator: Check for file and throw exception if it isn't there
 f2ffdf8e5 MB-35297: Remove unnecessary virtual inheritance in DCPBackfillBySeqno
 eab6f4c6e MB-35297: Refactor: Move getValueFilter(ActiveStream&) to ActiveStream
 2d43de249 Use cb::io::loadFile in audit load file
 746f92ba4 MB-50146: Don't read value from disk for CommitSyncWrite at backfill
 6dc6e0e4b MB-49858: Add bloom_filter_memory stat
 abc2f16b7 MB-50110: Set log-level DEBUG in ClosedUnrefCheckpointRemoverTask
 5bd0bccf9 MB-48531: PagingVisitor doesn't attempt to remove checkpoints
 742ee4164 MB-49727: Remove PagingVisitor::numEjected()
 3254d7231 MB-49727: Remove KVBucket::processExpiredItems
 7d9c00715 MB-47604: Support concurrent flush and compaction in Nexus
 a47dbbeff MB-41323: Compaction throttle: snooze waiting tasks forever
 e823748d0 MB-49156: RAII cookie reserving in ConnHandler
ns_server is at 0fce4a5, changes since last good build: 
 0fce4a516 MB-49595 refresh cbauth if manifest id on at least of one bucket
 cbcc985c4 Move some mochiweb_response:write_chunk calls to menelaus_util:write_chunk
 fcd061bd1 Fix indentation of readded code
 65bdb4aab Merge remote-tracking branch 'couchbase/cheshire-cat'
 09688e755 MB-49765 Remove backward compatibility support
 ae5db4503 MB-49765 Remove unneeded dist_manager migration code
 cb31bc2c5 MB-49765 Remove support for no address family
 713fcf723 MB-49765 Remove ns_config support for pre-6.5 releases
 308b1ebbd MB-49765 Remove backward compatibility support
 abce0aaa4 MB-50153: Merge remote-tracking branch 'couchbase/mad-hatter'
 5084c4509 MB-50153: Fix crash when secure_headers is missing
 f25311e4d MB-50160: call setAngularJSGlobal(angular) after @angular/upgrade/static
 aff6dd698 stop returning version from prepare_rebalance
 6b1291cb7 prepare_nodes_for_rebalance doesn't need to return versions anymore
 c3dd75fa5 Merge "Merge remote-tracking branch 'couchbase/cheshire-cat'"
 92891532c MB-49918: Refactor mn_logs_controller.js to Angular
 a5dbee163 MB-49821: Handle 'sampleBuckets/install' error as string or array
 7b2005826 Merge remote-tracking branch 'couchbase/cheshire-cat'
 a976afbbd MB-49255: Merge remote-tracking branch 'couchbase/mad-hatter'
 65c144ebc MB-49255: recognize nodes with ssl_rest_port
couchstore is at 0bf3a4b, changes since last good build: 
 0bf3a4b MB-49819: Dump JSON as ASCII & escape any UNICODE chars
 8a13cc7 MB-49817: Fix regression of doc id printing under --json
 21a382b MB-49817: Ensure --json outputs valid json
couchdb is at fca2e6b, changes since last good build: none
testrunner is at 9c4b191, changes since last good build: 
 9c4b1913e uncommenting oso tests based on MB-49153
 800127393 Fixed the merge issue with test reports
 0d5c6dec8 Add tc for udf with search query
 c9646c916 changes to run java sdk client with tls
 87ad81284 more UDF testing.
 44bb3377e Added new tests for GSI System Events
 5016f88f4 MB-45242 update skip count test case
 03efd4533 MB-49860 add test case for gt 10 terms
 72a67ef6f changes for get bucket items count for tls
 9d8de39be CBQE-7386: Add new merge validation for backup tests
 dfbad2b14 CBQE-7380: Add improvements for x509 TLS testing
 59c7539b7 CBQE-7383: Fix GCP delete with prefix
 2166f5c4e TLS Fix
Switching eventing to unstable
eventing is at d9c8767, changes since last good build: none
Switching eventing-ee to unstable
eventing-ee is at 3f826e0, changes since last good build: none
Pulling in uncommitted change 160397 at refs/changes/97/160397/3
Total 23 (delta 15), reused 17 (delta 15)
[unstable ab29827f] MB-100 : Do not fail n1ql timeout test if we are catching timeout exceptions successfully
 Author: abhijpes 
 Date: Mon Aug 30 08:24:38 2021 +0530
 1 file changed, 2 insertions(+), 2 deletions(-)
Pulling in uncommitted change 163449 at refs/changes/49/163449/1
Total 48 (delta 27), reused 39 (delta 27)
[unstable 930600d0] MB-100: collect data when test fails
 Author: AnkitPrabhu 
 Date: Tue Oct 12 14:02:31 2021 +0530
 1 file changed, 2 insertions(+)
Pulling in uncommitted change 165806 at refs/changes/06/165806/42
Total 34 (delta 25), reused 34 (delta 25)
[unstable 950c49ec] MB-48538: Audit log refactor
 Author: AnkitPrabhu 
 Date: Mon Dec 13 10:30:25 2021 +0530
 18 files changed, 3165 insertions(+), 2213 deletions(-)
 create mode 100644 service_manager/response/defs.go
 create mode 100644 service_manager/response/response.go
Pulling in uncommitted change 165976 at refs/changes/76/165976/19
[unstable 06be6051] MB-48538: Add new audit ids for different events
 Author: AnkitPrabhu 
 Date: Tue Nov 23 14:29:10 2021 +0530
 1 file changed, 337 insertions(+), 61 deletions(-)
Pulling in uncommitted change 166698 at refs/changes/98/166698/3
Total 4 (delta 3), reused 4 (delta 3)
[unstable ecc0fadf] MB-48334 : Fail rebalance unless all functions deployed on current encryption level
 Author: abhijpes 
 Date: Wed Dec 1 14:51:29 2021 +0530
 1 file changed, 9 insertions(+)
Pulling in uncommitted change 167982 at refs/changes/82/167982/2
Total 42 (delta 32), reused 42 (delta 32)
[unstable 06644a64] MB-50179: Use vbucket forward map for master node calculation during vbucket movement
 Author: AnkitPrabhu 
 Date: Tue Dec 21 13:32:56 2021 +0530
 3 files changed, 31 insertions(+), 27 deletions(-)
Pulling in uncommitted change 167820 at refs/changes/20/167820/17
Total 27 (delta 13), reused 27 (delta 13)
[unstable 6fe6dd6] MB-49127 : js-evaluator RBAC
 Author: abhijpes 
 Date: Fri Dec 17 13:56:53 2021 +0530
 14 files changed, 661 insertions(+), 256 deletions(-)
 create mode 100644 evaluator/common/common.go
 create mode 100644 evaluator/rbac/rbac.go
 create mode 100644 evaluator/utils/service_mgr.go
Building cmakefiles and deps
Building main product

Testing

Started testing at 2021/12/22 12:05:53
Testing mode: rebalance,n1ql,functional
Starting server
Starting server: attempt 1

Functional tests

2021/12/22 12:07:25 Started functional
Post "http://127.0.0.1:9000/pools/default": EOF
Quota setup Post "http://127.0.0.1:9000/pools/default": EOF
2021/12/22 12:07:33 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/22 12:07:39 Error in adding nodes : , response: {"otpNode":"n_1@127.0.0.1"}
2021/12/22 12:07:39 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 12:07:44 Removing node(s): [] from the cluster
2021/12/22 12:07:49 Rebalance progress: 0
2021/12/22 12:07:54 Rebalance progress: 1.283998842592593
2021/12/22 12:07:59 Rebalance progress: 5.985966435185184
2021/12/22 12:08:04 Rebalance progress: 9.403935185185185
2021/12/22 12:08:09 Rebalance progress: 13.90697337962963
2021/12/22 12:08:14 Rebalance progress: 18.51851851851852
2021/12/22 12:08:19 Rebalance progress: 21.99074074074074
2021/12/22 12:08:24 Rebalance progress: 26.63845486111111
2021/12/22 12:08:29 Rebalance progress: 100
=== RUN   TestAdvancedGetOps
2021/12/22 12:08:35 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:08:50 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:09:05 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:09:20 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:09:35 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:09:50 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:10:05 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:10:20 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:10:35 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:10:50 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:11:05 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:11:20 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:11:35 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:11:50 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:12:05 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:12:20 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:12:35 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:12:50 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:13:05 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:13:20 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:13:35 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:13:50 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/22 12:14:05 Deploying app: TestAdvancedGetOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:14:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps stored in temp store"
}
2021/12/22 12:14:11 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/22 12:14:16 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/22 12:14:21 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/22 12:14:26 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/22 12:14:26 App: TestAdvancedGetOps got deployed
2021/12/22 12:14:26 Starting bucket ops to source bucket
2021/12/22 12:14:32 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 12:14:32 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 12:14:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:14:32 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:14:37 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/22 12:14:42 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/22 12:14:47 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/22 12:14:52 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/22 12:14:52 App: TestAdvancedGetOps got un-deployed
2021/12/22 12:14:52 No eventing-con process running
2021/12/22 12:14:52 Function: TestAdvancedGetOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps deleting in background"
}
2021/12/22 12:14:53 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:15:04 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:15:09 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 12:15:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:15:10 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:15:20 Waiting for dst bucket item count to get to: 0 curr count: 74
2021/12/22 12:15:25 Waiting for dst bucket item count to get to: 0 curr count: 74
2021/12/22 12:15:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedGetOps (410.13s)
=== RUN   TestAdvancedInsertOps
2021/12/22 12:15:25 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:15:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2021/12/22 12:15:31 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/22 12:15:36 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/22 12:15:41 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/22 12:15:46 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/22 12:15:46 App: TestAdvancedInsertOps got deployed
2021/12/22 12:15:46 Starting bucket ops to source bucket
2021/12/22 12:15:52 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/22 12:15:57 Waiting for dst bucket item count to get to: 1024 curr count: 906
2021/12/22 12:16:02 Waiting for dst bucket item count to get to: 1024 curr count: 906
2021/12/22 12:16:02 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/22 12:16:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:16:02 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:16:08 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/22 12:16:13 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/22 12:16:18 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/22 12:16:23 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/22 12:16:23 App: TestAdvancedInsertOps got un-deployed
2021/12/22 12:16:23 No eventing-con process running
2021/12/22 12:16:23 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2021/12/22 12:16:24 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:16:34 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/22 12:16:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:16:36 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:16:46 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/22 12:16:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:16:46 Testing insert operation on source bucket
2021/12/22 12:16:46 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:16:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2021/12/22 12:16:52 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/22 12:16:57 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/22 12:17:02 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/22 12:17:07 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/22 12:17:07 App: TestAdvancedInsertOps got deployed
2021/12/22 12:17:07 Starting bucket ops to source bucket
2021/12/22 12:17:13 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/22 12:17:18 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/22 12:17:23 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/22 12:17:23 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/22 12:17:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:17:23 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:17:28 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/22 12:17:34 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/22 12:17:39 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/22 12:17:44 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/22 12:17:44 App: TestAdvancedInsertOps got un-deployed
2021/12/22 12:17:44 No eventing-con process running
2021/12/22 12:17:44 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2021/12/22 12:17:45 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:17:55 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/22 12:17:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:17:57 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:18:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertOps (156.78s)
=== RUN   TestAdvancedUpsertOps
2021/12/22 12:18:02 Starting bucket ops to source bucket
2021/12/22 12:18:03 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:18:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2021/12/22 12:18:09 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/22 12:18:14 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/22 12:18:19 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/22 12:18:24 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/22 12:18:24 App: TestAdvancedUpsertOps got deployed
2021/12/22 12:18:24 Starting bucket ops to source bucket
2021/12/22 12:18:30 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/22 12:18:35 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/22 12:18:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:18:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:18:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:18:40 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/22 12:18:45 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/22 12:18:50 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/22 12:18:55 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/22 12:18:55 App: TestAdvancedUpsertOps got un-deployed
2021/12/22 12:18:55 No eventing-con process running
2021/12/22 12:18:55 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2021/12/22 12:18:57 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:19:07 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/22 12:19:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:19:08 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:19:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:19:13 Testing upsert operation on source bucket
2021/12/22 12:19:13 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:19:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2021/12/22 12:19:20 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/22 12:19:25 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/22 12:19:30 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/22 12:19:35 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/22 12:19:35 App: TestAdvancedUpsertOps got deployed
2021/12/22 12:19:35 Starting bucket ops to source bucket
2021/12/22 12:19:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:19:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:19:36 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:19:41 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/22 12:19:46 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/22 12:19:51 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/22 12:19:56 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/22 12:19:56 App: TestAdvancedUpsertOps got un-deployed
2021/12/22 12:19:56 No eventing-con process running
2021/12/22 12:19:56 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2021/12/22 12:19:58 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:20:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:20:05 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:20:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedUpsertOps (127.85s)
=== RUN   TestAdvancedReplaceOps
2021/12/22 12:20:10 Starting bucket ops to source bucket
2021/12/22 12:20:11 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:20:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2021/12/22 12:20:17 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/22 12:20:22 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/22 12:20:27 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/22 12:20:32 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/22 12:20:32 App: TestAdvancedReplaceOps got deployed
2021/12/22 12:20:32 Starting bucket ops to source bucket
2021/12/22 12:20:38 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/22 12:20:43 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/22 12:20:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:20:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:20:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:20:48 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/22 12:20:53 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/22 12:20:58 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/22 12:21:03 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/22 12:21:03 App: TestAdvancedReplaceOps got un-deployed
2021/12/22 12:21:03 No eventing-con process running
2021/12/22 12:21:03 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2021/12/22 12:21:05 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:21:15 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/22 12:21:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:21:17 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:21:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:21:22 Testing upsert operation on source bucket
2021/12/22 12:21:22 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:21:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2021/12/22 12:21:28 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/22 12:21:33 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/22 12:21:38 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/22 12:21:43 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/22 12:21:43 App: TestAdvancedReplaceOps got deployed
2021/12/22 12:21:43 Starting bucket ops to source bucket
2021/12/22 12:21:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:21:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:21:44 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:21:49 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/22 12:21:54 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/22 12:21:59 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/22 12:22:04 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/22 12:22:04 App: TestAdvancedReplaceOps got un-deployed
2021/12/22 12:22:04 No eventing-con process running
2021/12/22 12:22:04 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2021/12/22 12:22:06 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:22:16 Waiting for dst bucket item count to get to: 0 curr count: 291
2021/12/22 12:22:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:22:18 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:22:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedReplaceOps (132.72s)
=== RUN   TestAdvancedDeleteOps
2021/12/22 12:22:23 Starting bucket ops to source bucket
2021/12/22 12:22:23 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:22:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2021/12/22 12:22:29 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/22 12:22:34 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/22 12:22:39 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/22 12:22:44 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/22 12:22:44 App: TestAdvancedDeleteOps got deployed
2021/12/22 12:22:44 Starting bucket ops to source bucket
2021/12/22 12:22:49 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:22:54 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 12:22:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:22:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:22:54 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:22:59 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/22 12:23:04 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/22 12:23:09 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/22 12:23:14 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/22 12:23:14 App: TestAdvancedDeleteOps got un-deployed
2021/12/22 12:23:14 No eventing-con process running
2021/12/22 12:23:14 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2021/12/22 12:23:16 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:23:26 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:23:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:23:28 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:23:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:23:33 Testing delete operation on source bucket
2021/12/22 12:23:33 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:23:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2021/12/22 12:23:39 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/22 12:23:44 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/22 12:23:49 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/22 12:23:54 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/22 12:23:54 App: TestAdvancedDeleteOps got deployed
2021/12/22 12:23:54 Starting bucket ops to source bucket
2021/12/22 12:23:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:23:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:23:54 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:23:59 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/22 12:24:04 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/22 12:24:09 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/22 12:24:14 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/22 12:24:14 App: TestAdvancedDeleteOps got un-deployed
2021/12/22 12:24:14 No eventing-con process running
2021/12/22 12:24:14 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2021/12/22 12:24:16 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:24:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:24:23 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:24:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedDeleteOps (125.64s)
=== RUN   TestEnoentAdvancedGet
2021/12/22 12:24:28 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:24:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2021/12/22 12:24:34 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/22 12:24:39 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/22 12:24:44 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/22 12:24:49 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/22 12:24:49 App: TestEnoentAdvancedGet got deployed
2021/12/22 12:24:49 Starting bucket ops to source bucket
2021/12/22 12:24:55 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 12:25:00 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 12:25:05 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/22 12:25:05 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 12:25:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:25:05 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:25:10 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/22 12:25:15 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/22 12:25:20 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/22 12:25:25 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/22 12:25:25 App: TestEnoentAdvancedGet got un-deployed
2021/12/22 12:25:25 No eventing-con process running
2021/12/22 12:25:25 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2021/12/22 12:25:26 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:25:36 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:25:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:25:38 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:25:48 Waiting for dst bucket item count to get to: 0 curr count: 78
2021/12/22 12:25:53 Waiting for dst bucket item count to get to: 0 curr count: 28
2021/12/22 12:25:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:25:53 Testing get enoent operation on source bucket
2021/12/22 12:25:53 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:25:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2021/12/22 12:25:59 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/22 12:26:05 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/22 12:26:10 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/22 12:26:15 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/22 12:26:15 App: TestEnoentAdvancedGet got deployed
2021/12/22 12:26:15 Starting bucket ops to source bucket
2021/12/22 12:26:20 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/22 12:26:25 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/22 12:26:25 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/22 12:26:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:26:25 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:26:30 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/22 12:26:35 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/22 12:26:40 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/22 12:26:45 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/22 12:26:45 App: TestEnoentAdvancedGet got un-deployed
2021/12/22 12:26:45 No eventing-con process running
2021/12/22 12:26:45 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2021/12/22 12:26:47 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:26:57 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/22 12:26:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:26:58 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:27:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedGet (155.05s)
=== RUN   TestEnoentAdvancedReplace
2021/12/22 12:27:03 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:27:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2021/12/22 12:27:09 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/22 12:27:14 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/22 12:27:19 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/22 12:27:24 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/22 12:27:24 App: TestEnoentAdvancedReplace got deployed
2021/12/22 12:27:24 Starting bucket ops to source bucket
2021/12/22 12:27:30 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 12:27:35 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/22 12:27:35 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 12:27:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:27:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:27:40 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/22 12:27:45 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/22 12:27:50 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/22 12:27:55 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/22 12:27:55 App: TestEnoentAdvancedReplace got un-deployed
2021/12/22 12:27:55 No eventing-con process running
2021/12/22 12:27:55 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2021/12/22 12:27:56 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:28:06 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:28:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:28:08 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:28:18 Waiting for dst bucket item count to get to: 0 curr count: 78
2021/12/22 12:28:23 Waiting for dst bucket item count to get to: 0 curr count: 28
2021/12/22 12:28:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:28:23 Testing get enoent operation on source bucket
2021/12/22 12:28:23 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:28:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2021/12/22 12:28:30 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/22 12:28:35 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/22 12:28:40 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/22 12:28:45 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/22 12:28:45 App: TestEnoentAdvancedReplace got deployed
2021/12/22 12:28:45 Starting bucket ops to source bucket
2021/12/22 12:28:50 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/22 12:28:55 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/22 12:28:55 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/22 12:28:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:28:55 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:29:00 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/22 12:29:05 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/22 12:29:10 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/22 12:29:15 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/22 12:29:15 App: TestEnoentAdvancedReplace got un-deployed
2021/12/22 12:29:15 No eventing-con process running
2021/12/22 12:29:15 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2021/12/22 12:29:17 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:29:27 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/22 12:29:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:29:28 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:29:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedReplace (150.08s)
=== RUN   TestEnoentAdvancedDelete
2021/12/22 12:29:33 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:29:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2021/12/22 12:29:40 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/22 12:29:45 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/22 12:29:50 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/22 12:29:55 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/22 12:29:55 App: TestEnoentAdvancedDelete got deployed
2021/12/22 12:29:55 Starting bucket ops to source bucket
2021/12/22 12:30:00 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 12:30:05 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/22 12:30:05 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 12:30:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:30:05 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:30:10 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/22 12:30:15 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/22 12:30:20 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/22 12:30:25 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/22 12:30:25 App: TestEnoentAdvancedDelete got un-deployed
2021/12/22 12:30:25 No eventing-con process running
2021/12/22 12:30:25 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2021/12/22 12:30:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:30:37 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:30:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:30:38 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:30:48 Waiting for dst bucket item count to get to: 0 curr count: 80
2021/12/22 12:30:53 Waiting for dst bucket item count to get to: 0 curr count: 30
2021/12/22 12:30:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:30:53 Testing get enoent operation on source bucket
2021/12/22 12:30:53 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:30:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2021/12/22 12:30:59 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/22 12:31:05 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/22 12:31:10 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/22 12:31:15 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/22 12:31:15 App: TestEnoentAdvancedDelete got deployed
2021/12/22 12:31:15 Starting bucket ops to source bucket
2021/12/22 12:31:20 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/22 12:31:25 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/22 12:31:25 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/22 12:31:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:31:25 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:31:30 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/22 12:31:35 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/22 12:31:40 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/22 12:31:45 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/22 12:31:45 App: TestEnoentAdvancedDelete got un-deployed
2021/12/22 12:31:45 No eventing-con process running
2021/12/22 12:31:45 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2021/12/22 12:31:47 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:31:57 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/22 12:31:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:31:58 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:32:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedDelete (149.92s)
=== RUN   TestAdvancedInsertKeyExist
2021/12/22 12:32:03 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:32:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2021/12/22 12:32:10 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/22 12:32:15 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/22 12:32:20 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/22 12:32:25 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/22 12:32:25 App: TestAdvancedInsertKeyExist got deployed
2021/12/22 12:32:25 Starting bucket ops to source bucket
2021/12/22 12:32:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:32:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:32:25 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:32:30 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/22 12:32:35 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/22 12:32:40 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/22 12:32:45 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/22 12:32:45 App: TestAdvancedInsertKeyExist got un-deployed
2021/12/22 12:32:45 No eventing-con process running
2021/12/22 12:32:45 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2021/12/22 12:32:47 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:32:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:32:54 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:32:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:32:59 Pumping document in the destination bucket
2021/12/22 12:32:59 Starting bucket ops to source bucket
2021/12/22 12:32:59 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:33:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2021/12/22 12:33:05 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/22 12:33:10 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/22 12:33:15 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/22 12:33:20 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/22 12:33:20 App: TestAdvancedInsertKeyExist got deployed
2021/12/22 12:33:20 Starting bucket ops to source bucket
2021/12/22 12:33:25 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:33:30 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:33:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:33:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:33:30 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:33:36 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/22 12:33:41 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/22 12:33:46 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/22 12:33:51 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/22 12:33:51 App: TestAdvancedInsertKeyExist got un-deployed
2021/12/22 12:33:51 No eventing-con process running
2021/12/22 12:33:51 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2021/12/22 12:33:52 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:34:02 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:34:07 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 12:34:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:34:09 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:34:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertKeyExist (130.87s)
=== RUN   TestExipryGet
2021/12/22 12:34:14 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:34:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2021/12/22 12:34:20 Waiting for app: TestExipryGet to get deployed
2021/12/22 12:34:25 Waiting for app: TestExipryGet to get deployed
2021/12/22 12:34:30 Waiting for app: TestExipryGet to get deployed
2021/12/22 12:34:35 Waiting for app: TestExipryGet to get deployed
2021/12/22 12:34:35 App: TestExipryGet got deployed
2021/12/22 12:34:35 Starting bucket ops to source bucket
2021/12/22 12:35:21 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:35:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:35:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:35:21 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:35:26 Waiting for app: TestExipryGet to get un-deployed
2021/12/22 12:35:31 Waiting for app: TestExipryGet to get un-deployed
2021/12/22 12:35:36 Waiting for app: TestExipryGet to get un-deployed
2021/12/22 12:35:41 Waiting for app: TestExipryGet to get un-deployed
2021/12/22 12:35:41 App: TestExipryGet got un-deployed
2021/12/22 12:35:41 No eventing-con process running
2021/12/22 12:35:41 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2021/12/22 12:35:43 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:35:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:35:50 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:35:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:35:55 Pumping document in the destination bucket for expiry get
2021/12/22 12:35:55 Starting bucket ops to source bucket
2021/12/22 12:35:55 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:35:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2021/12/22 12:36:01 Waiting for app: TestExipryGet to get deployed
2021/12/22 12:36:06 Waiting for app: TestExipryGet to get deployed
2021/12/22 12:36:11 Waiting for app: TestExipryGet to get deployed
2021/12/22 12:36:16 Waiting for app: TestExipryGet to get deployed
2021/12/22 12:36:16 App: TestExipryGet got deployed
2021/12/22 12:36:16 Starting bucket ops to source bucket
2021/12/22 12:37:01 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:37:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:37:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:37:01 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:37:06 Waiting for app: TestExipryGet to get un-deployed
2021/12/22 12:37:12 Waiting for app: TestExipryGet to get un-deployed
2021/12/22 12:37:17 Waiting for app: TestExipryGet to get un-deployed
2021/12/22 12:37:22 Waiting for app: TestExipryGet to get un-deployed
2021/12/22 12:37:22 App: TestExipryGet got un-deployed
2021/12/22 12:37:22 No eventing-con process running
2021/12/22 12:37:22 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2021/12/22 12:37:23 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:37:33 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:37:38 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 12:37:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:37:40 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:37:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryGet (210.87s)
=== RUN   TestExipryInsert
2021/12/22 12:37:45 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:37:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2021/12/22 12:37:51 Waiting for app: TestExipryInsert to get deployed
2021/12/22 12:37:56 Waiting for app: TestExipryInsert to get deployed
2021/12/22 12:38:01 Waiting for app: TestExipryInsert to get deployed
2021/12/22 12:38:06 Waiting for app: TestExipryInsert to get deployed
2021/12/22 12:38:06 App: TestExipryInsert got deployed
2021/12/22 12:38:06 Starting bucket ops to source bucket
2021/12/22 12:38:52 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/22 12:38:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:38:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:38:52 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:38:57 Waiting for app: TestExipryInsert to get un-deployed
2021/12/22 12:39:02 Waiting for app: TestExipryInsert to get un-deployed
2021/12/22 12:39:07 Waiting for app: TestExipryInsert to get un-deployed
2021/12/22 12:39:12 Waiting for app: TestExipryInsert to get un-deployed
2021/12/22 12:39:12 App: TestExipryInsert got un-deployed
2021/12/22 12:39:12 No eventing-con process running
2021/12/22 12:39:12 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2021/12/22 12:39:13 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:39:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:39:21 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:39:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:39:26 Testing on the destination bucket for expiry insert
2021/12/22 12:39:26 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:39:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2021/12/22 12:39:32 Waiting for app: TestExipryInsert to get deployed
2021/12/22 12:39:37 Waiting for app: TestExipryInsert to get deployed
2021/12/22 12:39:42 Waiting for app: TestExipryInsert to get deployed
2021/12/22 12:39:47 Waiting for app: TestExipryInsert to get deployed
2021/12/22 12:39:47 App: TestExipryInsert got deployed
2021/12/22 12:39:47 Starting bucket ops to source bucket
2021/12/22 12:40:32 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:40:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:40:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:40:32 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:40:37 Waiting for app: TestExipryInsert to get un-deployed
2021/12/22 12:40:42 Waiting for app: TestExipryInsert to get un-deployed
2021/12/22 12:40:47 Waiting for app: TestExipryInsert to get un-deployed
2021/12/22 12:40:52 Waiting for app: TestExipryInsert to get un-deployed
2021/12/22 12:40:52 App: TestExipryInsert got un-deployed
2021/12/22 12:40:52 No eventing-con process running
2021/12/22 12:40:52 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2021/12/22 12:40:54 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:41:04 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:41:09 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 12:41:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:41:11 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:41:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryInsert (210.63s)
=== RUN   TestExipryReplace
2021/12/22 12:41:16 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:41:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2021/12/22 12:41:22 Waiting for app: TestExipryReplace to get deployed
2021/12/22 12:41:27 Waiting for app: TestExipryReplace to get deployed
2021/12/22 12:41:32 Waiting for app: TestExipryReplace to get deployed
2021/12/22 12:41:37 Waiting for app: TestExipryReplace to get deployed
2021/12/22 12:41:37 App: TestExipryReplace got deployed
2021/12/22 12:41:37 Starting bucket ops to source bucket
2021/12/22 12:42:22 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:42:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:42:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:42:22 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:42:27 Waiting for app: TestExipryReplace to get un-deployed
2021/12/22 12:42:32 Waiting for app: TestExipryReplace to get un-deployed
2021/12/22 12:42:37 Waiting for app: TestExipryReplace to get un-deployed
2021/12/22 12:42:42 Waiting for app: TestExipryReplace to get un-deployed
2021/12/22 12:42:42 App: TestExipryReplace got un-deployed
2021/12/22 12:42:42 No eventing-con process running
2021/12/22 12:42:42 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2021/12/22 12:42:44 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:42:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:42:51 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:42:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:42:56 Testing on the destination bucket for expiry insert
2021/12/22 12:42:56 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:42:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2021/12/22 12:43:02 Waiting for app: TestExipryReplace to get deployed
2021/12/22 12:43:07 Waiting for app: TestExipryReplace to get deployed
2021/12/22 12:43:12 Waiting for app: TestExipryReplace to get deployed
2021/12/22 12:43:17 Waiting for app: TestExipryReplace to get deployed
2021/12/22 12:43:17 App: TestExipryReplace got deployed
2021/12/22 12:43:17 Starting bucket ops to source bucket
2021/12/22 12:44:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:44:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 12:44:13 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 12:44:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:44:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:44:13 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:44:18 Waiting for app: TestExipryReplace to get un-deployed
2021/12/22 12:44:23 Waiting for app: TestExipryReplace to get un-deployed
2021/12/22 12:44:28 Waiting for app: TestExipryReplace to get un-deployed
2021/12/22 12:44:33 Waiting for app: TestExipryReplace to get un-deployed
2021/12/22 12:44:33 App: TestExipryReplace got un-deployed
2021/12/22 12:44:33 No eventing-con process running
2021/12/22 12:44:33 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2021/12/22 12:44:35 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:44:45 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:44:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:44:46 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:44:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryReplace (215.59s)
=== RUN   TestExipryUpsert
2021/12/22 12:44:51 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:44:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2021/12/22 12:44:57 Waiting for app: TestExipryUpsert to get deployed
2021/12/22 12:45:03 Waiting for app: TestExipryUpsert to get deployed
2021/12/22 12:45:08 Waiting for app: TestExipryUpsert to get deployed
2021/12/22 12:45:13 Waiting for app: TestExipryUpsert to get deployed
2021/12/22 12:45:13 App: TestExipryUpsert got deployed
2021/12/22 12:45:13 Starting bucket ops to source bucket
2021/12/22 12:45:58 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:46:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:46:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:46:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:46:03 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:46:08 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/22 12:46:13 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/22 12:46:18 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/22 12:46:23 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/22 12:46:23 App: TestExipryUpsert got un-deployed
2021/12/22 12:46:23 No eventing-con process running
2021/12/22 12:46:23 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2021/12/22 12:46:25 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:46:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:46:32 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:46:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:46:37 Testing on the destination bucket for expiry insert
2021/12/22 12:46:37 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:46:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2021/12/22 12:46:43 Waiting for app: TestExipryUpsert to get deployed
2021/12/22 12:46:48 Waiting for app: TestExipryUpsert to get deployed
2021/12/22 12:46:53 Waiting for app: TestExipryUpsert to get deployed
2021/12/22 12:46:58 Waiting for app: TestExipryUpsert to get deployed
2021/12/22 12:46:58 App: TestExipryUpsert got deployed
2021/12/22 12:46:58 Starting bucket ops to source bucket
2021/12/22 12:47:43 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:47:48 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 12:47:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:47:48 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:47:48 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:47:53 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/22 12:47:58 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/22 12:48:03 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/22 12:48:08 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/22 12:48:08 App: TestExipryUpsert got un-deployed
2021/12/22 12:48:08 No eventing-con process running
2021/12/22 12:48:08 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2021/12/22 12:48:10 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:48:20 Waiting for dst bucket item count to get to: 0 curr count: 65
2021/12/22 12:48:25 Waiting for dst bucket item count to get to: 0 curr count: 65
2021/12/22 12:48:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:48:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:48:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryUpsert (220.58s)
=== RUN   TestCasReplace
2021/12/22 12:48:32 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:48:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2021/12/22 12:48:38 Waiting for app: TestCasReplace to get deployed
2021/12/22 12:48:43 Waiting for app: TestCasReplace to get deployed
2021/12/22 12:48:48 Waiting for app: TestCasReplace to get deployed
2021/12/22 12:48:53 Waiting for app: TestCasReplace to get deployed
2021/12/22 12:48:53 App: TestCasReplace got deployed
2021/12/22 12:48:53 Starting bucket ops to source bucket
2021/12/22 12:48:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:48:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:48:53 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:48:59 Waiting for app: TestCasReplace to get un-deployed
2021/12/22 12:49:04 Waiting for app: TestCasReplace to get un-deployed
2021/12/22 12:49:09 Waiting for app: TestCasReplace to get un-deployed
2021/12/22 12:49:14 Waiting for app: TestCasReplace to get un-deployed
2021/12/22 12:49:14 App: TestCasReplace got un-deployed
2021/12/22 12:49:14 No eventing-con process running
2021/12/22 12:49:14 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2021/12/22 12:49:15 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:49:25 Waiting for dst bucket item count to get to: 0 curr count: 3
2021/12/22 12:49:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:49:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:49:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:49:32 Testing on the destination bucket for upsert with cas
2021/12/22 12:49:32 Starting bucket ops to source bucket
2021/12/22 12:49:32 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:49:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2021/12/22 12:49:38 Waiting for app: TestCasReplace to get deployed
2021/12/22 12:49:43 Waiting for app: TestCasReplace to get deployed
2021/12/22 12:49:48 Waiting for app: TestCasReplace to get deployed
2021/12/22 12:49:53 Waiting for app: TestCasReplace to get deployed
2021/12/22 12:49:53 App: TestCasReplace got deployed
2021/12/22 12:49:53 Starting bucket ops to source bucket
2021/12/22 12:49:59 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:50:04 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 12:50:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:50:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:50:04 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:50:09 Waiting for app: TestCasReplace to get un-deployed
2021/12/22 12:50:14 Waiting for app: TestCasReplace to get un-deployed
2021/12/22 12:50:19 Waiting for app: TestCasReplace to get un-deployed
2021/12/22 12:50:24 Waiting for app: TestCasReplace to get un-deployed
2021/12/22 12:50:24 App: TestCasReplace got un-deployed
2021/12/22 12:50:24 No eventing-con process running
2021/12/22 12:50:24 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2021/12/22 12:50:25 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:50:35 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:50:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:50:37 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:50:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasReplace (130.28s)
=== RUN   TestCasDelete
2021/12/22 12:50:42 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:50:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2021/12/22 12:50:48 Waiting for app: TestCasDelete to get deployed
2021/12/22 12:50:53 Waiting for app: TestCasDelete to get deployed
2021/12/22 12:50:58 Waiting for app: TestCasDelete to get deployed
2021/12/22 12:51:03 Waiting for app: TestCasDelete to get deployed
2021/12/22 12:51:03 App: TestCasDelete got deployed
2021/12/22 12:51:03 Starting bucket ops to source bucket
2021/12/22 12:51:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:51:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:51:04 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:51:09 Waiting for app: TestCasDelete to get un-deployed
2021/12/22 12:51:14 Waiting for app: TestCasDelete to get un-deployed
2021/12/22 12:51:19 Waiting for app: TestCasDelete to get un-deployed
2021/12/22 12:51:24 Waiting for app: TestCasDelete to get un-deployed
2021/12/22 12:51:24 App: TestCasDelete got un-deployed
2021/12/22 12:51:24 No eventing-con process running
2021/12/22 12:51:24 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2021/12/22 12:51:26 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:51:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:51:33 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:51:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:51:38 Testing on the destination bucket for delete with cas
2021/12/22 12:51:38 Starting bucket ops to source bucket
2021/12/22 12:51:38 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:51:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2021/12/22 12:51:44 Waiting for app: TestCasDelete to get deployed
2021/12/22 12:51:49 Waiting for app: TestCasDelete to get deployed
2021/12/22 12:51:54 Waiting for app: TestCasDelete to get deployed
2021/12/22 12:51:59 Waiting for app: TestCasDelete to get deployed
2021/12/22 12:51:59 App: TestCasDelete got deployed
2021/12/22 12:51:59 Starting bucket ops to source bucket
2021/12/22 12:52:04 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:52:09 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:52:14 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 12:52:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:52:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:52:14 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 12:52:20 Waiting for app: TestCasDelete to get un-deployed
2021/12/22 12:52:25 Waiting for app: TestCasDelete to get un-deployed
2021/12/22 12:52:30 Waiting for app: TestCasDelete to get un-deployed
2021/12/22 12:52:35 Waiting for app: TestCasDelete to get un-deployed
2021/12/22 12:52:35 App: TestCasDelete got un-deployed
2021/12/22 12:52:35 No eventing-con process running
2021/12/22 12:52:35 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2021/12/22 12:52:36 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:52:46 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 12:52:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:52:48 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:52:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasDelete (130.84s)
=== RUN   TestCountersIncrement
2021/12/22 12:52:53 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/22 12:52:59 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 12:53:00 Removing node(s): [] from the cluster
2021/12/22 12:53:05 Rebalance progress: 100
2021/12/22 12:53:05 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:53:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2021/12/22 12:53:11 Waiting for app: TestCountersIncrement to get deployed
2021/12/22 12:53:16 Waiting for app: TestCountersIncrement to get deployed
2021/12/22 12:53:21 Waiting for app: TestCountersIncrement to get deployed
2021/12/22 12:53:26 Waiting for app: TestCountersIncrement to get deployed
2021/12/22 12:53:26 App: TestCountersIncrement got deployed
2021/12/22 12:53:26 Starting bucket ops to source bucket
2021/12/22 12:53:32 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/22 12:53:37 Waiting for dst bucket item count to get to: 1024 curr count: 512
2021/12/22 12:53:37 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/22 12:53:37 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:53:42 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/22 12:53:47 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/22 12:53:52 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/22 12:53:57 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/22 12:53:57 App: TestCountersIncrement got un-deployed
2021/12/22 12:53:57 No eventing-con process running
2021/12/22 12:53:57 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2021/12/22 12:53:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:54:09 Waiting for dst bucket item count to get to: 0 curr count: 1025
2021/12/22 12:54:14 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/22 12:54:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:54:16 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:54:26 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/22 12:54:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:54:26 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:54:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2021/12/22 12:54:32 Waiting for app: TestCountersIncrement to get deployed
2021/12/22 12:54:37 Waiting for app: TestCountersIncrement to get deployed
2021/12/22 12:54:42 Waiting for app: TestCountersIncrement to get deployed
2021/12/22 12:54:47 Waiting for app: TestCountersIncrement to get deployed
2021/12/22 12:54:47 App: TestCountersIncrement got deployed
2021/12/22 12:54:47 Starting bucket ops to source bucket
2021/12/22 12:54:53 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/22 12:54:58 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/22 12:55:03 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/22 12:55:03 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/22 12:55:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:55:08 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/22 12:55:14 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/22 12:55:19 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/22 12:55:24 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/22 12:55:24 App: TestCountersIncrement got un-deployed
2021/12/22 12:55:24 No eventing-con process running
2021/12/22 12:55:24 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2021/12/22 12:55:25 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:55:35 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/22 12:55:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:55:37 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:55:47 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/22 12:55:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:55:47 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2021/12/22 12:55:52 Rebalance progress: 100
--- PASS: TestCountersIncrement (179.23s)
=== RUN   TestCountersDecrement
2021/12/22 12:55:52 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/22 12:55:53 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 12:55:53 Removing node(s): [] from the cluster
2021/12/22 12:55:58 Rebalance progress: 100
2021/12/22 12:55:58 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:55:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2021/12/22 12:56:04 Waiting for app: TestCountersDecrement to get deployed
2021/12/22 12:56:09 Waiting for app: TestCountersDecrement to get deployed
2021/12/22 12:56:14 Waiting for app: TestCountersDecrement to get deployed
2021/12/22 12:56:19 Waiting for app: TestCountersDecrement to get deployed
2021/12/22 12:56:19 App: TestCountersDecrement got deployed
2021/12/22 12:56:19 Starting bucket ops to source bucket
2021/12/22 12:56:25 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/22 12:56:30 Waiting for dst bucket item count to get to: 1024 curr count: 28
2021/12/22 12:56:35 Waiting for dst bucket item count to get to: 1024 curr count: 540
2021/12/22 12:56:35 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/22 12:56:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:56:40 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/22 12:56:45 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/22 12:56:50 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/22 12:56:55 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/22 12:56:55 App: TestCountersDecrement got un-deployed
2021/12/22 12:56:55 No eventing-con process running
2021/12/22 12:56:56 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2021/12/22 12:56:57 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:57:07 Waiting for dst bucket item count to get to: 0 curr count: 1025
2021/12/22 12:57:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:57:09 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:57:19 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/22 12:57:24 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/22 12:57:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:57:24 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:57:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2021/12/22 12:57:30 Waiting for app: TestCountersDecrement to get deployed
2021/12/22 12:57:35 Waiting for app: TestCountersDecrement to get deployed
2021/12/22 12:57:40 Waiting for app: TestCountersDecrement to get deployed
2021/12/22 12:57:45 Waiting for app: TestCountersDecrement to get deployed
2021/12/22 12:57:45 App: TestCountersDecrement got deployed
2021/12/22 12:57:45 Starting bucket ops to source bucket
2021/12/22 12:57:51 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/22 12:57:51 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/22 12:57:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:57:57 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/22 12:58:02 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/22 12:58:07 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/22 12:58:12 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/22 12:58:12 App: TestCountersDecrement got un-deployed
2021/12/22 12:58:12 No eventing-con process running
2021/12/22 12:58:12 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2021/12/22 12:58:13 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:58:23 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/22 12:58:28 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/22 12:58:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:58:30 Context: Bucket flush, response code: 200 dump: 
2021/12/22 12:58:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 12:58:35 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2021/12/22 12:58:40 Rebalance progress: 100
--- PASS: TestCountersDecrement (168.06s)
=== RUN   TestCacheGet
2021/12/22 12:58:40 Deploying app: TestCacheGet. Item count src bucket: 0 dst bucket: 0
2021/12/22 12:58:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet stored in temp store"
}
2021/12/22 12:58:46 Waiting for app: TestCacheGet to get deployed
2021/12/22 12:58:52 Waiting for app: TestCacheGet to get deployed
2021/12/22 12:58:57 Waiting for app: TestCacheGet to get deployed
2021/12/22 12:59:02 Waiting for app: TestCacheGet to get deployed
2021/12/22 12:59:02 App: TestCacheGet got deployed
2021/12/22 12:59:02 Starting bucket ops to source bucket
2021/12/22 12:59:07 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/22 12:59:12 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/22 12:59:17 Waiting for dst bucket item count to get to: 20 curr count: 5
2021/12/22 12:59:22 Waiting for dst bucket item count to get to: 20 curr count: 5
2021/12/22 12:59:27 Waiting for dst bucket item count to get to: 20 curr count: 18
2021/12/22 12:59:32 Waiting for dst bucket item count to get to: 20 curr count: 18
2021/12/22 12:59:32 src & dst bucket item count matched up. src bucket count: 20 dst bucket count: 20
2021/12/22 12:59:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 12:59:37 Waiting for app: TestCacheGet to get un-deployed
2021/12/22 12:59:42 Waiting for app: TestCacheGet to get un-deployed
2021/12/22 12:59:47 Waiting for app: TestCacheGet to get un-deployed
2021/12/22 12:59:52 Waiting for app: TestCacheGet to get un-deployed
2021/12/22 12:59:52 App: TestCacheGet got un-deployed
2021/12/22 12:59:52 No eventing-con process running
2021/12/22 12:59:52 Function: TestCacheGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet deleting in background"
}
2021/12/22 12:59:54 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:00:04 Waiting for dst bucket item count to get to: 0 curr count: 20
2021/12/22 13:00:09 Waiting for dst bucket item count to get to: 0 curr count: 10
2021/12/22 13:00:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:00:11 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:00:21 Waiting for dst bucket item count to get to: 0 curr count: 18
2021/12/22 13:00:26 Waiting for dst bucket item count to get to: 0 curr count: 18
2021/12/22 13:00:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheGet (105.43s)
=== RUN   TestCacheRYOW
2021/12/22 13:00:26 Deploying app: TestCacheRYOW. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:00:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW stored in temp store"
}
2021/12/22 13:00:32 Waiting for app: TestCacheRYOW to get deployed
2021/12/22 13:00:37 Waiting for app: TestCacheRYOW to get deployed
2021/12/22 13:00:42 Waiting for app: TestCacheRYOW to get deployed
2021/12/22 13:00:47 Waiting for app: TestCacheRYOW to get deployed
2021/12/22 13:00:47 App: TestCacheRYOW got deployed
2021/12/22 13:00:47 Starting bucket ops to source bucket
2021/12/22 13:00:52 Waiting for dst bucket item count to get to: 50 curr count: 0
2021/12/22 13:00:52 src & dst bucket item count matched up. src bucket count: 50 dst bucket count: 50
2021/12/22 13:00:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:00:57 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/22 13:01:02 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/22 13:01:07 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/22 13:01:12 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/22 13:01:12 App: TestCacheRYOW got un-deployed
2021/12/22 13:01:12 No eventing-con process running
2021/12/22 13:01:12 Function: TestCacheRYOW delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW deleting in background"
}
2021/12/22 13:01:14 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:01:24 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 13:01:29 Waiting for dst bucket item count to get to: 0 curr count: 25
2021/12/22 13:01:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:01:31 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:01:41 Waiting for dst bucket item count to get to: 0 curr count: 49
2021/12/22 13:01:46 Waiting for dst bucket item count to get to: 0 curr count: 49
2021/12/22 13:01:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheRYOW (80.20s)
=== RUN   TestCacheExpiry
2021/12/22 13:01:46 Deploying app: TestCacheExpiry. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:01:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry stored in temp store"
}
2021/12/22 13:01:52 Waiting for app: TestCacheExpiry to get deployed
2021/12/22 13:01:57 Waiting for app: TestCacheExpiry to get deployed
2021/12/22 13:02:02 Waiting for app: TestCacheExpiry to get deployed
2021/12/22 13:02:07 Waiting for app: TestCacheExpiry to get deployed
2021/12/22 13:02:07 App: TestCacheExpiry got deployed
2021/12/22 13:02:07 Starting bucket ops to source bucket
2021/12/22 13:02:12 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 13:02:17 Waiting for dst bucket item count to get to: 100 curr count: 13
2021/12/22 13:02:22 Waiting for dst bucket item count to get to: 100 curr count: 13
2021/12/22 13:02:27 Waiting for dst bucket item count to get to: 100 curr count: 86
2021/12/22 13:02:32 Waiting for dst bucket item count to get to: 100 curr count: 86
2021/12/22 13:02:32 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 13:02:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:02:38 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/22 13:02:43 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/22 13:02:48 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/22 13:02:53 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/22 13:02:53 App: TestCacheExpiry got un-deployed
2021/12/22 13:02:53 No eventing-con process running
2021/12/22 13:02:53 Function: TestCacheExpiry delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry deleting in background"
}
2021/12/22 13:02:54 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:03:04 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 13:03:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:03:06 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:03:16 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:03:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiry (90.26s)
=== RUN   TestCacheExpiryCustom
2021/12/22 13:03:16 Deploying app: TestCacheExpiryCustom. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:03:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom stored in temp store"
}
2021/12/22 13:03:22 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/22 13:03:27 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/22 13:03:32 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/22 13:03:37 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/22 13:03:38 App: TestCacheExpiryCustom got deployed
2021/12/22 13:03:38 Starting bucket ops to source bucket
2021/12/22 13:03:43 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 13:03:48 Waiting for dst bucket item count to get to: 100 curr count: 3
2021/12/22 13:03:53 Waiting for dst bucket item count to get to: 100 curr count: 3
2021/12/22 13:03:58 Waiting for dst bucket item count to get to: 100 curr count: 86
2021/12/22 13:04:03 Waiting for dst bucket item count to get to: 100 curr count: 86
2021/12/22 13:04:03 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 13:04:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:04:08 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/22 13:04:13 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/22 13:04:18 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/22 13:04:23 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/22 13:04:23 App: TestCacheExpiryCustom got un-deployed
2021/12/22 13:04:23 No eventing-con process running
2021/12/22 13:04:23 Function: TestCacheExpiryCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom deleting in background"
}
2021/12/22 13:04:25 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:04:35 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 13:04:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:04:36 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:04:46 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:04:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiryCustom (90.29s)
=== RUN   TestCacheOverflowCustom
2021/12/22 13:04:46 Deploying app: TestCacheOverflowCustom. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:04:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom stored in temp store"
}
2021/12/22 13:04:53 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/22 13:04:58 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/22 13:05:03 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/22 13:05:08 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/22 13:05:08 App: TestCacheOverflowCustom got deployed
2021/12/22 13:05:08 Starting bucket ops to source bucket
2021/12/22 13:05:13 Waiting for dst bucket item count to get to: 35 curr count: 0
2021/12/22 13:05:18 Waiting for dst bucket item count to get to: 35 curr count: 3
2021/12/22 13:05:23 Waiting for dst bucket item count to get to: 35 curr count: 3
2021/12/22 13:05:28 Waiting for dst bucket item count to get to: 35 curr count: 25
2021/12/22 13:05:33 Waiting for dst bucket item count to get to: 35 curr count: 25
2021/12/22 13:05:38 Waiting for dst bucket item count to get to: 35 curr count: 34
2021/12/22 13:05:43 Waiting for dst bucket item count to get to: 35 curr count: 34
2021/12/22 13:05:43 src & dst bucket item count matched up. src bucket count: 35 dst bucket count: 35
2021/12/22 13:05:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:05:48 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/22 13:05:53 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/22 13:05:58 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/22 13:06:03 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/22 13:06:03 App: TestCacheOverflowCustom got un-deployed
2021/12/22 13:06:03 No eventing-con process running
2021/12/22 13:06:03 Function: TestCacheOverflowCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom deleting in background"
}
2021/12/22 13:06:05 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:06:15 Waiting for dst bucket item count to get to: 0 curr count: 5
2021/12/22 13:06:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:06:17 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:06:27 Waiting for dst bucket item count to get to: 0 curr count: 35
2021/12/22 13:06:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheOverflowCustom (100.28s)
=== RUN   TestStrictMode
2021/12/22 13:06:27 Deploying app: TestStrictMode. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:06:28 Context: Post to main store, response code: 422 dump: {
 "name": "ERR_HANDLER_COMPILATION",
 "code": 27,
 "description": {
  "area": "handlerCode",
  "column_number": 63,
  "compile_success": false,
  "description": "        destination[meta.id] = 00000000000000000000000000000101;\n                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nSyntaxError: Octal literals are not allowed in strict mode.\n",
  "index": 132,
  "language": "JavaScript",
  "line_number": 4
 }
}
--- PASS: TestStrictMode (1.06s)
=== RUN   TestDataTypes
2021/12/22 13:06:28 Deploying app: TestDataTypes. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:06:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes stored in temp store"
}
2021/12/22 13:06:34 Waiting for app: TestDataTypes to get deployed
2021/12/22 13:06:39 Waiting for app: TestDataTypes to get deployed
2021/12/22 13:06:44 Waiting for app: TestDataTypes to get deployed
2021/12/22 13:06:49 Waiting for app: TestDataTypes to get deployed
2021/12/22 13:06:49 App: TestDataTypes got deployed
2021/12/22 13:06:49 Starting bucket ops to source bucket
2021/12/22 13:06:54 Waiting for dst bucket item count to get to: 18 curr count: 0
2021/12/22 13:06:59 Waiting for dst bucket item count to get to: 18 curr count: 10
2021/12/22 13:07:04 Waiting for dst bucket item count to get to: 18 curr count: 10
2021/12/22 13:07:04 src & dst bucket item count matched up. src bucket count: 18 dst bucket count: 18
2021/12/22 13:07:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:07:09 Waiting for app: TestDataTypes to get un-deployed
2021/12/22 13:07:14 Waiting for app: TestDataTypes to get un-deployed
2021/12/22 13:07:19 Waiting for app: TestDataTypes to get un-deployed
2021/12/22 13:07:24 Waiting for app: TestDataTypes to get un-deployed
2021/12/22 13:07:24 App: TestDataTypes got un-deployed
2021/12/22 13:07:24 No eventing-con process running
2021/12/22 13:07:24 Function: TestDataTypes delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes deleting in background"
}
2021/12/22 13:07:26 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:07:36 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/22 13:07:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:07:38 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:07:48 Waiting for dst bucket item count to get to: 0 curr count: 11
2021/12/22 13:07:53 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/22 13:07:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDataTypes (85.21s)
=== RUN   TestEnoentGet
2021/12/22 13:07:53 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:07:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2021/12/22 13:07:59 Waiting for app: TestEnoentGet to get deployed
2021/12/22 13:08:04 Waiting for app: TestEnoentGet to get deployed
2021/12/22 13:08:09 Waiting for app: TestEnoentGet to get deployed
2021/12/22 13:08:14 Waiting for app: TestEnoentGet to get deployed
2021/12/22 13:08:14 App: TestEnoentGet got deployed
2021/12/22 13:08:14 Starting bucket ops to source bucket
2021/12/22 13:08:19 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 13:08:24 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/22 13:08:24 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 13:08:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:08:30 Waiting for app: TestEnoentGet to get un-deployed
2021/12/22 13:08:35 Waiting for app: TestEnoentGet to get un-deployed
2021/12/22 13:08:40 Waiting for app: TestEnoentGet to get un-deployed
2021/12/22 13:08:45 Waiting for app: TestEnoentGet to get un-deployed
2021/12/22 13:08:45 App: TestEnoentGet got un-deployed
2021/12/22 13:08:45 No eventing-con process running
2021/12/22 13:08:45 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2021/12/22 13:08:46 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:08:56 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:08:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:08:58 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:09:08 Waiting for dst bucket item count to get to: 0 curr count: 77
2021/12/22 13:09:13 Waiting for dst bucket item count to get to: 0 curr count: 27
2021/12/22 13:09:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:09:13 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:09:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2021/12/22 13:09:19 Waiting for app: TestEnoentGet to get deployed
2021/12/22 13:09:24 Waiting for app: TestEnoentGet to get deployed
2021/12/22 13:09:29 Waiting for app: TestEnoentGet to get deployed
2021/12/22 13:09:35 Waiting for app: TestEnoentGet to get deployed
2021/12/22 13:09:35 App: TestEnoentGet got deployed
2021/12/22 13:09:35 Starting bucket ops to source bucket
2021/12/22 13:09:40 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 13:09:45 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/22 13:09:45 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 13:09:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:09:50 Waiting for app: TestEnoentGet to get un-deployed
2021/12/22 13:09:55 Waiting for app: TestEnoentGet to get un-deployed
2021/12/22 13:10:00 Waiting for app: TestEnoentGet to get un-deployed
2021/12/22 13:10:00 App: TestEnoentGet got un-deployed
2021/12/22 13:10:00 No eventing-con process running
2021/12/22 13:10:00 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2021/12/22 13:10:02 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:10:12 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:10:17 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:10:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:10:19 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:10:29 Waiting for dst bucket item count to get to: 0 curr count: 91
2021/12/22 13:10:34 Waiting for dst bucket item count to get to: 0 curr count: 41
2021/12/22 13:10:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentGet (160.68s)
=== RUN   TestEnoentDelete
2021/12/22 13:10:34 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:10:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2021/12/22 13:10:40 Waiting for app: TestEnoentDelete to get deployed
2021/12/22 13:10:45 Waiting for app: TestEnoentDelete to get deployed
2021/12/22 13:10:50 Waiting for app: TestEnoentDelete to get deployed
2021/12/22 13:10:55 Waiting for app: TestEnoentDelete to get deployed
2021/12/22 13:10:55 App: TestEnoentDelete got deployed
2021/12/22 13:10:55 Starting bucket ops to source bucket
2021/12/22 13:11:00 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 13:11:05 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/22 13:11:05 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 13:11:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:11:10 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/22 13:11:15 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/22 13:11:20 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/22 13:11:25 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/22 13:11:25 App: TestEnoentDelete got un-deployed
2021/12/22 13:11:25 No eventing-con process running
2021/12/22 13:11:25 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2021/12/22 13:11:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:11:37 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:11:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:11:39 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:11:49 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:11:54 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 13:11:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:11:54 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:11:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2021/12/22 13:12:00 Waiting for app: TestEnoentDelete to get deployed
2021/12/22 13:12:05 Waiting for app: TestEnoentDelete to get deployed
2021/12/22 13:12:10 Waiting for app: TestEnoentDelete to get deployed
2021/12/22 13:12:15 Waiting for app: TestEnoentDelete to get deployed
2021/12/22 13:12:15 App: TestEnoentDelete got deployed
2021/12/22 13:12:15 Starting bucket ops to source bucket
2021/12/22 13:12:20 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 13:12:20 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 13:12:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:12:25 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/22 13:12:31 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/22 13:12:36 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/22 13:12:41 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/22 13:12:41 App: TestEnoentDelete got un-deployed
2021/12/22 13:12:41 No eventing-con process running
2021/12/22 13:12:41 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2021/12/22 13:12:42 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:12:52 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:12:57 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 13:12:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:12:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:13:09 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:13:14 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/22 13:13:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentDelete (160.51s)
=== RUN   TestError
2021/12/22 13:13:24 Waiting for app: TestError to get un-deployed
2021/12/22 13:13:24 App: TestError got un-deployed
2021/12/22 13:13:24 No eventing-con process running
2021/12/22 13:13:24 Function: TestError delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestError not found"
}
2021/12/22 13:13:26 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:13:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:13:33 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:13:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:13:38 Deploying app: TestError. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:13:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError stored in temp store"
}
2021/12/22 13:13:44 Waiting for app: TestError to get deployed
2021/12/22 13:13:49 Waiting for app: TestError to get deployed
2021/12/22 13:13:54 Waiting for app: TestError to get deployed
2021/12/22 13:13:59 Waiting for app: TestError to get deployed
2021/12/22 13:13:59 App: TestError got deployed
2021/12/22 13:13:59 Starting bucket ops to source bucket
2021/12/22 13:14:04 Waiting for dst bucket item count to get to: 300 curr count: 0
2021/12/22 13:14:09 Waiting for dst bucket item count to get to: 300 curr count: 144
2021/12/22 13:14:09 src & dst bucket item count matched up. src bucket count: 300 dst bucket count: 300
2021/12/22 13:14:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:14:14 Waiting for app: TestError to get un-deployed
2021/12/22 13:14:19 Waiting for app: TestError to get un-deployed
2021/12/22 13:14:24 Waiting for app: TestError to get un-deployed
2021/12/22 13:14:30 Waiting for app: TestError to get un-deployed
2021/12/22 13:14:30 App: TestError got un-deployed
2021/12/22 13:14:30 No eventing-con process running
2021/12/22 13:14:30 Function: TestError delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError deleting in background"
}
2021/12/22 13:14:31 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:14:41 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:14:46 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:14:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:14:48 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:14:58 Waiting for dst bucket item count to get to: 0 curr count: 210
2021/12/22 13:15:03 Waiting for dst bucket item count to get to: 0 curr count: 66
2021/12/22 13:15:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestError (108.92s)
=== RUN   TestCRLF
2021/12/22 13:15:13 Waiting for app: TestCRLF to get un-deployed
2021/12/22 13:15:13 App: TestCRLF got un-deployed
2021/12/22 13:15:13 No eventing-con process running
2021/12/22 13:15:13 Function: TestCRLF delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCRLF not found"
}
2021/12/22 13:15:15 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:15:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:15:22 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:15:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:15:27 Deploying app: TestCRLF. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:15:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF stored in temp store"
}
2021/12/22 13:15:33 Waiting for app: TestCRLF to get deployed
2021/12/22 13:15:38 Waiting for app: TestCRLF to get deployed
2021/12/22 13:15:43 Waiting for app: TestCRLF to get deployed
2021/12/22 13:15:48 Waiting for app: TestCRLF to get deployed
2021/12/22 13:15:48 App: TestCRLF got deployed
2021/12/22 13:15:48 Starting bucket ops to source bucket
2021/12/22 13:15:53 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 13:15:58 Waiting for dst bucket item count to get to: 100 curr count: 45
2021/12/22 13:16:03 Waiting for dst bucket item count to get to: 100 curr count: 45
2021/12/22 13:16:03 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 13:16:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:16:08 Waiting for app: TestCRLF to get un-deployed
2021/12/22 13:16:13 Waiting for app: TestCRLF to get un-deployed
2021/12/22 13:16:18 Waiting for app: TestCRLF to get un-deployed
2021/12/22 13:16:23 Waiting for app: TestCRLF to get un-deployed
2021/12/22 13:16:23 App: TestCRLF got un-deployed
2021/12/22 13:16:23 No eventing-con process running
2021/12/22 13:16:23 Function: TestCRLF delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF deleting in background"
}
2021/12/22 13:16:25 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:16:35 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:16:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:16:37 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:16:47 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 13:16:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCRLF (103.91s)
=== RUN   TestImportExport
2021/12/22 13:16:57 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/22 13:16:57 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/22 13:16:57 No eventing-con process running
2021/12/22 13:16:57 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_n1ql_insert_on_update not found"
}
2021/12/22 13:16:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:17:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:17:06 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:17:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:17:16 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/22 13:17:16 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/22 13:17:16 No eventing-con process running
2021/12/22 13:17:16 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_bucket_op_on_update not found"
}
2021/12/22 13:17:18 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:17:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:17:24 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:17:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:17:29 Deploying app: TestImportExport_n1ql_insert_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:17:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update stored in temp store"
}
2021/12/22 13:17:30 Deploying app: TestImportExport_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:17:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update stored in temp store"
}
2021/12/22 13:17:37 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/22 13:17:42 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/22 13:17:47 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/22 13:17:52 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/22 13:17:52 App: TestImportExport_n1ql_insert_on_update got deployed
2021/12/22 13:17:57 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/22 13:18:02 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/22 13:18:07 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/22 13:18:07 App: TestImportExport_bucket_op_on_update got deployed
2021/12/22 13:18:12 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/22 13:18:17 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/22 13:18:22 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/22 13:18:27 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/22 13:18:27 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/22 13:18:27 No eventing-con process running
2021/12/22 13:18:27 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2021/12/22 13:18:32 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/22 13:18:37 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/22 13:18:42 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/22 13:18:47 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/22 13:18:47 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/22 13:18:47 No eventing-con process running
2021/12/22 13:18:47 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2021/12/22 13:19:05 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/22 13:19:05 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/22 13:19:05 No eventing-con process running
2021/12/22 13:19:05 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2021/12/22 13:19:06 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:19:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:19:13 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:19:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:19:23 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/22 13:19:23 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/22 13:19:23 No eventing-con process running
2021/12/22 13:19:23 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2021/12/22 13:19:25 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:19:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:19:32 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:19:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestImportExport (169.68s)
=== RUN   TestDeployUndeployLoopNonDefaultSettings
2021/12/22 13:19:47 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:19:47 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/22 13:19:47 No eventing-con process running
2021/12/22 13:19:47 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopNonDefaultSettings not found"
}
2021/12/22 13:19:49 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:19:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:19:55 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:20:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:20:00 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:20:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/22 13:20:01 Starting bucket ops to source bucket
2021/12/22 13:20:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:20:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:20:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:20:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:20:24 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:20:29 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/22 13:20:29 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/22 13:20:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:20:30 Undeploying app: bucket_op_on_update
2021/12/22 13:20:35 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:20:40 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:20:45 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:20:50 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:20:50 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/22 13:20:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:20:50 No eventing-con process running
2021/12/22 13:20:52 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:20:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:21:34 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:21:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/22 13:21:35 Starting bucket ops to source bucket
2021/12/22 13:21:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:21:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:21:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:21:58 Waiting for dst bucket item count to get to: 5000 curr count: 3295
2021/12/22 13:22:03 Waiting for dst bucket item count to get to: 5000 curr count: 3295
2021/12/22 13:22:03 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:22:08 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/22 13:22:08 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/22 13:22:08 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:22:08 Undeploying app: bucket_op_on_update
2021/12/22 13:22:13 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:22:18 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:22:23 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:22:28 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:22:28 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/22 13:22:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:22:28 No eventing-con process running
2021/12/22 13:22:30 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:22:37 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:23:12 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:23:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/22 13:23:13 Starting bucket ops to source bucket
2021/12/22 13:23:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:23:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:23:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:23:36 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/22 13:23:36 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:23:41 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/22 13:23:41 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/22 13:23:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:23:41 Undeploying app: bucket_op_on_update
2021/12/22 13:23:46 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:23:52 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:23:57 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:24:02 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:24:02 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/22 13:24:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:24:02 No eventing-con process running
2021/12/22 13:24:03 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:24:11 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:24:46 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:24:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/22 13:24:47 Starting bucket ops to source bucket
2021/12/22 13:24:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:25:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:25:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:25:10 Waiting for dst bucket item count to get to: 5000 curr count: 1275
2021/12/22 13:25:15 Waiting for dst bucket item count to get to: 5000 curr count: 1275
2021/12/22 13:25:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:25:20 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/22 13:25:20 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/22 13:25:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:25:20 Undeploying app: bucket_op_on_update
2021/12/22 13:25:25 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:25:30 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:25:35 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:25:40 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:25:40 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/22 13:25:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:25:40 No eventing-con process running
2021/12/22 13:25:42 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:25:49 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:26:24 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:26:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/22 13:26:25 Starting bucket ops to source bucket
2021/12/22 13:26:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:26:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:26:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:26:48 Waiting for dst bucket item count to get to: 5000 curr count: 3070
2021/12/22 13:26:53 Waiting for dst bucket item count to get to: 5000 curr count: 3070
2021/12/22 13:26:53 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:26:58 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/22 13:26:58 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/22 13:26:58 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:26:58 Undeploying app: bucket_op_on_update
2021/12/22 13:27:03 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:27:08 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:27:13 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:27:18 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/22 13:27:18 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/22 13:27:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:27:18 No eventing-con process running
2021/12/22 13:27:20 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:27:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:28:02 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings deleting in background"
}
--- PASS: TestDeployUndeployLoopNonDefaultSettings (505.76s)
=== RUN   TestOnUpdateN1QLOp
2021/12/22 13:28:12 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/22 13:28:12 App: TestOnUpdateN1QLOp got un-deployed
2021/12/22 13:28:12 No eventing-con process running
2021/12/22 13:28:13 Function: TestOnUpdateN1QLOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateN1QLOp not found"
}
2021/12/22 13:28:14 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:28:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:28:21 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:28:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:28:26 Deploying app: TestOnUpdateN1QLOp. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:28:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp stored in temp store"
}
2021/12/22 13:28:27 Starting bucket ops to source bucket
2021/12/22 13:28:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:28:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:28:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:28:50 Waiting for dst bucket item count to get to: 5000 curr count: 175
2021/12/22 13:28:55 Waiting for dst bucket item count to get to: 5000 curr count: 175
2021/12/22 13:28:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:28:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:29:00 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/22 13:29:05 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/22 13:29:11 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/22 13:29:16 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/22 13:29:16 App: TestOnUpdateN1QLOp got un-deployed
2021/12/22 13:29:16 No eventing-con process running
2021/12/22 13:29:16 Function: TestOnUpdateN1QLOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp deleting in background"
}
2021/12/22 13:29:17 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:29:27 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 13:29:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:29:29 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:29:39 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 13:29:44 Waiting for dst bucket item count to get to: 0 curr count: 2488
2021/12/22 13:29:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateN1QLOp (101.73s)
=== RUN   TestOnUpdateBucketOpDefaultSettings
2021/12/22 13:29:54 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/22 13:29:54 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2021/12/22 13:29:54 No eventing-con process running
2021/12/22 13:29:54 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings not found"
}
2021/12/22 13:29:56 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:30:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:30:03 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:30:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:30:08 Deploying app: TestOnUpdateBucketOpDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:30:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings stored in temp store"
}
2021/12/22 13:30:09 Starting bucket ops to source bucket
2021/12/22 13:30:17 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:30:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:30:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:30:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:30:37 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/22 13:30:37 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:30:37 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:30:42 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/22 13:30:47 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/22 13:30:52 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/22 13:30:57 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/22 13:30:57 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2021/12/22 13:30:57 No eventing-con process running
2021/12/22 13:30:57 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings deleting in background"
}
2021/12/22 13:30:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:31:09 Waiting for dst bucket item count to get to: 0 curr count: 4914
2021/12/22 13:31:14 Waiting for dst bucket item count to get to: 0 curr count: 2414
2021/12/22 13:31:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:31:16 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:31:26 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 13:31:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings (101.40s)
=== RUN   TestOnUpdateBucketOpNonDefaultSettings
2021/12/22 13:31:36 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/22 13:31:36 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/22 13:31:36 No eventing-con process running
2021/12/22 13:31:36 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpNonDefaultSettings not found"
}
2021/12/22 13:31:37 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:31:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:31:44 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:31:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:31:49 Deploying app: TestOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:31:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2021/12/22 13:31:50 Starting bucket ops to source bucket
2021/12/22 13:31:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:32:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:32:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:32:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:32:13 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:32:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:32:18 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/22 13:32:23 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/22 13:32:28 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/22 13:32:33 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/22 13:32:33 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/22 13:32:33 No eventing-con process running
2021/12/22 13:32:34 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2021/12/22 13:32:35 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:32:45 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 13:32:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:32:47 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:32:57 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 13:32:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpNonDefaultSettings (91.55s)
=== RUN   TestOnUpdateBucketOpDefaultSettings10K
2021/12/22 13:33:07 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/22 13:33:07 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2021/12/22 13:33:07 No eventing-con process running
2021/12/22 13:33:07 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings10K not found"
}
2021/12/22 13:33:09 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:33:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:33:16 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:33:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:33:21 Deploying app: TestOnUpdateBucketOpDefaultSettings10K. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:33:22 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K stored in temp store"
}
2021/12/22 13:33:22 Starting bucket ops to source bucket
2021/12/22 13:33:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:33:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:33:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:33:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:33:45 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:33:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:33:50 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/22 13:33:55 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/22 13:34:00 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/22 13:34:05 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/22 13:34:05 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2021/12/22 13:34:05 No eventing-con process running
2021/12/22 13:34:05 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K deleting in background"
}
2021/12/22 13:34:07 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:34:17 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 13:34:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:34:19 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:34:29 Waiting for dst bucket item count to get to: 0 curr count: 4552
2021/12/22 13:34:34 Waiting for dst bucket item count to get to: 0 curr count: 2052
2021/12/22 13:34:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings10K (96.54s)
=== RUN   TestOnUpdateBucketOpDefaultSettings100K
2021/12/22 13:34:44 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/22 13:34:44 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2021/12/22 13:34:44 No eventing-con process running
2021/12/22 13:34:44 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings100K not found"
}
2021/12/22 13:34:45 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:34:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:34:52 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:34:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:34:57 Deploying app: TestOnUpdateBucketOpDefaultSettings100K. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:34:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K stored in temp store"
}
2021/12/22 13:34:59 Starting bucket ops to source bucket
2021/12/22 13:35:07 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:35:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:35:17 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:35:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:35:27 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/22 13:35:27 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:35:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:35:32 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/22 13:35:37 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/22 13:35:42 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/22 13:35:47 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/22 13:35:47 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2021/12/22 13:35:47 No eventing-con process running
2021/12/22 13:35:47 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K deleting in background"
}
2021/12/22 13:35:49 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:35:59 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 13:36:04 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 13:36:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:36:06 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:36:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 13:36:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings100K (102.15s)
=== RUN   TestOnDeleteBucketOp
2021/12/22 13:36:26 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/22 13:36:26 App: TestOnDeleteBucketOp got un-deployed
2021/12/22 13:36:26 No eventing-con process running
2021/12/22 13:36:26 Function: TestOnDeleteBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp not found"
}
2021/12/22 13:36:28 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:36:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:36:34 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:36:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:36:39 Deploying app: TestOnDeleteBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:36:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp stored in temp store"
}
2021/12/22 13:36:41 Starting bucket ops to source bucket
2021/12/22 13:36:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:36:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:37:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:37:01 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:37:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:37:06 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/22 13:37:11 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/22 13:37:16 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/22 13:37:21 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/22 13:37:21 App: TestOnDeleteBucketOp got un-deployed
2021/12/22 13:37:21 No eventing-con process running
2021/12/22 13:37:21 Function: TestOnDeleteBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp deleting in background"
}
2021/12/22 13:37:23 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:37:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:37:30 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:37:40 Waiting for dst bucket item count to get to: 0 curr count: 3739
2021/12/22 13:37:46 Waiting for dst bucket item count to get to: 0 curr count: 3739
2021/12/22 13:37:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp (89.67s)
=== RUN   TestOnDeleteBucketOp5K
2021/12/22 13:37:56 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/22 13:37:56 App: TestOnDeleteBucketOp5K got un-deployed
2021/12/22 13:37:56 No eventing-con process running
2021/12/22 13:37:56 Function: TestOnDeleteBucketOp5K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp5K not found"
}
2021/12/22 13:37:57 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:38:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:38:04 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:38:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:38:09 Deploying app: TestOnDeleteBucketOp5K. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:38:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K stored in temp store"
}
2021/12/22 13:38:10 Starting bucket ops to source bucket
2021/12/22 13:38:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:38:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:38:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:38:31 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:38:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:38:36 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/22 13:38:41 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/22 13:38:46 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/22 13:38:51 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/22 13:38:51 App: TestOnDeleteBucketOp5K got un-deployed
2021/12/22 13:38:51 No eventing-con process running
2021/12/22 13:38:51 Function: TestOnDeleteBucketOp5K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K deleting in background"
}
2021/12/22 13:38:53 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:38:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:39:00 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:39:10 Waiting for dst bucket item count to get to: 0 curr count: 3122
2021/12/22 13:39:15 Waiting for dst bucket item count to get to: 0 curr count: 3122
2021/12/22 13:39:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp5K (89.84s)
=== RUN   TestTimerBucketOp
2021/12/22 13:39:25 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/22 13:39:25 App: TestTimerBucketOp got un-deployed
2021/12/22 13:39:25 No eventing-con process running
2021/12/22 13:39:25 Function: TestTimerBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerBucketOp not found"
}
2021/12/22 13:39:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:39:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:39:34 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:39:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:39:39 Deploying app: TestTimerBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:39:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp stored in temp store"
}
2021/12/22 13:39:40 Starting bucket ops to source bucket
2021/12/22 13:39:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:39:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:39:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:40:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:40:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:40:13 Waiting for dst bucket item count to get to: 5000 curr count: 11
2021/12/22 13:40:18 Waiting for dst bucket item count to get to: 5000 curr count: 4299
2021/12/22 13:40:23 Waiting for dst bucket item count to get to: 5000 curr count: 4299
2021/12/22 13:40:23 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:40:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:40:28 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/22 13:40:33 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/22 13:40:38 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/22 13:40:43 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/22 13:40:43 App: TestTimerBucketOp got un-deployed
2021/12/22 13:40:43 No eventing-con process running
2021/12/22 13:40:43 Function: TestTimerBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp deleting in background"
}
2021/12/22 13:40:45 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:40:55 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 13:40:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:40:57 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:41:07 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 13:41:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerBucketOp (111.53s)
=== RUN   TestTimerInPastBucketOp
2021/12/22 13:41:17 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/22 13:41:17 App: TestTimerInPastBucketOp got un-deployed
2021/12/22 13:41:17 No eventing-con process running
2021/12/22 13:41:17 Function: TestTimerInPastBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerInPastBucketOp not found"
}
2021/12/22 13:41:19 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:41:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:41:25 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:41:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:41:30 Deploying app: TestTimerInPastBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:41:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp stored in temp store"
}
2021/12/22 13:41:32 Starting bucket ops to source bucket
2021/12/22 13:41:39 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:41:44 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:41:49 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:41:54 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:41:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:42:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:42:10 Waiting for dst bucket item count to get to: 5000 curr count: 3663
2021/12/22 13:42:15 Waiting for dst bucket item count to get to: 5000 curr count: 3663
2021/12/22 13:42:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:42:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:42:20 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/22 13:42:25 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/22 13:42:30 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/22 13:42:35 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/22 13:42:35 App: TestTimerInPastBucketOp got un-deployed
2021/12/22 13:42:35 No eventing-con process running
2021/12/22 13:42:35 Function: TestTimerInPastBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp deleting in background"
}
2021/12/22 13:42:37 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:42:47 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 13:42:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:42:48 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:42:58 Waiting for dst bucket item count to get to: 0 curr count: 4192
2021/12/22 13:43:03 Waiting for dst bucket item count to get to: 0 curr count: 1692
2021/12/22 13:43:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerInPastBucketOp (116.57s)
=== RUN   TestDeployUndeployLoopTimer
2021/12/22 13:43:13 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:43:13 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/22 13:43:13 No eventing-con process running
2021/12/22 13:43:13 Function: TestDeployUndeployLoopTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopTimer not found"
}
2021/12/22 13:43:15 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:43:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:43:22 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:43:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:43:27 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:43:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/22 13:43:28 Starting bucket ops to source bucket
2021/12/22 13:43:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:43:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:43:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:43:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:43:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:44:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:44:06 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/22 13:44:06 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:44:11 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/22 13:44:11 App: TestDeployUndeployLoopTimer got deployed
2021/12/22 13:44:11 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:44:11 Undeploying app: bucket_op_with_timer
2021/12/22 13:44:16 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:44:21 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:44:26 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:44:31 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:44:31 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/22 13:44:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:44:31 No eventing-con process running
2021/12/22 13:44:33 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:44:40 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:45:15 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:45:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/22 13:45:17 Starting bucket ops to source bucket
2021/12/22 13:45:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:45:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:45:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:45:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:45:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:45:50 Waiting for dst bucket item count to get to: 5000 curr count: 917
2021/12/22 13:45:55 Waiting for dst bucket item count to get to: 5000 curr count: 917
2021/12/22 13:45:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:46:00 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/22 13:46:00 App: TestDeployUndeployLoopTimer got deployed
2021/12/22 13:46:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:46:00 Undeploying app: bucket_op_with_timer
2021/12/22 13:46:05 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:46:10 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:46:15 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:46:20 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:46:20 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/22 13:46:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:46:20 No eventing-con process running
2021/12/22 13:46:22 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:46:29 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:47:04 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:47:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/22 13:47:05 Starting bucket ops to source bucket
2021/12/22 13:47:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:47:18 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:47:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:47:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:47:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:47:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:47:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:47:43 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:47:48 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/22 13:47:48 App: TestDeployUndeployLoopTimer got deployed
2021/12/22 13:47:48 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:47:48 Undeploying app: bucket_op_with_timer
2021/12/22 13:47:53 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:47:58 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:48:03 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:48:08 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:48:08 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/22 13:48:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:48:08 No eventing-con process running
2021/12/22 13:48:10 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:48:17 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:48:52 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:48:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/22 13:48:53 Starting bucket ops to source bucket
2021/12/22 13:49:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:49:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:49:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:49:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:49:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:49:26 Waiting for dst bucket item count to get to: 5000 curr count: 20
2021/12/22 13:49:31 Waiting for dst bucket item count to get to: 5000 curr count: 628
2021/12/22 13:49:36 Waiting for dst bucket item count to get to: 5000 curr count: 3108
2021/12/22 13:49:37 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:49:42 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/22 13:49:42 App: TestDeployUndeployLoopTimer got deployed
2021/12/22 13:49:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:49:42 Undeploying app: bucket_op_with_timer
2021/12/22 13:49:47 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:49:52 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:49:57 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:50:02 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:50:02 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/22 13:50:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:50:02 No eventing-con process running
2021/12/22 13:50:03 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:50:11 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:50:46 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:50:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/22 13:50:47 Starting bucket ops to source bucket
2021/12/22 13:50:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:51:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:51:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:51:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:51:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:51:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:51:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:51:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:51:30 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/22 13:51:30 App: TestDeployUndeployLoopTimer got deployed
2021/12/22 13:51:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:51:30 Undeploying app: bucket_op_with_timer
2021/12/22 13:51:35 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:51:40 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:51:45 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:51:50 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/22 13:51:50 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/22 13:51:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:51:50 No eventing-con process running
2021/12/22 13:51:52 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:51:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:52:34 Function: TestDeployUndeployLoopTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer deleting in background"
}
--- PASS: TestDeployUndeployLoopTimer (570.73s)
=== RUN   TestMultipleHandlers
2021/12/22 13:52:44 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/22 13:52:44 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2021/12/22 13:52:44 No eventing-con process running
2021/12/22 13:52:44 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_update not found"
}
2021/12/22 13:52:46 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:52:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:52:53 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:52:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:53:03 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/22 13:53:03 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2021/12/22 13:53:03 No eventing-con process running
2021/12/22 13:53:03 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_delete not found"
}
2021/12/22 13:53:05 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:53:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:53:11 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:53:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:53:16 Deploying app: TestMultipleHandlers_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:53:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update stored in temp store"
}
2021/12/22 13:53:17 Deploying app: TestMultipleHandlers_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:53:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete stored in temp store"
}
2021/12/22 13:53:24 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/22 13:53:29 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/22 13:53:34 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/22 13:53:39 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/22 13:53:39 App: TestMultipleHandlers_bucket_op_on_update got deployed
2021/12/22 13:53:44 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/22 13:53:49 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/22 13:53:54 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/22 13:53:54 App: TestMultipleHandlers_bucket_op_on_delete got deployed
2021/12/22 13:53:54 Starting bucket ops to source bucket
2021/12/22 13:54:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:54:09 Waiting for dst bucket item count to get to: 5000 curr count: 4205
2021/12/22 13:54:14 Waiting for dst bucket item count to get to: 5000 curr count: 4205
2021/12/22 13:54:14 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:54:14 Starting bucket ops to source bucket
2021/12/22 13:54:29 Waiting for dst bucket item count to get to: 10000 curr count: 5313
2021/12/22 13:54:34 Waiting for dst bucket item count to get to: 10000 curr count: 7817
2021/12/22 13:54:34 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 13:54:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:54:34 Function: TestMultipleHandlers_bucket_op_on_update update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:54:34 Function: TestMultipleHandlers_bucket_op_on_delete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:54:39 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/22 13:54:44 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/22 13:54:49 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/22 13:54:54 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/22 13:54:54 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2021/12/22 13:54:54 No eventing-con process running
2021/12/22 13:54:54 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update deleting in background"
}
2021/12/22 13:54:56 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:55:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:55:03 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:55:13 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/22 13:55:18 Waiting for dst bucket item count to get to: 0 curr count: 4996
2021/12/22 13:55:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:55:23 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/22 13:55:28 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/22 13:55:33 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/22 13:55:38 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/22 13:55:38 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2021/12/22 13:55:38 No eventing-con process running
2021/12/22 13:55:38 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete deleting in background"
}
2021/12/22 13:55:40 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:55:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:55:47 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:55:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMultipleHandlers (197.80s)
=== RUN   TestPauseResumeLoopDefaultSettings
2021/12/22 13:56:02 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/22 13:56:02 App: TestPauseResumeLoopDefaultSettings got un-deployed
2021/12/22 13:56:02 No eventing-con process running
2021/12/22 13:56:02 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopDefaultSettings not found"
}
2021/12/22 13:56:04 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:56:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:56:11 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:56:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:56:16 Deploying app: TestPauseResumeLoopDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/22 13:56:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings stored in temp store"
}
2021/12/22 13:56:17 Starting bucket ops to source bucket
2021/12/22 13:56:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:56:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:56:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 13:56:40 Waiting for dst bucket item count to get to: 5000 curr count: 1457
2021/12/22 13:56:45 Waiting for dst bucket item count to get to: 5000 curr count: 1457
2021/12/22 13:56:45 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 13:56:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:56:50 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/22 13:56:50 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/22 13:56:50 Pausing app: bucket_op_on_update
2021/12/22 13:56:50 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:56:55 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/22 13:56:55 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/22 13:56:55 Resuming app: bucket_op_on_update
2021/12/22 13:56:56 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:56:56 Starting bucket ops to source bucket
2021/12/22 13:57:04 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 13:57:09 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 13:57:14 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 13:57:14 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 13:57:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:57:19 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/22 13:57:19 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/22 13:57:19 Pausing app: bucket_op_on_update
2021/12/22 13:57:19 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:57:24 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/22 13:57:24 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/22 13:57:24 Resuming app: bucket_op_on_update
2021/12/22 13:57:25 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:57:25 Starting bucket ops to source bucket
2021/12/22 13:57:33 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/22 13:57:38 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/22 13:57:43 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/22 13:57:43 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2021/12/22 13:57:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:57:48 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/22 13:57:48 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/22 13:57:48 Pausing app: bucket_op_on_update
2021/12/22 13:57:48 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:57:53 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/22 13:57:53 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/22 13:57:53 Resuming app: bucket_op_on_update
2021/12/22 13:57:54 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:57:54 Starting bucket ops to source bucket
2021/12/22 13:58:02 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/22 13:58:07 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/22 13:58:12 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/22 13:58:17 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2021/12/22 13:58:17 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/22 13:58:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:58:22 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/22 13:58:22 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/22 13:58:22 Pausing app: bucket_op_on_update
2021/12/22 13:58:23 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:58:28 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/22 13:58:28 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/22 13:58:28 Resuming app: bucket_op_on_update
2021/12/22 13:58:29 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:58:29 Starting bucket ops to source bucket
2021/12/22 13:58:37 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/22 13:58:42 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/22 13:58:47 Waiting for dst bucket item count to get to: 25000 curr count: 22376
2021/12/22 13:58:52 Waiting for dst bucket item count to get to: 25000 curr count: 24876
2021/12/22 13:58:52 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/22 13:58:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 13:58:57 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/22 13:58:57 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/22 13:58:57 Pausing app: bucket_op_on_update
2021/12/22 13:58:57 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 13:59:02 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/22 13:59:02 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/22 13:59:07 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/22 13:59:12 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/22 13:59:17 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/22 13:59:22 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/22 13:59:22 App: TestPauseResumeLoopDefaultSettings got un-deployed
2021/12/22 13:59:22 No eventing-con process running
2021/12/22 13:59:22 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings deleting in background"
}
2021/12/22 13:59:24 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:59:34 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/22 13:59:39 Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/22 13:59:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 13:59:41 Context: Bucket flush, response code: 200 dump: 
2021/12/22 13:59:51 Waiting for dst bucket item count to get to: 0 curr count: 21906
2021/12/22 13:59:56 Waiting for dst bucket item count to get to: 0 curr count: 21906
2021/12/22 13:59:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopDefaultSettings (243.70s)
=== RUN   TestPauseResumeLoopNonDefaultSettings
2021/12/22 14:00:06 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/22 14:00:06 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2021/12/22 14:00:06 No eventing-con process running
2021/12/22 14:00:06 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopNonDefaultSettings not found"
}
2021/12/22 14:00:07 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:00:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:00:14 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:00:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:00:19 Deploying app: TestPauseResumeLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:00:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings stored in temp store"
}
2021/12/22 14:00:20 Starting bucket ops to source bucket
2021/12/22 14:00:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:00:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:00:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:00:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:00:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:00:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:00:58 Waiting for dst bucket item count to get to: 5000 curr count: 3188
2021/12/22 14:01:03 Waiting for dst bucket item count to get to: 5000 curr count: 3188
2021/12/22 14:01:03 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:01:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:01:08 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/22 14:01:08 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/22 14:01:08 Pausing app: bucket_op_with_timer
2021/12/22 14:01:08 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:01:13 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/22 14:01:14 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/22 14:01:14 Resuming app: bucket_op_with_timer
2021/12/22 14:01:15 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:01:15 Starting bucket ops to source bucket
2021/12/22 14:01:23 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:01:28 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:01:33 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:01:38 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:01:43 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:01:48 Waiting for dst bucket item count to get to: 10000 curr count: 9247
2021/12/22 14:01:53 Waiting for dst bucket item count to get to: 10000 curr count: 9247
2021/12/22 14:01:53 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 14:01:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:01:58 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/22 14:01:58 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/22 14:01:58 Pausing app: bucket_op_with_timer
2021/12/22 14:01:58 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:02:03 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/22 14:02:03 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/22 14:02:03 Resuming app: bucket_op_with_timer
2021/12/22 14:02:04 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:02:04 Starting bucket ops to source bucket
2021/12/22 14:02:12 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/22 14:02:17 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/22 14:02:22 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/22 14:02:27 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/22 14:02:32 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/22 14:02:37 Waiting for dst bucket item count to get to: 15000 curr count: 14985
2021/12/22 14:02:42 Waiting for dst bucket item count to get to: 15000 curr count: 14985
2021/12/22 14:02:42 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2021/12/22 14:02:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:02:47 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/22 14:02:47 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/22 14:02:47 Pausing app: bucket_op_with_timer
2021/12/22 14:02:47 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:02:52 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/22 14:02:52 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/22 14:02:52 Resuming app: bucket_op_with_timer
2021/12/22 14:02:53 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:02:53 Starting bucket ops to source bucket
2021/12/22 14:03:01 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/22 14:03:06 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/22 14:03:11 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/22 14:03:16 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/22 14:03:21 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/22 14:03:26 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/22 14:03:26 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/22 14:03:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:03:31 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/22 14:03:31 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/22 14:03:31 Pausing app: bucket_op_with_timer
2021/12/22 14:03:32 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:03:37 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/22 14:03:37 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/22 14:03:37 Resuming app: bucket_op_with_timer
2021/12/22 14:03:38 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:03:38 Starting bucket ops to source bucket
2021/12/22 14:03:46 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/22 14:03:51 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/22 14:03:56 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/22 14:04:01 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/22 14:04:06 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/22 14:04:11 Waiting for dst bucket item count to get to: 25000 curr count: 20376
2021/12/22 14:04:16 Waiting for dst bucket item count to get to: 25000 curr count: 22876
2021/12/22 14:04:16 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/22 14:04:16 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:04:21 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/22 14:04:21 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/22 14:04:21 Pausing app: bucket_op_with_timer
2021/12/22 14:04:21 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:04:26 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/22 14:04:26 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/22 14:04:31 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/22 14:04:36 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/22 14:04:41 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/22 14:04:46 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/22 14:04:46 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2021/12/22 14:04:46 No eventing-con process running
2021/12/22 14:04:46 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings deleting in background"
}
2021/12/22 14:04:48 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:04:58 Waiting for dst bucket item count to get to: 0 curr count: 15690
2021/12/22 14:05:03 Waiting for dst bucket item count to get to: 0 curr count: 3190
2021/12/22 14:05:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:05:05 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:05:15 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/22 14:05:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopNonDefaultSettings (319.00s)
=== RUN   TestPauseAndResumeWithWorkerCountChange
2021/12/22 14:05:25 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/22 14:05:25 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2021/12/22 14:05:25 No eventing-con process running
2021/12/22 14:05:25 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseAndResumeWithWorkerCountChange not found"
}
2021/12/22 14:05:26 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:05:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:05:33 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:05:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:05:38 Deploying app: TestPauseAndResumeWithWorkerCountChange. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:05:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange stored in temp store"
}
2021/12/22 14:05:44 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/22 14:05:49 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/22 14:05:54 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/22 14:05:59 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/22 14:05:59 App: TestPauseAndResumeWithWorkerCountChange got deployed
2021/12/22 14:05:59 Starting bucket ops to source bucket
2021/12/22 14:06:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:06:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:06:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:06:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:06:29 Waiting for dst bucket item count to get to: 5000 curr count: 631
2021/12/22 14:06:34 Waiting for dst bucket item count to get to: 5000 curr count: 1262
2021/12/22 14:06:39 Waiting for dst bucket item count to get to: 5000 curr count: 3131
2021/12/22 14:06:39 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:06:39 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:06:39 Pausing app: bucket_op_with_timer
2021/12/22 14:06:39 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:06:44 Waiting for function: TestPauseAndResumeWithWorkerCountChange status to change to paused
2021/12/22 14:06:44 Function: TestPauseAndResumeWithWorkerCountChange status changed to paused
2021/12/22 14:06:44 Resuming app: bucket_op_with_timer
2021/12/22 14:06:45 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:06:45 Starting bucket ops to source bucket
2021/12/22 14:06:57 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:07:02 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:07:07 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:07:12 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:07:17 Waiting for dst bucket item count to get to: 10000 curr count: 7566
2021/12/22 14:07:22 Waiting for dst bucket item count to get to: 10000 curr count: 7566
2021/12/22 14:07:22 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 14:07:27 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/22 14:07:32 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/22 14:07:37 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/22 14:07:42 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/22 14:07:42 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2021/12/22 14:07:42 No eventing-con process running
2021/12/22 14:07:42 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange deleting in background"
}
2021/12/22 14:07:44 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:07:54 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/22 14:07:59 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:07:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:08:00 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:08:10 Waiting for dst bucket item count to get to: 0 curr count: 8233
2021/12/22 14:08:15 Waiting for dst bucket item count to get to: 0 curr count: 8233
2021/12/22 14:08:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseAndResumeWithWorkerCountChange (180.76s)
=== RUN   TestPauseResumeWithEventingReb
2021/12/22 14:08:25 Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/22 14:08:25 App: TestPauseResumeWithEventingReb got un-deployed
2021/12/22 14:08:25 No eventing-con process running
2021/12/22 14:08:25 Function: TestPauseResumeWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeWithEventingReb not found"
}
2021/12/22 14:08:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:08:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:08:34 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:08:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:08:39 Deploying app: TestPauseResumeWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:08:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb stored in temp store"
}
2021/12/22 14:08:45 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/22 14:08:50 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/22 14:08:55 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/22 14:09:00 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/22 14:09:00 App: TestPauseResumeWithEventingReb got deployed
2021/12/22 14:09:00 Starting bucket ops to source bucket
2021/12/22 14:09:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:09:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:09:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:09:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:09:29 Waiting for dst bucket item count to get to: 5000 curr count: 2655
2021/12/22 14:09:34 Waiting for dst bucket item count to get to: 5000 curr count: 2655
2021/12/22 14:09:34 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:09:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:09:34 Pausing app: bucket_op_with_timer
2021/12/22 14:09:35 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:09:40 Waiting for function: TestPauseResumeWithEventingReb status to change to paused
2021/12/22 14:09:40 Function: TestPauseResumeWithEventingReb status changed to paused
2021/12/22 14:09:40 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/22 14:09:40 Removing node(s): [] from the cluster
2021/12/22 14:09:45 Rebalance progress: 29.16666666666666
2021/12/22 14:09:50 Rebalance progress: 29.16666666666666
2021/12/22 14:09:55 Rebalance progress: 100
2021/12/22 14:09:55 Resuming app: bucket_op_with_timer
2021/12/22 14:09:56 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:09:56 Starting bucket ops to source bucket
2021/12/22 14:10:08 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:10:13 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:10:18 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:10:23 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/22 14:10:28 Waiting for dst bucket item count to get to: 10000 curr count: 6163
2021/12/22 14:10:33 Waiting for dst bucket item count to get to: 10000 curr count: 6163
2021/12/22 14:10:33 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 14:10:33 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/22 14:10:38 Rebalance progress: 29.16666666666666
2021/12/22 14:10:43 Rebalance progress: 29.16666666666666
2021/12/22 14:10:48 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2021/12/22 14:10:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:11:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:11:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:11:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:11:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:12:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:12:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:12:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:12:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:13:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:13:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:13:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 14:13:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:55} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 47519c98cb7ec87dcd295870fe0c0b96
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [57-113]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [114-170]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [171-227]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [228-284]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 57
	v: [285-341]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [0-56]
Producer node: 172.31.2.134:9300	Node UUID: b4664f38ed3f283981d177ce421d1c2a
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [854-910]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [911-967]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [968-1023]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [683-739]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [740-796]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [797-853]
Producer node: 127.0.0.1:9303	Node UUID: 4b762506c3d6f4f85c1cf4b9e8c4d9ae
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [399-455]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [456-512]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [513-569]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [570-626]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [627-682]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [342-398]


2021/12/22 14:14:08 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:14:13 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/22 14:14:18 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/22 14:14:23 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/22 14:14:28 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/22 14:14:28 clusterSetup.go:405: App: TestPauseResumeWithEventingReb got un-deployed
2021/12/22 14:14:28 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:14:28 eventingSetup.go:418: Function: TestPauseResumeWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb deleting in background"
}
2021/12/22 14:14:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:14:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7104
2021/12/22 14:14:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7104
2021/12/22 14:14:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:14:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:14:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/22 14:14:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeWithEventingReb (401.66s)
=== RUN   TestBucketDeleteAfterPause
2021/12/22 14:15:07 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2021/12/22 14:15:07 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2021/12/22 14:15:07 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:15:07 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteAfterPause not found"
}
2021/12/22 14:15:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:15:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:15:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:15:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:15:21 eventingSetup.go:125: Deploying app: TestBucketDeleteAfterPause. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:15:22 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause stored in temp store"
}
2021/12/22 14:15:27 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/22 14:15:32 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/22 14:15:37 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/22 14:15:42 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/22 14:15:42 clusterSetup.go:354: App: TestBucketDeleteAfterPause got deployed
2021/12/22 14:15:42 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:15:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:15:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:15:52 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:15:52 handler_test.go:712: Pausing app: bucket_op_on_update
2021/12/22 14:15:52 eventingSetup.go:270: Function: TestBucketDeleteAfterPause update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:15:57 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to paused
2021/12/22 14:15:57 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to paused
2021/12/22 14:15:57 handler_test.go:716: Deleting source bucket: default
2021/12/22 14:16:03 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to undeployed
2021/12/22 14:16:03 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to undeployed
2021/12/22 14:16:08 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2021/12/22 14:16:08 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2021/12/22 14:16:08 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:16:08 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause deleting in background"
}
2021/12/22 14:16:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:16:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:16:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:16:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:16:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketDeleteAfterPause (89.06s)
=== RUN   TestChangeFnCodeBetweenPauseResume
2021/12/22 14:16:36 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/22 14:16:36 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2021/12/22 14:16:36 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:16:36 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestChangeFnCodeBetweenPauseResume not found"
}
2021/12/22 14:16:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:16:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:16:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:16:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:16:49 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:16:50 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2021/12/22 14:16:55 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/22 14:17:00 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/22 14:17:05 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/22 14:17:10 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/22 14:17:10 clusterSetup.go:354: App: TestChangeFnCodeBetweenPauseResume got deployed
2021/12/22 14:17:10 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:17:45 handler_test.go:739: Pausing function: TestChangeFnCodeBetweenPauseResume
2021/12/22 14:17:46 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:17:51 eventingSetup.go:719: Waiting for function: TestChangeFnCodeBetweenPauseResume status to change to paused
2021/12/22 14:17:51 eventingSetup.go:727: Function: TestChangeFnCodeBetweenPauseResume status changed to paused
2021/12/22 14:20:51 handler_test.go:748: Resuming function: TestChangeFnCodeBetweenPauseResume
2021/12/22 14:20:51 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 5000 dst bucket: 0
2021/12/22 14:20:52 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2021/12/22 14:20:57 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/22 14:20:57 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:20:57 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 0 expected 5000
2021/12/22 14:21:02 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/22 14:21:02 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:21:02 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 3156 expected 5000
2021/12/22 14:21:07 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/22 14:21:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:21:07 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 4452 expected 5000
2021/12/22 14:21:12 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/22 14:21:12 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:21:12 eventingSetup.go:804: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 5000
2021/12/22 14:21:12 handler_test.go:753: Undeploying function: TestChangeFnCodeBetweenPauseResume
2021/12/22 14:21:12 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:21:22 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/22 14:21:27 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/22 14:21:32 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/22 14:21:32 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2021/12/22 14:21:32 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:21:32 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume deleting in background"
}
2021/12/22 14:21:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:21:43 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:21:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 14:21:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:21:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:21:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestChangeFnCodeBetweenPauseResume (329.09s)
=== RUN   TestCommentUnCommentOnDelete
2021/12/22 14:22:05 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/22 14:22:05 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2021/12/22 14:22:05 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:22:05 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCommentUnCommentOnDelete not found"
}
2021/12/22 14:22:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:22:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:22:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:22:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:22:18 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:22:20 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2021/12/22 14:22:25 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/22 14:22:30 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/22 14:22:35 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/22 14:22:40 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/22 14:22:40 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2021/12/22 14:22:40 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:22:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:22:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:22:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/22 14:22:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:22:59 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:22:59 handler_test.go:780: Undeploying app: TestCommentUnCommentOnDelete
2021/12/22 14:22:59 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:23:29 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 5000 dst bucket: 5000
2021/12/22 14:23:30 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2021/12/22 14:23:35 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/22 14:23:40 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/22 14:23:45 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/22 14:23:50 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/22 14:23:50 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2021/12/22 14:23:50 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:24:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:24:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 242
2021/12/22 14:24:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 242
2021/12/22 14:24:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:24:13 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:24:13 handler_test.go:799: Undeploying app: TestCommentUnCommentOnDelete
2021/12/22 14:24:13 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:24:23 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/22 14:24:28 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/22 14:24:33 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/22 14:24:33 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2021/12/22 14:24:33 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:24:33 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete deleting in background"
}
2021/12/22 14:24:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:24:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:24:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:24:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCommentUnCommentOnDelete (170.54s)
=== RUN   TestCPPWorkerCleanup
2021/12/22 14:24:56 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/22 14:24:56 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2021/12/22 14:24:56 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:24:56 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCPPWorkerCleanup not found"
}
2021/12/22 14:24:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:25:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:25:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:25:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:25:09 eventingSetup.go:125: Deploying app: TestCPPWorkerCleanup. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:25:10 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup stored in temp store"
}
2021/12/22 14:25:10 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:25:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:25:22 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:25:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:25:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:25:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2399
2021/12/22 14:25:42 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4899
2021/12/22 14:25:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:25:42 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:25:47 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/22 14:25:52 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/22 14:25:57 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/22 14:26:03 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/22 14:26:03 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2021/12/22 14:26:03 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:26:03 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup deleting in background"
}
2021/12/22 14:26:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:26:14 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:26:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 14:26:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:26:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:26:31 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4266
2021/12/22 14:26:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4266
2021/12/22 14:26:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCPPWorkerCleanup (139.79s)
=== RUN   TestWithUserXattrs
2021/12/22 14:27:16 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/22 14:27:16 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2021/12/22 14:27:16 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:27:16 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestWithUserXattrs not found"
}
2021/12/22 14:27:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:27:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:27:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:27:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:27:29 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:27:31 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:27:33 eventingSetup.go:125: Deploying app: TestWithUserXattrs. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:27:34 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs stored in temp store"
}
2021/12/22 14:27:39 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/22 14:27:44 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/22 14:27:49 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/22 14:27:54 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/22 14:27:54 clusterSetup.go:354: App: TestWithUserXattrs got deployed
2021/12/22 14:27:54 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:28:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:28:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1889
2021/12/22 14:28:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4389
2021/12/22 14:28:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:28:13 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:28:18 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/22 14:28:23 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/22 14:28:28 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/22 14:28:33 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/22 14:28:33 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2021/12/22 14:28:33 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:28:33 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs deleting in background"
}
2021/12/22 14:28:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:28:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:28:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:28:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:28:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:28:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestWithUserXattrs (110.90s)
=== RUN   TestEventProcessingPostBucketFlush
2021/12/22 14:29:06 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/22 14:29:07 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/22 14:29:07 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:29:07 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventProcessingPostBucketFlush not found"
}
2021/12/22 14:29:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:29:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:29:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:29:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:29:20 eventingSetup.go:125: Deploying app: TestEventProcessingPostBucketFlush. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:29:21 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush stored in temp store"
}
2021/12/22 14:29:26 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/22 14:29:31 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/22 14:29:36 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/22 14:29:41 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/22 14:29:41 clusterSetup.go:354: App: TestEventProcessingPostBucketFlush got deployed
2021/12/22 14:29:41 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:29:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:29:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:29:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:29:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:29:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:30:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2793
2021/12/22 14:30:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 293
2021/12/22 14:30:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:30:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:30:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:30:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:30:25 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:30:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 16748
2021/12/22 14:30:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 16748
2021/12/22 14:30:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/22 14:30:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:30:55 eventingSetup.go:270: Function: TestEventProcessingPostBucketFlush update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:31:00 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/22 14:31:05 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/22 14:31:10 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/22 14:31:15 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/22 14:31:15 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/22 14:31:15 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:31:20 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/22 14:31:20 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/22 14:31:20 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:31:20 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush deleting in background"
}
2021/12/22 14:31:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:31:31 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/22 14:31:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/22 14:31:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:31:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:31:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 18004
2021/12/22 14:31:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5504
2021/12/22 14:31:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventProcessingPostBucketFlush (176.59s)
=== RUN   TestMetaBucketDelete
2021/12/22 14:32:03 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/22 14:32:03 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/22 14:32:03 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:32:03 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDelete not found"
}
2021/12/22 14:32:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:32:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:32:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:32:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:32:16 eventingSetup.go:125: Deploying app: TestMetaBucketDelete. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:32:17 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete stored in temp store"
}
2021/12/22 14:32:22 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/22 14:32:27 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/22 14:32:32 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/22 14:32:37 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/22 14:32:37 clusterSetup.go:354: App: TestMetaBucketDelete got deployed
2021/12/22 14:32:37 handler_test.go:902: Deleting metadata bucket: eventing
2021/12/22 14:32:39 handler_test.go:904: Deleted metadata bucket: eventing
2021/12/22 14:32:44 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/22 14:32:44 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/22 14:32:59 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/22 14:32:59 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/22 14:32:59 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:32:59 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete deleting in background"
}
2021/12/22 14:33:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:33:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:33:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:33:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDelete (78.80s)
=== RUN   TestMetaBucketDeleteWithBootstrap
2021/12/22 14:33:22 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/22 14:33:22 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/22 14:33:22 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:33:22 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDeleteWithBootstrap not found"
}
2021/12/22 14:33:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:33:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:33:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:33:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:33:35 eventingSetup.go:125: Deploying app: TestMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:33:36 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap stored in temp store"
}
2021/12/22 14:33:55 handler_test.go:923: Deleting metadata bucket: eventing
2021/12/22 14:33:56 handler_test.go:925: Deleted metadata bucket: eventing
2021/12/22 14:34:11 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/22 14:34:11 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/22 14:34:26 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/22 14:34:26 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/22 14:34:26 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:34:26 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap deleting in background"
}
2021/12/22 14:34:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:34:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:34:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:34:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDeleteWithBootstrap (87.02s)
=== RUN   TestSourceBucketDelete
2021/12/22 14:34:49 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/22 14:34:49 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/22 14:34:49 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:34:49 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDelete not found"
}
2021/12/22 14:34:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:34:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:34:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:35:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:35:02 eventingSetup.go:125: Deploying app: TestSourceBucketDelete. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:35:03 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete stored in temp store"
}
2021/12/22 14:35:08 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/22 14:35:13 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/22 14:35:18 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/22 14:35:23 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/22 14:35:23 clusterSetup.go:354: App: TestSourceBucketDelete got deployed
2021/12/22 14:35:23 handler_test.go:945: Deleting source bucket: default
2021/12/22 14:35:25 handler_test.go:947: Deleted source bucket: default
2021/12/22 14:35:30 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/22 14:35:30 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/22 14:35:45 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/22 14:35:45 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/22 14:35:45 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:35:45 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete deleting in background"
}
2021/12/22 14:35:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:35:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:35:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:35:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDelete (79.32s)
=== RUN   TestSourceBucketDeleteWithBootstrap
2021/12/22 14:36:08 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/22 14:36:08 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/22 14:36:08 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:36:08 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDeleteWithBootstrap not found"
}
2021/12/22 14:36:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:36:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:36:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:36:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:36:21 eventingSetup.go:125: Deploying app: TestSourceBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:36:22 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap stored in temp store"
}
2021/12/22 14:36:41 handler_test.go:966: Deleting source bucket: default
2021/12/22 14:36:43 handler_test.go:968: Deleted source bucket: default
2021/12/22 14:36:58 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/22 14:36:58 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/22 14:37:13 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/22 14:37:13 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/22 14:37:13 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:37:13 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap deleting in background"
}
2021/12/22 14:37:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:37:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:37:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:37:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDeleteWithBootstrap (87.59s)
=== RUN   TestSourceAndMetaBucketDeleteWithBootstrap
2021/12/22 14:37:36 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/22 14:37:36 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/22 14:37:36 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:37:36 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceAndMetaBucketDeleteWithBootstrap not found"
}
2021/12/22 14:37:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:37:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:37:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:37:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:37:49 eventingSetup.go:125: Deploying app: TestSourceAndMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:37:50 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap stored in temp store"
}
2021/12/22 14:38:09 handler_test.go:988: Deleting source bucket: default
2021/12/22 14:38:10 handler_test.go:990: Deleted source bucket: default
2021/12/22 14:38:10 handler_test.go:992: Deleting metadata bucket: eventing
2021/12/22 14:38:11 handler_test.go:994: Deleted metadata bucket: eventing
2021/12/22 14:38:26 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/22 14:38:26 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/22 14:38:41 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/22 14:38:41 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/22 14:38:41 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:38:41 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap deleting in background"
}
2021/12/22 14:38:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:38:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:38:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:38:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceAndMetaBucketDeleteWithBootstrap (88.21s)
=== RUN   TestUndeployDuringBootstrap
2021/12/22 14:39:04 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/22 14:39:04 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/22 14:39:04 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:39:04 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployDuringBootstrap not found"
}
2021/12/22 14:39:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:39:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:39:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:39:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:39:17 eventingSetup.go:125: Deploying app: TestUndeployDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:39:18 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap stored in temp store"
}
2021/12/22 14:39:18 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:39:30 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:39:31 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/22 14:39:31 clusterSetup.go:378: App: TestUndeployDuringBootstrap started bootstrap
2021/12/22 14:39:31 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/22 14:39:36 clusterSetup.go:367: No apps undergoing bootstrap
2021/12/22 14:39:41 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/22 14:39:46 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/22 14:39:51 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/22 14:39:51 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/22 14:39:51 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:40:16 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/22 14:40:16 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/22 14:40:16 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:40:16 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap deleting in background"
}
2021/12/22 14:40:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:40:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:40:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:40:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:40:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3883
2021/12/22 14:40:44 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1383
2021/12/22 14:40:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployDuringBootstrap (109.63s)
=== RUN   TestDeleteBeforeUndeploy
2021/12/22 14:40:49 eventingSetup.go:125: Deploying app: TestDeleteBeforeUndeploy. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:40:50 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy stored in temp store"
}
2021/12/22 14:40:55 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/22 14:41:00 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/22 14:41:05 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/22 14:41:10 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/22 14:41:10 clusterSetup.go:354: App: TestDeleteBeforeUndeploy got deployed
2021/12/22 14:41:10 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 422 dump: {
 "name": "ERR_APP_NOT_UNDEPLOYED",
 "code": 22,
 "description": "Function: TestDeleteBeforeUndeploy skipping delete request as it hasn't been undeployed"
}
2021/12/22 14:41:10 eventingSetup.go:270: Function: TestDeleteBeforeUndeploy update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:41:10 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy deleting in background"
}
2021/12/22 14:41:15 clusterSetup.go:397: Waiting for app: TestDeleteBeforeUndeploy to get un-deployed
2021/12/22 14:41:15 clusterSetup.go:405: App: TestDeleteBeforeUndeploy got un-deployed
2021/12/22 14:41:15 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:41:15 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeleteBeforeUndeploy not found"
}
2021/12/22 14:41:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:41:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:41:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:41:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDeleteBeforeUndeploy (44.59s)
=== RUN   TestUndeployWhenTimersAreFired
2021/12/22 14:41:38 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/22 14:41:38 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/22 14:41:38 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:41:38 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWhenTimersAreFired not found"
}
2021/12/22 14:41:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:41:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:41:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:41:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:41:51 eventingSetup.go:125: Deploying app: TestUndeployWhenTimersAreFired. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:41:53 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired stored in temp store"
}
2021/12/22 14:41:58 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/22 14:42:03 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/22 14:42:08 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/22 14:42:13 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/22 14:42:13 clusterSetup.go:354: App: TestUndeployWhenTimersAreFired got deployed
2021/12/22 14:42:13 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:42:48 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/22 14:42:53 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/22 14:42:58 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/22 14:43:03 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/22 14:43:03 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/22 14:43:03 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:44:48 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/22 14:44:48 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/22 14:44:48 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:44:48 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired deleting in background"
}
2021/12/22 14:44:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:45:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 14:45:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 14:45:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:45:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:45:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:45:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWhenTimersAreFired (228.16s)
=== RUN   TestUndeployWithKVFailover
2021/12/22 14:45:26 clusterSetup.go:397: Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/22 14:45:26 clusterSetup.go:405: App: TestUndeployWithKVFailover got un-deployed
2021/12/22 14:45:26 eventingSetup.go:46: No eventing-con process running
2021/12/22 14:45:26 eventingSetup.go:418: Function: TestUndeployWithKVFailover delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWithKVFailover not found"
}
2021/12/22 14:45:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:45:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:45:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:45:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:45:40 eventingSetup.go:125: Deploying app: TestUndeployWithKVFailover. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:45:41 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover stored in temp store"
}
2021/12/22 14:45:41 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 14:45:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:45:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:45:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:46:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:46:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:46:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:46:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2553
2021/12/22 14:46:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2553
2021/12/22 14:46:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:46:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/22 14:46:23 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 14:46:28 Rebalance progress: 29.16666666666666
2021/12/22 14:46:33 Rebalance progress: 29.16666666666666
2021/12/22 14:46:38 Rebalance progress: 100
2021/12/22 14:46:38 Failing over: [127.0.0.1:19003]
2021/12/22 14:46:48 Function: TestUndeployWithKVFailover update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/22 14:47:48 Removing node(s): [] from the cluster
2021/12/22 14:47:54 Rebalance progress: 29.16666666666666
2021/12/22 14:47:59 Rebalance progress: 29.16666666666666
2021/12/22 14:48:04 Rebalance progress: 100
2021/12/22 14:48:09 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/22 14:48:09 App: TestUndeployWithKVFailover got un-deployed
2021/12/22 14:48:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:48:14 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/22 14:48:14 App: TestUndeployWithKVFailover got un-deployed
2021/12/22 14:48:14 No eventing-con process running
2021/12/22 14:48:14 Function: TestUndeployWithKVFailover delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover deleting in background"
}
2021/12/22 14:48:15 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:48:25 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:48:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:48:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:48:37 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:48:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWithKVFailover (200.26s)
=== RUN   TestBucketFlushWhileFnDeployed
2021/12/22 14:48:47 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/22 14:48:47 App: TestBucketFlushWhileFnDeployed got un-deployed
2021/12/22 14:48:47 No eventing-con process running
2021/12/22 14:48:47 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketFlushWhileFnDeployed not found"
}
2021/12/22 14:48:48 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:48:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:48:55 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:49:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:49:00 Deploying app: TestBucketFlushWhileFnDeployed. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:49:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed stored in temp store"
}
2021/12/22 14:49:06 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/22 14:49:11 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/22 14:49:16 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/22 14:49:21 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/22 14:49:21 App: TestBucketFlushWhileFnDeployed got deployed
2021/12/22 14:49:21 Starting bucket ops to source bucket
2021/12/22 14:49:41 Waiting for dst bucket item count to get to: 20000 curr count: 9491
2021/12/22 14:49:41 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/22 14:49:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:49:44 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:49:54 Waiting for dst bucket item count to get to: 0 curr count: 20000
2021/12/22 14:49:59 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/22 14:49:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:50:00 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:50:10 Waiting for dst bucket item count to get to: 0 curr count: 16130
2021/12/22 14:50:15 Waiting for dst bucket item count to get to: 0 curr count: 16130
2021/12/22 14:50:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:50:15 Starting bucket ops to source bucket
2021/12/22 14:50:28 Waiting for dst bucket item count to get to: 10000 curr count: 3711
2021/12/22 14:50:33 Waiting for dst bucket item count to get to: 10000 curr count: 3711
2021/12/22 14:50:33 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 14:50:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:50:38 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/22 14:50:43 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/22 14:50:48 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/22 14:50:53 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/22 14:50:53 App: TestBucketFlushWhileFnDeployed got un-deployed
2021/12/22 14:50:53 No eventing-con process running
2021/12/22 14:50:53 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed deleting in background"
}
2021/12/22 14:50:55 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:51:05 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/22 14:51:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:51:06 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:51:16 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/22 14:51:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketFlushWhileFnDeployed (159.66s)
=== RUN   TestTimerOverwrite
2021/12/22 14:51:26 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/22 14:51:26 App: TestTimerOverwrite got un-deployed
2021/12/22 14:51:26 No eventing-con process running
2021/12/22 14:51:26 Function: TestTimerOverwrite delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverwrite not found"
}
2021/12/22 14:51:28 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:51:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:51:34 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:51:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:51:39 Deploying app: TestTimerOverwrite. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:51:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite stored in temp store"
}
2021/12/22 14:51:46 Waiting for app: TestTimerOverwrite to get deployed
2021/12/22 14:51:51 Waiting for app: TestTimerOverwrite to get deployed
2021/12/22 14:51:56 Waiting for app: TestTimerOverwrite to get deployed
2021/12/22 14:52:01 Waiting for app: TestTimerOverwrite to get deployed
2021/12/22 14:52:01 App: TestTimerOverwrite got deployed
2021/12/22 14:52:11 Starting bucket ops to source bucket
2021/12/22 14:52:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:52:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:52:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:52:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:52:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:52:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:52:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:52:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:53:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:53:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:53:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:53:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 14:53:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:53:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:53:30 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/22 14:53:35 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/22 14:53:40 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/22 14:53:45 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/22 14:53:45 App: TestTimerOverwrite got un-deployed
2021/12/22 14:53:45 No eventing-con process running
2021/12/22 14:53:45 Function: TestTimerOverwrite delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite deleting in background"
}
2021/12/22 14:53:46 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:53:56 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:53:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:53:58 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:54:08 Waiting for dst bucket item count to get to: 0 curr count: 4015
2021/12/22 14:54:13 Waiting for dst bucket item count to get to: 0 curr count: 1535
2021/12/22 14:54:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverwrite (176.96s)
=== RUN   TestUndeployBackdoorDuringBootstrap
2021/12/22 14:54:18 Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/22 14:54:18 Removing node(s): [] from the cluster
2021/12/22 14:54:24 Rebalance progress: 100
2021/12/22 14:54:24 Failing over: [127.0.0.1:19003]
2021/12/22 14:54:29 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/22 14:54:29 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/22 14:54:29 No eventing-con process running
2021/12/22 14:54:29 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2021/12/22 14:54:30 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:54:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:54:37 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:54:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:54:42 Deploying app: TestUndeployBackdoorDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:54:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap stored in temp store"
}
2021/12/22 14:54:43 Starting bucket ops to source bucket
2021/12/22 14:54:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:54:53 Context: Post to set retry counter, response code: 200 dump: {
 "code": 0
}
2021/12/22 14:54:53 set retry counter, response &{[123 10 32 34 99 111 100 101 34 58 32 48 10 125] }
2021/12/22 14:55:58 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/22 14:55:58 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/22 14:55:58 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:55:58 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap deleting in background"
}
2021/12/22 14:56:03 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/22 14:56:03 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/22 14:56:03 No eventing-con process running
2021/12/22 14:56:03 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2021/12/22 14:56:04 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:56:14 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:56:19 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 14:56:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:56:21 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:56:31 Waiting for dst bucket item count to get to: 0 curr count: 2191
2021/12/22 14:56:36 Waiting for dst bucket item count to get to: 0 curr count: 2191
2021/12/22 14:56:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:56:36 Removing node(s): [] from the cluster
2021/12/22 14:56:41 Rebalance progress: 100
--- PASS: TestUndeployBackdoorDuringBootstrap (147.80s)
=== RUN   TestOnUpdateSrcMutation
2021/12/22 14:56:51 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/22 14:56:51 App: TestOnUpdateSrcMutation got un-deployed
2021/12/22 14:56:51 No eventing-con process running
2021/12/22 14:56:51 Function: TestOnUpdateSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutation not found"
}
2021/12/22 14:56:52 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:56:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:56:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:57:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:57:04 Deploying app: TestOnUpdateSrcMutation. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:57:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation stored in temp store"
}
2021/12/22 14:57:05 Starting bucket ops to source bucket
2021/12/22 14:57:32 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 14:57:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:57:37 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/22 14:57:43 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/22 14:57:48 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/22 14:57:53 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/22 14:57:53 App: TestOnUpdateSrcMutation got un-deployed
2021/12/22 14:57:53 No eventing-con process running
2021/12/22 14:57:53 Function: TestOnUpdateSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation deleting in background"
}
2021/12/22 14:57:54 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:58:04 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/22 14:58:09 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 14:58:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:58:11 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:58:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutation (94.59s)
=== RUN   TestOnDeleteSrcMutation
2021/12/22 14:58:26 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/22 14:58:26 App: TestOnDeleteSrcMutation got un-deployed
2021/12/22 14:58:26 No eventing-con process running
2021/12/22 14:58:26 Function: TestOnDeleteSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutation not found"
}
2021/12/22 14:58:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:58:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:58:34 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:58:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:58:39 Deploying app: TestOnDeleteSrcMutation. Item count src bucket: 0 dst bucket: 0
2021/12/22 14:58:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation stored in temp store"
}
2021/12/22 14:58:40 Starting bucket ops to source bucket
2021/12/22 14:59:08 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 14:59:08 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 14:59:14 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/22 14:59:19 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/22 14:59:24 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/22 14:59:29 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/22 14:59:29 App: TestOnDeleteSrcMutation got un-deployed
2021/12/22 14:59:29 No eventing-con process running
2021/12/22 14:59:29 Function: TestOnDeleteSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation deleting in background"
}
2021/12/22 14:59:30 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:59:40 Waiting for dst bucket item count to get to: 0 curr count: 3346
2021/12/22 14:59:45 Waiting for dst bucket item count to get to: 0 curr count: 3346
2021/12/22 14:59:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 14:59:47 Context: Bucket flush, response code: 200 dump: 
2021/12/22 14:59:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutation (96.13s)
=== RUN   TestOnUpdateSrcMutationWithTimer
2021/12/22 15:00:02 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/22 15:00:02 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2021/12/22 15:00:02 No eventing-con process running
2021/12/22 15:00:02 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutationWithTimer not found"
}
2021/12/22 15:00:03 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:00:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:00:10 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:00:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:00:15 Deploying app: TestOnUpdateSrcMutationWithTimer. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:00:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer stored in temp store"
}
2021/12/22 15:00:16 Starting bucket ops to source bucket
2021/12/22 15:01:03 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 15:01:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:01:08 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/22 15:01:13 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/22 15:01:18 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/22 15:01:23 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/22 15:01:23 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2021/12/22 15:01:23 No eventing-con process running
2021/12/22 15:01:23 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer deleting in background"
}
2021/12/22 15:01:25 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:01:35 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/22 15:01:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:01:36 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:01:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutationWithTimer (109.57s)
=== RUN   TestOnDeleteSrcMutationsWithTimer
2021/12/22 15:01:51 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/22 15:01:51 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2021/12/22 15:01:51 No eventing-con process running
2021/12/22 15:01:51 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutationsWithTimer not found"
}
2021/12/22 15:01:53 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:01:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:01:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:02:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:02:04 Deploying app: TestOnDeleteSrcMutationsWithTimer. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:02:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer stored in temp store"
}
2021/12/22 15:02:06 Starting bucket ops to source bucket
2021/12/22 15:02:44 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 15:02:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:02:49 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/22 15:02:54 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/22 15:02:59 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/22 15:03:04 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/22 15:03:04 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2021/12/22 15:03:04 No eventing-con process running
2021/12/22 15:03:04 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer deleting in background"
}
2021/12/22 15:03:06 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:03:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 15:03:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:03:18 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:03:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutationsWithTimer (101.17s)
=== RUN   TestInterHandlerRecursion
2021/12/22 15:03:33 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/22 15:03:33 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/22 15:03:33 No eventing-con process running
2021/12/22 15:03:33 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_source_bucket_update_op not found"
}
2021/12/22 15:03:34 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:03:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:03:41 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:03:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:03:51 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/22 15:03:51 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/22 15:03:51 No eventing-con process running
2021/12/22 15:03:51 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/22 15:03:52 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:03:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:03:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:04:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:04:04 Deploying app: TestInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:04:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2021/12/22 15:04:05 response body {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2021/12/22 15:04:10 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/22 15:04:15 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/22 15:04:20 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/22 15:04:25 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/22 15:04:25 App: TestInterHandlerRecursion_source_bucket_update_op got deployed
2021/12/22 15:04:25 Deploying app: TestInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:04:25 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
}
2021/12/22 15:04:25 response body {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
} err 
2021/12/22 15:04:30 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/22 15:04:35 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/22 15:04:40 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/22 15:04:45 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/22 15:04:45 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/22 15:04:45 No eventing-con process running
2021/12/22 15:04:45 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2021/12/22 15:04:47 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:04:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:04:53 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:04:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:05:03 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/22 15:05:03 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/22 15:05:03 No eventing-con process running
2021/12/22 15:05:03 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/22 15:05:05 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:05:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:05:11 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:05:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterHandlerRecursion (113.87s)
=== RUN   TestInterBucketRecursion
2021/12/22 15:05:21 Deploying app: TestInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:05:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
}
2021/12/22 15:05:23 response body {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
} err 
2021/12/22 15:05:23 Deploying app: TestInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:05:23 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion_function2 causes a cycle involving functions: [TestInterBucketRecursion_function1], hence deployment is disallowed"
}
2021/12/22 15:05:28 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/22 15:05:33 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/22 15:05:38 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/22 15:05:43 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/22 15:05:43 App: TestInterBucketRecursion_function1 got deployed
2021/12/22 15:05:48 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/22 15:05:53 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/22 15:05:58 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/22 15:06:03 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/22 15:06:03 App: TestInterBucketRecursion_function1 got un-deployed
2021/12/22 15:06:03 No eventing-con process running
2021/12/22 15:06:03 Function: TestInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 deleting in background"
}
2021/12/22 15:06:04 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:06:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:06:11 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:06:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:06:21 Waiting for app: TestInterBucketRecursion_function2 to get un-deployed
2021/12/22 15:06:21 App: TestInterBucketRecursion_function2 got un-deployed
2021/12/22 15:06:21 No eventing-con process running
2021/12/22 15:06:21 Function: TestInterBucketRecursion_function2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion_function2 not found"
}
2021/12/22 15:06:22 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:06:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:06:29 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:06:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion (77.58s)
=== RUN   TestLargeHandler
2021/12/22 15:06:34 Changed force_compress value to false
2021/12/22 15:06:34 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:06:34 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_APPCODE_SIZE",
 "code": 39,
 "description": "Function: TestLargeHandler_function handler Code size is more than 131072. Code Size: 131752"
}
2021/12/22 15:06:34 Changed force_compress value to true
2021/12/22 15:06:34 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:06:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function stored in temp store"
}
2021/12/22 15:06:41 Waiting for app: TestLargeHandler_function to get deployed
2021/12/22 15:06:46 Waiting for app: TestLargeHandler_function to get deployed
2021/12/22 15:06:51 Waiting for app: TestLargeHandler_function to get deployed
2021/12/22 15:06:56 Waiting for app: TestLargeHandler_function to get deployed
2021/12/22 15:06:56 App: TestLargeHandler_function got deployed
2021/12/22 15:07:01 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/22 15:07:06 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/22 15:07:11 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/22 15:07:16 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/22 15:07:16 App: TestLargeHandler_function got un-deployed
2021/12/22 15:07:16 No eventing-con process running
2021/12/22 15:07:16 Function: TestLargeHandler_function delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function deleting in background"
}
2021/12/22 15:07:18 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:07:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:07:24 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:07:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestLargeHandler (55.37s)
=== RUN   TestAllowInterHandlerRecursion
2021/12/22 15:07:39 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/22 15:07:39 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/22 15:07:39 No eventing-con process running
2021/12/22 15:07:39 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op not found"
}
2021/12/22 15:07:41 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:07:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:07:47 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:07:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:07:57 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/22 15:07:57 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/22 15:07:57 No eventing-con process running
2021/12/22 15:07:57 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/22 15:07:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:08:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:08:05 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:08:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:08:11 Deploying app: TestAllowInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:08:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2021/12/22 15:08:12 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2021/12/22 15:08:17 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/22 15:08:22 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/22 15:08:27 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/22 15:08:32 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/22 15:08:32 App: TestAllowInterHandlerRecursion_source_bucket_update_op got deployed
2021/12/22 15:08:32 Deploying app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:08:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
}
2021/12/22 15:08:33 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
} err 
2021/12/22 15:08:38 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/22 15:08:43 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/22 15:08:48 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/22 15:08:53 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/22 15:08:53 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got deployed
2021/12/22 15:08:53 TestAllowInterHandlerRecursion_src_bucket_op_on_delete is deployed
2021/12/22 15:08:58 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/22 15:09:03 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/22 15:09:08 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/22 15:09:13 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/22 15:09:13 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/22 15:09:13 No eventing-con process running
2021/12/22 15:09:13 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2021/12/22 15:09:16 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:09:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:09:22 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:09:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:09:33 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/22 15:09:38 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/22 15:09:43 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/22 15:09:48 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/22 15:09:48 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/22 15:09:48 No eventing-con process running
2021/12/22 15:09:48 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete deleting in background"
}
2021/12/22 15:09:49 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:09:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:09:56 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:10:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterHandlerRecursion (151.51s)
=== RUN   TestAllowInterBucketRecursion
2021/12/22 15:10:06 Deploying app: TestAllowInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:10:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
}
2021/12/22 15:10:07 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
} err 
2021/12/22 15:10:12 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/22 15:10:17 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/22 15:10:22 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/22 15:10:27 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/22 15:10:27 App: TestAllowInterBucketRecursion_function1 got deployed
2021/12/22 15:10:27 Deploying app: TestAllowInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:10:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
}
2021/12/22 15:10:28 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
} err 
2021/12/22 15:10:33 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/22 15:10:38 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/22 15:10:43 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/22 15:10:48 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/22 15:10:48 App: TestAllowInterBucketRecursion_function2 got deployed
2021/12/22 15:10:48 TestAllowInterBucketRecursion_function2 is deployed
2021/12/22 15:10:53 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/22 15:10:59 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/22 15:11:04 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/22 15:11:09 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/22 15:11:09 App: TestAllowInterBucketRecursion_function1 got un-deployed
2021/12/22 15:11:09 No eventing-con process running
2021/12/22 15:11:09 Function: TestAllowInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 deleting in background"
}
2021/12/22 15:11:10 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:11:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:11:18 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:11:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:11:28 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/22 15:11:33 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/22 15:11:38 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/22 15:11:43 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/22 15:11:43 App: TestAllowInterBucketRecursion_function2 got un-deployed
2021/12/22 15:11:43 No eventing-con process running
2021/12/22 15:11:43 Function: TestAllowInterBucketRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 deleting in background"
}
2021/12/22 15:11:45 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:11:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:11:51 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:11:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterBucketRecursion (115.42s)
=== RUN   TestInterBucketRecursion2
2021/12/22 15:12:03 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:12:09 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:12:15 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:12:20 Context: Bucket flush, response code: 500 dump: {"_":"Flush failed with unexpected error. Check server logs for details."}
2021/12/22 15:12:25 Deploying app: TestInterBucketRecursion2_function1. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:12:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 stored in temp store"
}
2021/12/22 15:12:31 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/22 15:12:36 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/22 15:12:41 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/22 15:12:46 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/22 15:12:46 App: TestInterBucketRecursion2_function1 got deployed
2021/12/22 15:12:46 Deploying app: TestInterBucketRecursion2_function2. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:12:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 stored in temp store"
}
2021/12/22 15:12:52 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/22 15:12:57 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/22 15:13:02 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/22 15:13:07 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/22 15:13:07 App: TestInterBucketRecursion2_function2 got deployed
2021/12/22 15:13:07 Deploying app: TestInterBucketRecursion2_function3. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:13:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 stored in temp store"
}
2021/12/22 15:13:13 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/22 15:13:18 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/22 15:13:23 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/22 15:13:28 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/22 15:13:28 App: TestInterBucketRecursion2_function3 got deployed
2021/12/22 15:13:29 Deploying app: TestInterBucketRecursion2_function4. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:13:29 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion2_function4 causes a cycle involving functions: [TestInterBucketRecursion2_function1 TestInterBucketRecursion2_function2 TestInterBucketRecursion2_function3], hence deployment is disallowed"
}
2021/12/22 15:13:34 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/22 15:13:39 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/22 15:13:44 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/22 15:13:49 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/22 15:13:49 App: TestInterBucketRecursion2_function1 got un-deployed
2021/12/22 15:13:49 No eventing-con process running
2021/12/22 15:13:49 Function: TestInterBucketRecursion2_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 deleting in background"
}
2021/12/22 15:13:50 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:13:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:13:57 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:14:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:14:07 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/22 15:14:12 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/22 15:14:17 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/22 15:14:22 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/22 15:14:22 App: TestInterBucketRecursion2_function2 got un-deployed
2021/12/22 15:14:22 No eventing-con process running
2021/12/22 15:14:22 Function: TestInterBucketRecursion2_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 deleting in background"
}
2021/12/22 15:14:23 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:14:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:14:30 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:14:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:14:40 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/22 15:14:46 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/22 15:14:51 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/22 15:14:56 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/22 15:14:56 App: TestInterBucketRecursion2_function3 got un-deployed
2021/12/22 15:14:56 No eventing-con process running
2021/12/22 15:14:56 Function: TestInterBucketRecursion2_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 deleting in background"
}
2021/12/22 15:14:57 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:15:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:15:04 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:15:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:15:14 Waiting for app: TestInterBucketRecursion2_function4 to get un-deployed
2021/12/22 15:15:14 App: TestInterBucketRecursion2_function4 got un-deployed
2021/12/22 15:15:14 No eventing-con process running
2021/12/22 15:15:14 Function: TestInterBucketRecursion2_function4 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion2_function4 not found"
}
2021/12/22 15:15:15 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:15:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:15:22 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:15:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion2 (212.48s)
=== RUN   TestBucketDeleteWithRebOut
2021/12/22 15:15:34 Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/22 15:15:39 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2021/12/22 15:15:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 15:15:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 15:16:12 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 15:16:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 15:16:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 15:16:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 15:17:12 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 15:17:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 15:17:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/22 15:17:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:

vbucket curr owner:


2021/12/22 15:18:12 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:18:12 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 15:18:12 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 15:18:17 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2021/12/22 15:18:17 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:18:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 15:18:18 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 15:18:23 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2021/12/22 15:18:23 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:18:28 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2021/12/22 15:18:28 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2021/12/22 15:18:28 eventingSetup.go:46: No eventing-con process running
2021/12/22 15:18:28 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteWithRebOut not found"
}
2021/12/22 15:18:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:18:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:18:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:18:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:18:46 eventingSetup.go:125: Deploying app: TestBucketDeleteWithRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:18:47 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut stored in temp store"
}
2021/12/22 15:18:52 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/22 15:18:57 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/22 15:19:02 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/22 15:19:07 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/22 15:19:07 clusterSetup.go:354: App: TestBucketDeleteWithRebOut got deployed

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 47519c98cb7ec87dcd295870fe0c0b96
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: b4664f38ed3f283981d177ce421d1c2a
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
Producer node: 127.0.0.1:9303	Node UUID: 4b762506c3d6f4f85c1cf4b9e8c4d9ae
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]


2021/12/22 15:19:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:19:07 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 15:19:12 Rebalance progress: 29.16666666666666
2021/12/22 15:19:17 Rebalance progress: 29.16666666666666
2021/12/22 15:19:22 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 47519c98cb7ec87dcd295870fe0c0b96
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: b4664f38ed3f283981d177ce421d1c2a
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
Producer node: 127.0.0.1:9303	Node UUID: 4b762506c3d6f4f85c1cf4b9e8c4d9ae
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]


2021/12/22 15:19:23 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:19:23 handler_test.go:1674: Deleting source bucket: default
2021/12/22 15:19:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 15:19:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 15:19:30 Rebalance progress: 29.16666666666666
2021/12/22 15:19:35 Rebalance progress: 29.16666666666666
2021/12/22 15:19:40 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 893
	vb list dump: [0-12, 14-28, 31-47, 49-50, 52-75, 77, 79-80, 82-83, 85, 87-100, 102-108, 111-112, 114-118, 120-121, 123-134, 136-146, 148, 150, 152-156, 158-161, 163, 165, 167, 169, 171-181, 183, 185-198, 200-201, 203-204, 206-208, 210-215, 218, 221-252, 254-270, 273-278, 280, 282-287, 289-305, 307, 309-314, 316-318, 320-336, 338, 341-344, 346-349, 351-359, 361-362, 365-367, 369-370, 372-387, 389-390, 392-402, 404, 406-409, 411-413, 415-437, 439-448, 450-456, 458-469, 472-474, 476-478, 480-484, 486, 491, 493, 495-505, 507-581, 583-600, 602-617, 619-628, 631-632, 634-638, 640-641, 643-661, 665-670, 672-690, 692-710, 712-713, 715-737, 740, 743-745, 747-769, 771-772, 774-777, 779-785, 787-788, 790-800, 802-804, 806-808, 811-818, 820-841, 843, 845-858, 860-864, 866-875, 878-880, 882-893, 895, 897-899, 901-904, 906-907, 909-912, 914-927, 929-932, 934, 936-938, 940-953, 955-962, 964, 966-968, 970-1006, 1008-1010, 1012-1020, 1022-1023]
	stream status: stopped
	len: 131
	vb list dump: [13, 29-30, 48, 51, 76, 78, 81, 84, 86, 101, 109-110, 113, 119, 122, 135, 147, 149, 151, 157, 162, 164, 166, 168, 170, 182, 184, 199, 202, 205, 209, 216-217, 219-220, 253, 271-272, 279, 281, 288, 306, 308, 315, 319, 337, 339-340, 345, 350, 360, 363-364, 368, 371, 388, 391, 403, 405, 410, 414, 438, 449, 457, 470-471, 475, 479, 485, 487-490, 492, 494, 506, 582, 601, 618, 629-630, 633, 639, 642, 662-664, 671, 691, 711, 714, 738-739, 741-742, 746, 770, 773, 778, 786, 789, 801, 805, 809-810, 819, 842, 844, 859, 865, 876-877, 881, 894, 896, 900, 905, 908, 913, 928, 933, 935, 939, 954, 963, 965, 969, 1007, 1011, 1021]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 47519c98cb7ec87dcd295870fe0c0b96
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 92
	v: [114-118, 120-121, 123-134, 136-146, 148, 150, 152-156, 158-161, 163, 165, 167, 169, 171-181, 183, 185-198, 200-201, 203-204, 206-208, 210-215, 218, 221-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [228-252, 254-270, 273-278, 280, 282-287, 289-305, 307, 309-314, 316-318, 320-336, 338, 341]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 100
	v: [0-12, 14-28, 31-47, 49-50, 52-75, 77, 79-80, 82-83, 85, 87-100, 102-108, 111-112]
Producer node: 172.31.2.134:9300	Node UUID: b4664f38ed3f283981d177ce421d1c2a
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [683-690, 692-710, 712-713, 715-737, 740, 743-745, 747-769, 771-772, 774-777, 779-785, 787-788, 790-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 97
	v: [797-800, 802-804, 806-808, 811-818, 820-841, 843, 845-858, 860-864, 866-875, 878-880, 882-893, 895, 897-899, 901-904, 906-907, 909-910]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [911-912, 914-927, 929-932, 934, 936-938, 940-953, 955-962, 964, 966-968, 970-1006, 1008-1010, 1012-1020, 1022-1023]
Producer node: 127.0.0.1:9303	Node UUID: 4b762506c3d6f4f85c1cf4b9e8c4d9ae
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 99
	v: [342-344, 346-349, 351-359, 361-362, 365-367, 369-370, 372-387, 389-390, 392-402, 404, 406-409, 411-413, 415-437, 439-448, 450-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [456, 458-469, 472-474, 476-478, 480-484, 486, 491, 493, 495-505, 507-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [570-581, 583-600, 602-617, 619-628, 631-632, 634-638, 640-641, 643-661, 665-670, 672-682]


2021/12/22 15:19:40 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:19:45 eventingSetup.go:719: Waiting for function: TestBucketDeleteWithRebOut status to change to undeployed
2021/12/22 15:19:45 eventingSetup.go:727: Function: TestBucketDeleteWithRebOut status changed to undeployed
2021/12/22 15:19:50 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2021/12/22 15:19:50 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2021/12/22 15:19:50 eventingSetup.go:46: No eventing-con process running
2021/12/22 15:19:50 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut deleting in background"
}
2021/12/22 15:19:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:19:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:19:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:20:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:20:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/22 15:20:03 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 15:20:08 Rebalance progress: 100
--- PASS: TestBucketDeleteWithRebOut (282.31s)
=== RUN   TestN1QLRecursion
2021/12/22 15:20:11 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/22 15:20:11 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/22 15:20:11 Removing node(s): [] from the cluster
2021/12/22 15:20:17 Rebalance progress: 100
2021/12/22 15:20:23 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:20:29 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:20:35 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:20:40 Deploying app: TestN1QLRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:20:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
}
2021/12/22 15:20:41 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
} err 
2021/12/22 15:20:46 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/22 15:20:51 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/22 15:20:56 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/22 15:21:01 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/22 15:21:06 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/22 15:21:11 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/22 15:21:11 App: TestN1QLRecursion_function1 got deployed
2021/12/22 15:21:11 TestN1QLRecursion_function1 is deployed
2021/12/22 15:21:11 Deploying app: TestN1QLRecursion_function3. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:21:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
}
2021/12/22 15:21:12 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
} err 
2021/12/22 15:21:17 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/22 15:21:22 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/22 15:21:27 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/22 15:21:32 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/22 15:21:32 App: TestN1QLRecursion_function3 got deployed
2021/12/22 15:21:32 TestN1QLRecursion_function3 is deployed
2021/12/22 15:21:32 Deploying app: TestN1QLRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:21:32 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
}
2021/12/22 15:21:32 response body {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
} err 
2021/12/22 15:21:32 Success: TestN1QLRecursion_function2 is not deployed
2021/12/22 15:21:38 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/22 15:21:43 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/22 15:21:48 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/22 15:21:53 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/22 15:21:53 App: TestN1QLRecursion_function1 got un-deployed
2021/12/22 15:21:53 No eventing-con process running
2021/12/22 15:21:53 Function: TestN1QLRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 deleting in background"
}
2021/12/22 15:21:54 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:22:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:22:01 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:22:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:22:12 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/22 15:22:17 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/22 15:22:22 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/22 15:22:27 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/22 15:22:27 App: TestN1QLRecursion_function3 got un-deployed
2021/12/22 15:22:27 No eventing-con process running
2021/12/22 15:22:27 Function: TestN1QLRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 deleting in background"
}
2021/12/22 15:22:29 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:22:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:22:36 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:22:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:22:42 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/22 15:22:47 Rebalance progress: 100
--- PASS: TestN1QLRecursion (155.84s)
=== RUN   TestN1QLAllowRecursion
2021/12/22 15:22:47 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/22 15:22:47 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/22 15:22:47 Removing node(s): [] from the cluster
2021/12/22 15:22:52 Rebalance progress: 100
2021/12/22 15:22:58 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:23:04 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:23:10 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:23:15 Deploying app: TestN1QLAllowRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:23:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
}
2021/12/22 15:23:16 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
} err 
2021/12/22 15:23:21 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/22 15:23:26 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/22 15:23:31 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/22 15:23:36 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/22 15:23:36 App: TestN1QLAllowRecursion_function1 got deployed
2021/12/22 15:23:36 TestN1QLAllowRecursion_function1 is deployed
2021/12/22 15:23:36 Deploying app: TestN1QLAllowRecursion_function3. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:23:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
}
2021/12/22 15:23:37 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
} err 
2021/12/22 15:23:42 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/22 15:23:47 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/22 15:23:52 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/22 15:23:57 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/22 15:23:57 App: TestN1QLAllowRecursion_function3 got deployed
2021/12/22 15:23:57 TestN1QLAllowRecursion_function3 is deployed
2021/12/22 15:23:57 Deploying app: TestN1QLAllowRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:23:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
}
2021/12/22 15:23:59 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
} err 
2021/12/22 15:24:04 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/22 15:24:09 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/22 15:24:14 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/22 15:24:19 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/22 15:24:19 App: TestN1QLAllowRecursion_function2 got deployed
2021/12/22 15:24:19 Success: TestN1QLAllowRecursion_function2 is deployed after allow_interbucket_recursion
2021/12/22 15:24:24 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/22 15:24:29 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/22 15:24:34 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/22 15:24:39 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/22 15:24:39 App: TestN1QLAllowRecursion_function1 got un-deployed
2021/12/22 15:24:39 No eventing-con process running
2021/12/22 15:24:39 Function: TestN1QLAllowRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 deleting in background"
}
2021/12/22 15:24:41 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:24:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:24:48 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:24:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:24:58 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/22 15:25:03 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/22 15:25:08 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/22 15:25:13 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/22 15:25:13 App: TestN1QLAllowRecursion_function2 got un-deployed
2021/12/22 15:25:13 No eventing-con process running
2021/12/22 15:25:13 Function: TestN1QLAllowRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 deleting in background"
}
2021/12/22 15:25:15 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:25:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:25:22 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:25:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:25:32 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/22 15:25:37 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/22 15:25:42 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/22 15:25:47 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/22 15:25:47 App: TestN1QLAllowRecursion_function3 got un-deployed
2021/12/22 15:25:47 No eventing-con process running
2021/12/22 15:25:47 Function: TestN1QLAllowRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 deleting in background"
}
2021/12/22 15:25:49 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:25:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:25:56 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:26:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:26:02 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/22 15:26:07 Rebalance progress: 100
--- PASS: TestN1QLAllowRecursion (200.28s)
=== RUN   TestOnDeleteExpiryBucketOp
2021/12/22 15:26:07 Sleeping for some time
2021/12/22 15:26:17 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/22 15:26:17 App: TestOnDeleteExpiryBucketOp got un-deployed
2021/12/22 15:26:17 No eventing-con process running
2021/12/22 15:26:17 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteExpiryBucketOp not found"
}
2021/12/22 15:26:19 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:26:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:26:26 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:26:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:26:31 Deploying app: TestOnDeleteExpiryBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:26:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp stored in temp store"
}
2021/12/22 15:26:32 Starting bucket ops to source bucket
2021/12/22 15:27:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 15:27:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 15:27:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 15:27:26 Starting bucket ops to source bucket
2021/12/22 15:27:27 Starting bucket ops to source bucket
2021/12/22 15:28:33 Waiting for dst bucket item count to get to: 7000 curr count: 5000
2021/12/22 15:28:38 Waiting for dst bucket item count to get to: 7000 curr count: 6000
2021/12/22 15:28:43 Waiting for dst bucket item count to get to: 7000 curr count: 6000
2021/12/22 15:28:43 src & dst bucket item count matched up. src bucket count: 7000 dst bucket count: 7000
2021/12/22 15:28:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:28:48 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/22 15:28:53 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/22 15:28:58 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/22 15:29:03 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/22 15:29:03 App: TestOnDeleteExpiryBucketOp got un-deployed
2021/12/22 15:29:03 No eventing-con process running
2021/12/22 15:29:03 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp deleting in background"
}
2021/12/22 15:29:05 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:29:15 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/22 15:29:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:29:17 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:29:27 Waiting for dst bucket item count to get to: 0 curr count: 7000
2021/12/22 15:29:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteExpiryBucketOp (199.76s)
=== RUN   TestTimerOverWriteSameReference
2021/12/22 15:29:32 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/22 15:29:32 App: TestTimerOverWriteSameReference got un-deployed
2021/12/22 15:29:32 No eventing-con process running
2021/12/22 15:29:32 Function: TestTimerOverWriteSameReference delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverWriteSameReference not found"
}
2021/12/22 15:29:34 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:29:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:29:41 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:29:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:29:46 Deploying app: TestTimerOverWriteSameReference. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:29:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference stored in temp store"
}
2021/12/22 15:29:52 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/22 15:29:57 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/22 15:30:02 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/22 15:30:07 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/22 15:30:07 App: TestTimerOverWriteSameReference got deployed
2021/12/22 15:30:17 Starting bucket ops to source bucket
2021/12/22 15:31:18 src & dst bucket item count matched up. src bucket count: 1 dst bucket count: 1
2021/12/22 15:31:28 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:31:33 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/22 15:31:38 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/22 15:31:43 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/22 15:31:48 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/22 15:31:48 App: TestTimerOverWriteSameReference got un-deployed
2021/12/22 15:31:48 No eventing-con process running
2021/12/22 15:31:48 Function: TestTimerOverWriteSameReference delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference deleting in background"
}
2021/12/22 15:31:50 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:32:00 Waiting for dst bucket item count to get to: 0 curr count: 623
2021/12/22 15:32:05 Waiting for dst bucket item count to get to: 0 curr count: 623
2021/12/22 15:32:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:32:07 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:32:17 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/22 15:32:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverWriteSameReference (169.86s)
=== RUN   TestCancelTimerBucketop
2021/12/22 15:32:22 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/22 15:32:22 App: TestCancelTimerBucketop got un-deployed
2021/12/22 15:32:22 No eventing-con process running
2021/12/22 15:32:22 Function: TestCancelTimerBucketop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCancelTimerBucketop not found"
}
2021/12/22 15:32:24 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:32:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:32:31 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:32:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:32:36 Deploying app: TestCancelTimerBucketop. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:32:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop stored in temp store"
}
2021/12/22 15:32:42 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/22 15:32:47 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/22 15:32:52 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/22 15:32:57 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/22 15:32:57 App: TestCancelTimerBucketop got deployed
2021/12/22 15:32:57 Starting bucket ops to source bucket
2021/12/22 15:33:04 Starting bucket ops to source bucket
2021/12/22 15:34:06 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/22 15:34:06 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:34:11 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/22 15:34:16 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/22 15:34:21 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/22 15:34:26 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/22 15:34:26 App: TestCancelTimerBucketop got un-deployed
2021/12/22 15:34:26 No eventing-con process running
2021/12/22 15:34:26 Function: TestCancelTimerBucketop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop deleting in background"
}
2021/12/22 15:34:28 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:34:38 Waiting for dst bucket item count to get to: 0 curr count: 715
2021/12/22 15:34:43 Waiting for dst bucket item count to get to: 0 curr count: 215
2021/12/22 15:34:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:34:45 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:34:55 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/22 15:34:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCancelTimerBucketop (158.19s)
=== RUN   TestJSExpiryDate
2021/12/22 15:35:00 Starting bucket ops to source bucket
2021/12/22 15:35:13 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 15:35:13 Deploying app: TestJSExpiryDate. Item count src bucket: 5000 dst bucket: 0
2021/12/22 15:35:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate stored in temp store"
}
2021/12/22 15:35:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:35:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:35:49 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/22 15:35:55 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/22 15:36:00 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/22 15:36:05 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/22 15:36:05 App: TestJSExpiryDate got un-deployed
2021/12/22 15:36:05 No eventing-con process running
2021/12/22 15:36:05 Function: TestJSExpiryDate delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate deleting in background"
}
2021/12/22 15:36:06 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:36:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:36:14 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:36:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestJSExpiryDate (83.73s)
=== RUN   TestBinaryDoc
2021/12/22 15:36:24 Starting bucket ops to source bucket
2021/12/22 15:36:24 Deploying app: TestBinaryDoc. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:36:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc stored in temp store"
}
2021/12/22 15:36:25 Starting bucket ops to source bucket
2021/12/22 15:36:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:36:25 Deleting source bucket docs now
2021/12/22 15:36:25 Starting bucket ops to source bucket
2021/12/22 15:37:02 Waiting for dst bucket item count to get to: 32 curr count: 23
2021/12/22 15:37:02 src & dst bucket item count matched up. src bucket count: 32 dst bucket count: 32
2021/12/22 15:37:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:37:07 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/22 15:37:12 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/22 15:37:17 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/22 15:37:22 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/22 15:37:22 App: TestBinaryDoc got un-deployed
2021/12/22 15:37:22 No eventing-con process running
2021/12/22 15:37:23 Function: TestBinaryDoc delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc deleting in background"
}
2021/12/22 15:37:24 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:37:34 Waiting for dst bucket item count to get to: 0 curr count: 32
2021/12/22 15:37:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:37:36 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:37:46 Waiting for dst bucket item count to get to: 0 curr count: 32
2021/12/22 15:37:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBinaryDoc (87.31s)
=== RUN   TestConstantBindings
2021/12/22 15:37:46 Deploying app: TestConstantBindings. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:37:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings stored in temp store"
}
2021/12/22 15:37:47 Starting bucket ops to source bucket
2021/12/22 15:37:53 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/22 15:37:58 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/22 15:38:03 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/22 15:38:08 Waiting for dst bucket item count to get to: 6000 curr count: 887
2021/12/22 15:38:13 Waiting for dst bucket item count to get to: 6000 curr count: 887
2021/12/22 15:38:13 src & dst bucket item count matched up. src bucket count: 6000 dst bucket count: 6000
2021/12/22 15:38:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:38:18 Waiting for app: TestConstantBindings to get un-deployed
2021/12/22 15:38:23 Waiting for app: TestConstantBindings to get un-deployed
2021/12/22 15:38:28 Waiting for app: TestConstantBindings to get un-deployed
2021/12/22 15:38:33 Waiting for app: TestConstantBindings to get un-deployed
2021/12/22 15:38:33 App: TestConstantBindings got un-deployed
2021/12/22 15:38:33 No eventing-con process running
2021/12/22 15:38:33 Function: TestConstantBindings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings deleting in background"
}
2021/12/22 15:38:35 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:38:45 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/22 15:38:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:38:47 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:38:57 Waiting for dst bucket item count to get to: 0 curr count: 6000
2021/12/22 15:38:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestConstantBindings (70.67s)
=== RUN   TestCodeInsight
2021/12/22 15:39:02 Waiting for app: TestCodeInsight to get un-deployed
2021/12/22 15:39:02 App: TestCodeInsight got un-deployed
2021/12/22 15:39:02 No eventing-con process running
2021/12/22 15:39:02 Function: TestCodeInsight delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCodeInsight not found"
}
2021/12/22 15:39:04 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:39:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:39:10 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:39:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:39:15 Starting bucket ops to source bucket
2021/12/22 15:39:16 Deploying app: TestCodeInsight. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:39:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight stored in temp store"
}
2021/12/22 15:39:22 Waiting for app: TestCodeInsight to get deployed
2021/12/22 15:39:27 Waiting for app: TestCodeInsight to get deployed
2021/12/22 15:39:32 Waiting for app: TestCodeInsight to get deployed
2021/12/22 15:39:37 Waiting for app: TestCodeInsight to get deployed
2021/12/22 15:39:37 App: TestCodeInsight got deployed
2021/12/22 15:39:42 Waiting for dst bucket item count to get to: 1000 curr count: 324
2021/12/22 15:39:42 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/22 15:39:47 Waiting for app: TestCodeInsight to get un-deployed
2021/12/22 15:39:52 Waiting for app: TestCodeInsight to get un-deployed
2021/12/22 15:39:57 Waiting for app: TestCodeInsight to get un-deployed
2021/12/22 15:40:02 Waiting for app: TestCodeInsight to get un-deployed
2021/12/22 15:40:02 App: TestCodeInsight got un-deployed
2021/12/22 15:40:02 No eventing-con process running
2021/12/22 15:40:03 Function: TestCodeInsight delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight deleting in background"
}
2021/12/22 15:40:04 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:40:14 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/22 15:40:19 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/22 15:40:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:40:21 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:40:31 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/22 15:40:36 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/22 15:40:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCodeInsight (99.39s)
=== RUN   TestParserTransform
--- PASS: TestParserTransform (0.04s)
=== RUN   TestParserDetect
--- PASS: TestParserDetect (0.00s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	12789.953s

Functional tests took 3 hours, 33 minutes and 12 seconds.

N1ql tests

2021/12/22 15:40:46 Started n1ql
2021/12/22 15:40:55 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/22 15:40:56 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/22 15:40:56 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 15:40:56 Removing node(s): [] from the cluster
2021/12/22 15:41:01 Rebalance progress: 100
=== RUN   TestRecursiveMutationN1QL
2021/12/22 15:41:06 Waiting for app: TestRecursiveMutationN1QL to get un-deployed
2021/12/22 15:41:06 App: TestRecursiveMutationN1QL got un-deployed
2021/12/22 15:41:06 No eventing-con process running
2021/12/22 15:41:06 Function: TestRecursiveMutationN1QL delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestRecursiveMutationN1QL not found"
}
2021/12/22 15:41:08 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:41:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:41:15 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:41:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:41:20 Deploying app: TestRecursiveMutationN1QL. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:41:20 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Function: TestRecursiveMutationN1QL N1QL DML to source keyspace default:default"
}
--- PASS: TestRecursiveMutationN1QL (18.57s)
=== RUN   TestFlexReset1
2021/12/22 15:41:25 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/22 15:41:25 App: TestFlexReset1 got un-deployed
2021/12/22 15:41:25 No eventing-con process running
2021/12/22 15:41:25 Function: TestFlexReset1 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset1 not found"
}
2021/12/22 15:41:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:41:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:41:33 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:41:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:41:38 Starting bucket ops to source bucket
2021/12/22 15:41:39 Deploying app: TestFlexReset1. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:41:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 stored in temp store"
}
2021/12/22 15:41:45 Waiting for app: TestFlexReset1 to get deployed
2021/12/22 15:41:50 Waiting for app: TestFlexReset1 to get deployed
2021/12/22 15:41:55 Waiting for app: TestFlexReset1 to get deployed
2021/12/22 15:42:00 Waiting for app: TestFlexReset1 to get deployed
2021/12/22 15:42:00 App: TestFlexReset1 got deployed
2021/12/22 15:42:05 Waiting for dst bucket item count to get to: 1000 curr count: 500
2021/12/22 15:42:05 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/22 15:42:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:42:10 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/22 15:42:15 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/22 15:42:20 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/22 15:42:26 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/22 15:42:26 App: TestFlexReset1 got un-deployed
2021/12/22 15:42:26 No eventing-con process running
2021/12/22 15:42:26 Function: TestFlexReset1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 deleting in background"
}
2021/12/22 15:42:27 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:42:37 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/22 15:42:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:42:39 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:42:49 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/22 15:42:54 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/22 15:42:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset1 (94.35s)
=== RUN   TestFlexReset2
2021/12/22 15:42:59 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/22 15:42:59 App: TestFlexReset2 got un-deployed
2021/12/22 15:42:59 No eventing-con process running
2021/12/22 15:42:59 Function: TestFlexReset2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset2 not found"
}
2021/12/22 15:43:01 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:43:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:43:08 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:43:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:43:13 Starting bucket ops to source bucket
2021/12/22 15:43:13 Deploying app: TestFlexReset2. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:43:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 stored in temp store"
}
2021/12/22 15:43:19 Waiting for app: TestFlexReset2 to get deployed
2021/12/22 15:43:24 Waiting for app: TestFlexReset2 to get deployed
2021/12/22 15:43:30 Waiting for app: TestFlexReset2 to get deployed
2021/12/22 15:43:35 Waiting for app: TestFlexReset2 to get deployed
2021/12/22 15:43:35 App: TestFlexReset2 got deployed
2021/12/22 15:43:40 Waiting for dst bucket item count to get to: 1000 curr count: 602
2021/12/22 15:43:40 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/22 15:43:40 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:43:45 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/22 15:43:50 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/22 15:43:55 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/22 15:44:00 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/22 15:44:00 App: TestFlexReset2 got un-deployed
2021/12/22 15:44:00 No eventing-con process running
2021/12/22 15:44:00 Function: TestFlexReset2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 deleting in background"
}
2021/12/22 15:44:02 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:44:12 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/22 15:44:17 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/22 15:44:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:44:18 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:44:28 Waiting for dst bucket item count to get to: 0 curr count: 827
2021/12/22 15:44:33 Waiting for dst bucket item count to get to: 0 curr count: 327
2021/12/22 15:44:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset2 (99.36s)
=== RUN   TestN1QLLabelledBreak
2021/12/22 15:44:38 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/22 15:44:38 App: TestN1QLLabelledBreak got un-deployed
2021/12/22 15:44:38 No eventing-con process running
2021/12/22 15:44:38 Function: TestN1QLLabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLLabelledBreak not found"
}
2021/12/22 15:44:40 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:44:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:44:47 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:44:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:44:52 Deploying app: TestN1QLLabelledBreak. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:44:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak stored in temp store"
}
2021/12/22 15:44:58 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/22 15:45:03 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/22 15:45:08 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/22 15:45:13 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/22 15:45:13 App: TestN1QLLabelledBreak got deployed
2021/12/22 15:45:13 Starting bucket ops to source bucket
2021/12/22 15:45:23 Waiting for dst bucket item count to get to: 10000 curr count: 0
2021/12/22 15:45:28 Waiting for dst bucket item count to get to: 10000 curr count: 285
2021/12/22 15:45:33 Waiting for dst bucket item count to get to: 10000 curr count: 880
2021/12/22 15:45:38 Waiting for dst bucket item count to get to: 10000 curr count: 2828
2021/12/22 15:45:43 Waiting for dst bucket item count to get to: 10000 curr count: 4904
2021/12/22 15:45:48 Waiting for dst bucket item count to get to: 10000 curr count: 6946
2021/12/22 15:45:53 Waiting for dst bucket item count to get to: 10000 curr count: 8962
2021/12/22 15:45:58 Waiting for dst bucket item count to get to: 10000 curr count: 9687
2021/12/22 15:45:58 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 15:45:58 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:46:03 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/22 15:46:08 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/22 15:46:13 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/22 15:46:18 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/22 15:46:18 App: TestN1QLLabelledBreak got un-deployed
2021/12/22 15:46:18 No eventing-con process running
2021/12/22 15:46:18 Function: TestN1QLLabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak deleting in background"
}
2021/12/22 15:46:20 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:46:30 Waiting for dst bucket item count to get to: 0 curr count: 2814
2021/12/22 15:46:35 Waiting for dst bucket item count to get to: 0 curr count: 2814
2021/12/22 15:46:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:46:37 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:46:47 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/22 15:46:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLLabelledBreak (133.16s)
=== RUN   TestN1QLUnlabelledBreak
2021/12/22 15:46:52 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/22 15:46:52 App: TestN1QLUnlabelledBreak got un-deployed
2021/12/22 15:46:52 No eventing-con process running
2021/12/22 15:46:52 Function: TestN1QLUnlabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLUnlabelledBreak not found"
}
2021/12/22 15:46:53 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:46:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:47:00 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:47:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:47:05 Deploying app: TestN1QLUnlabelledBreak. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:47:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak stored in temp store"
}
2021/12/22 15:47:11 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/22 15:47:16 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/22 15:47:21 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/22 15:47:26 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/22 15:47:26 App: TestN1QLUnlabelledBreak got deployed
2021/12/22 15:47:26 Starting bucket ops to source bucket
2021/12/22 15:47:36 Waiting for dst bucket item count to get to: 10000 curr count: 318
2021/12/22 15:47:41 Waiting for dst bucket item count to get to: 10000 curr count: 318
2021/12/22 15:47:46 Waiting for dst bucket item count to get to: 10000 curr count: 5090
2021/12/22 15:47:51 Waiting for dst bucket item count to get to: 10000 curr count: 5090
2021/12/22 15:47:56 Waiting for dst bucket item count to get to: 10000 curr count: 5090
2021/12/22 15:47:56 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 15:47:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:48:01 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/22 15:48:06 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/22 15:48:12 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/22 15:48:17 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/22 15:48:17 App: TestN1QLUnlabelledBreak got un-deployed
2021/12/22 15:48:17 No eventing-con process running
2021/12/22 15:48:17 Function: TestN1QLUnlabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak deleting in background"
}
2021/12/22 15:48:18 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:48:28 Waiting for dst bucket item count to get to: 0 curr count: 4254
2021/12/22 15:48:33 Waiting for dst bucket item count to get to: 0 curr count: 1754
2021/12/22 15:48:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:48:35 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:48:45 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/22 15:48:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLUnlabelledBreak (118.52s)
=== RUN   TestN1QLThrowStatement
2021/12/22 15:48:50 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/22 15:48:50 App: TestN1QLThrowStatement got un-deployed
2021/12/22 15:48:50 No eventing-con process running
2021/12/22 15:48:50 Function: TestN1QLThrowStatement delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLThrowStatement not found"
}
2021/12/22 15:48:52 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:48:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:48:59 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:49:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:49:04 Deploying app: TestN1QLThrowStatement. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:49:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement stored in temp store"
}
2021/12/22 15:49:10 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/22 15:49:15 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/22 15:49:20 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/22 15:49:25 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/22 15:49:25 App: TestN1QLThrowStatement got deployed
2021/12/22 15:49:25 Starting bucket ops to source bucket
2021/12/22 15:49:34 Waiting for dst bucket item count to get to: 10000 curr count: 0
2021/12/22 15:49:39 Waiting for dst bucket item count to get to: 10000 curr count: 146
2021/12/22 15:49:44 Waiting for dst bucket item count to get to: 10000 curr count: 442
2021/12/22 15:49:49 Waiting for dst bucket item count to get to: 10000 curr count: 4242
2021/12/22 15:49:54 Waiting for dst bucket item count to get to: 10000 curr count: 4242
2021/12/22 15:49:59 Waiting for dst bucket item count to get to: 10000 curr count: 8288
2021/12/22 15:50:04 Waiting for dst bucket item count to get to: 10000 curr count: 8288
2021/12/22 15:50:04 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/22 15:50:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:50:09 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/22 15:50:15 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/22 15:50:20 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/22 15:50:25 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/22 15:50:25 App: TestN1QLThrowStatement got un-deployed
2021/12/22 15:50:25 No eventing-con process running
2021/12/22 15:50:25 Function: TestN1QLThrowStatement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement deleting in background"
}
2021/12/22 15:50:26 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:50:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 15:50:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:50:38 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:50:48 Waiting for dst bucket item count to get to: 0 curr count: 7874
2021/12/22 15:50:53 Waiting for dst bucket item count to get to: 0 curr count: 2874
2021/12/22 15:50:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLThrowStatement (128.10s)
=== RUN   TestN1QLNestedForLoop
2021/12/22 15:50:58 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/22 15:50:58 App: TestN1QLNestedForLoop got un-deployed
2021/12/22 15:50:58 No eventing-con process running
2021/12/22 15:50:58 Function: TestN1QLNestedForLoop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLNestedForLoop not found"
}
2021/12/22 15:51:00 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:51:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:51:07 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:51:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:51:12 Deploying app: TestN1QLNestedForLoop. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:51:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop stored in temp store"
}
2021/12/22 15:51:18 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/22 15:51:23 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/22 15:51:28 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/22 15:51:33 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/22 15:51:33 App: TestN1QLNestedForLoop got deployed
2021/12/22 15:51:33 Starting bucket ops to source bucket
2021/12/22 15:51:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 15:51:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 15:51:52 Waiting for dst bucket item count to get to: 5000 curr count: 520
2021/12/22 15:51:57 Waiting for dst bucket item count to get to: 5000 curr count: 1675
2021/12/22 15:52:02 Waiting for dst bucket item count to get to: 5000 curr count: 2866
2021/12/22 15:52:07 Waiting for dst bucket item count to get to: 5000 curr count: 4062
2021/12/22 15:52:07 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 15:52:07 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:52:12 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/22 15:52:18 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/22 15:52:23 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/22 15:52:28 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/22 15:52:28 App: TestN1QLNestedForLoop got un-deployed
2021/12/22 15:52:28 No eventing-con process running
2021/12/22 15:52:28 Function: TestN1QLNestedForLoop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop deleting in background"
}
2021/12/22 15:52:29 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:52:39 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 15:52:44 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 15:52:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:52:46 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:52:56 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 15:52:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLNestedForLoop (123.00s)
=== RUN   TestN1QLAutoClose
2021/12/22 15:53:01 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/22 15:53:01 App: TestN1QLAutoClose got un-deployed
2021/12/22 15:53:01 No eventing-con process running
2021/12/22 15:53:01 Function: TestN1QLAutoClose delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLAutoClose not found"
}
2021/12/22 15:53:03 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:53:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:53:10 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:53:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:53:15 Deploying app: TestN1QLAutoClose. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:53:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose stored in temp store"
}
2021/12/22 15:53:21 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/22 15:53:26 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/22 15:53:31 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/22 15:53:36 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/22 15:53:36 App: TestN1QLAutoClose got deployed
2021/12/22 15:53:36 Starting bucket ops to source bucket
2021/12/22 15:53:42 Waiting for dst bucket item count to get to: 500 curr count: 0
2021/12/22 15:53:47 Waiting for dst bucket item count to get to: 500 curr count: 2
2021/12/22 15:53:52 Waiting for dst bucket item count to get to: 500 curr count: 2
2021/12/22 15:53:57 Waiting for dst bucket item count to get to: 500 curr count: 27
2021/12/22 15:54:02 Waiting for dst bucket item count to get to: 500 curr count: 27
2021/12/22 15:54:07 Waiting for dst bucket item count to get to: 500 curr count: 47
2021/12/22 15:54:12 Waiting for dst bucket item count to get to: 500 curr count: 47
2021/12/22 15:54:17 Waiting for dst bucket item count to get to: 500 curr count: 69
2021/12/22 15:54:22 Waiting for dst bucket item count to get to: 500 curr count: 69
2021/12/22 15:54:27 Waiting for dst bucket item count to get to: 500 curr count: 93
2021/12/22 15:54:32 Waiting for dst bucket item count to get to: 500 curr count: 93
2021/12/22 15:54:37 Waiting for dst bucket item count to get to: 500 curr count: 115
2021/12/22 15:54:42 Waiting for dst bucket item count to get to: 500 curr count: 115
2021/12/22 15:54:47 Waiting for dst bucket item count to get to: 500 curr count: 115
2021/12/22 15:54:52 Waiting for dst bucket item count to get to: 500 curr count: 135
2021/12/22 15:54:57 Waiting for dst bucket item count to get to: 500 curr count: 135
2021/12/22 15:55:02 Waiting for dst bucket item count to get to: 500 curr count: 158
2021/12/22 15:55:07 Waiting for dst bucket item count to get to: 500 curr count: 158
2021/12/22 15:55:12 Waiting for dst bucket item count to get to: 500 curr count: 180
2021/12/22 15:55:17 Waiting for dst bucket item count to get to: 500 curr count: 180
2021/12/22 15:55:22 Waiting for dst bucket item count to get to: 500 curr count: 202
2021/12/22 15:55:27 Waiting for dst bucket item count to get to: 500 curr count: 212
2021/12/22 15:55:32 Waiting for dst bucket item count to get to: 500 curr count: 225
2021/12/22 15:55:37 Waiting for dst bucket item count to get to: 500 curr count: 235
2021/12/22 15:55:42 Waiting for dst bucket item count to get to: 500 curr count: 245
2021/12/22 15:55:47 Waiting for dst bucket item count to get to: 500 curr count: 253
2021/12/22 15:55:52 Waiting for dst bucket item count to get to: 500 curr count: 265
2021/12/22 15:55:57 Waiting for dst bucket item count to get to: 500 curr count: 274
2021/12/22 15:56:02 Waiting for dst bucket item count to get to: 500 curr count: 284
2021/12/22 15:56:07 Waiting for dst bucket item count to get to: 500 curr count: 298
2021/12/22 15:56:12 Waiting for dst bucket item count to get to: 500 curr count: 308
2021/12/22 15:56:17 Waiting for dst bucket item count to get to: 500 curr count: 319
2021/12/22 15:56:22 Waiting for dst bucket item count to get to: 500 curr count: 330
2021/12/22 15:56:27 Waiting for dst bucket item count to get to: 500 curr count: 343
2021/12/22 15:56:32 Waiting for dst bucket item count to get to: 500 curr count: 350
2021/12/22 15:56:37 Waiting for dst bucket item count to get to: 500 curr count: 362
2021/12/22 15:56:42 Waiting for dst bucket item count to get to: 500 curr count: 372
2021/12/22 15:56:47 Waiting for dst bucket item count to get to: 500 curr count: 382
2021/12/22 15:56:52 Waiting for dst bucket item count to get to: 500 curr count: 393
2021/12/22 15:56:57 Waiting for dst bucket item count to get to: 500 curr count: 404
2021/12/22 15:57:02 Waiting for dst bucket item count to get to: 500 curr count: 415
2021/12/22 15:57:07 Waiting for dst bucket item count to get to: 500 curr count: 436
2021/12/22 15:57:12 Waiting for dst bucket item count to get to: 500 curr count: 436
2021/12/22 15:57:17 Waiting for dst bucket item count to get to: 500 curr count: 458
2021/12/22 15:57:22 Waiting for dst bucket item count to get to: 500 curr count: 458
2021/12/22 15:57:27 Waiting for dst bucket item count to get to: 500 curr count: 480
2021/12/22 15:57:32 Waiting for dst bucket item count to get to: 500 curr count: 480
2021/12/22 15:57:37 Waiting for dst bucket item count to get to: 500 curr count: 498
2021/12/22 15:57:42 Waiting for dst bucket item count to get to: 500 curr count: 498
2021/12/22 15:57:42 src & dst bucket item count matched up. src bucket count: 500 dst bucket count: 500
2021/12/22 15:57:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:57:47 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/22 15:57:52 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/22 15:57:57 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/22 15:58:02 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/22 15:58:02 App: TestN1QLAutoClose got un-deployed
2021/12/22 15:58:02 No eventing-con process running
2021/12/22 15:58:02 Function: TestN1QLAutoClose delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose deleting in background"
}
2021/12/22 15:58:04 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:58:14 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/22 15:58:19 Waiting for dst bucket item count to get to: 0 curr count: 250
2021/12/22 15:58:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:58:21 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:58:31 Waiting for dst bucket item count to get to: 0 curr count: 466
2021/12/22 15:58:36 Waiting for dst bucket item count to get to: 0 curr count: 466
2021/12/22 15:58:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLAutoClose (339.62s)
=== RUN   TestN1QLPosParams
2021/12/22 15:58:41 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/22 15:58:41 App: TestN1QLPosParams got un-deployed
2021/12/22 15:58:41 No eventing-con process running
2021/12/22 15:58:41 Function: TestN1QLPosParams delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLPosParams not found"
}
2021/12/22 15:58:43 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:58:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:58:49 Context: Bucket flush, response code: 200 dump: 
2021/12/22 15:58:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 15:58:54 Deploying app: TestN1QLPosParams. Item count src bucket: 0 dst bucket: 0
2021/12/22 15:58:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams stored in temp store"
}
2021/12/22 15:59:01 Waiting for app: TestN1QLPosParams to get deployed
2021/12/22 15:59:06 Waiting for app: TestN1QLPosParams to get deployed
2021/12/22 15:59:11 Waiting for app: TestN1QLPosParams to get deployed
2021/12/22 15:59:16 Waiting for app: TestN1QLPosParams to get deployed
2021/12/22 15:59:16 App: TestN1QLPosParams got deployed
2021/12/22 15:59:16 Starting bucket ops to source bucket
2021/12/22 15:59:25 Waiting for dst bucket item count to get to: 5000 curr count: 787
2021/12/22 15:59:30 Waiting for dst bucket item count to get to: 5000 curr count: 787
2021/12/22 15:59:30 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 15:59:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 15:59:35 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/22 15:59:40 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/22 15:59:45 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/22 15:59:51 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/22 15:59:51 App: TestN1QLPosParams got un-deployed
2021/12/22 15:59:51 No eventing-con process running
2021/12/22 15:59:51 Function: TestN1QLPosParams delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams deleting in background"
}
2021/12/22 15:59:52 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:00:02 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 16:00:07 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 16:00:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:00:09 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:00:19 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 16:00:24 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/22 16:00:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLPosParams (108.25s)
=== RUN   TestN1QLExhaustConnPool
2021/12/22 16:00:29 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/22 16:00:29 App: TestN1QLExhaustConnPool got un-deployed
2021/12/22 16:00:29 No eventing-con process running
2021/12/22 16:00:29 Function: TestN1QLExhaustConnPool delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLExhaustConnPool not found"
}
2021/12/22 16:00:31 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:00:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:00:38 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:00:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:00:43 Deploying app: TestN1QLExhaustConnPool. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:00:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool stored in temp store"
}
2021/12/22 16:00:49 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/22 16:00:54 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/22 16:00:59 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/22 16:01:04 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/22 16:01:04 App: TestN1QLExhaustConnPool got deployed
2021/12/22 16:01:04 Starting bucket ops to source bucket
2021/12/22 16:01:09 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/22 16:01:14 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/22 16:01:14 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/22 16:01:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 16:01:19 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/22 16:01:24 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/22 16:01:29 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/22 16:01:34 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/22 16:01:34 App: TestN1QLExhaustConnPool got un-deployed
2021/12/22 16:01:34 No eventing-con process running
2021/12/22 16:01:34 Function: TestN1QLExhaustConnPool delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool deleting in background"
}
2021/12/22 16:01:36 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:01:46 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/22 16:01:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:01:48 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:01:58 Waiting for dst bucket item count to get to: 0 curr count: 65
2021/12/22 16:02:03 Waiting for dst bucket item count to get to: 0 curr count: 15
2021/12/22 16:02:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLExhaustConnPool (98.85s)
=== RUN   TestN1QLGraceSufficientTimeOut
2021/12/22 16:02:08 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/22 16:02:08 App: TestN1QLGraceSufficientTimeOut got un-deployed
2021/12/22 16:02:08 No eventing-con process running
2021/12/22 16:02:08 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLGraceSufficientTimeOut not found"
}
2021/12/22 16:02:10 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:02:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:02:16 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:02:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:02:21 Starting bucket ops to source bucket
2021/12/22 16:02:39 Starting bucket ops to source bucket
2021/12/22 16:02:56 Deploying app: TestN1QLGraceSufficientTimeOut. Item count src bucket: 30000 dst bucket: 16587
2021/12/22 16:02:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut stored in temp store"
}
2021/12/22 16:03:02 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/22 16:03:07 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/22 16:03:12 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/22 16:03:17 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/22 16:03:17 App: TestN1QLGraceSufficientTimeOut got deployed
2021/12/22 16:03:17 Starting bucket ops to source bucket
2021/12/22 16:03:22 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/22 16:03:27 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/22 16:03:32 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/22 16:03:37 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/22 16:03:42 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/22 16:03:47 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/22 16:03:52 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/22 16:03:57 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/22 16:04:02 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/22 16:04:02 src & dst bucket item count matched up. src bucket count: 30001 dst bucket count: 30001
2021/12/22 16:04:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 16:04:08 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/22 16:04:13 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/22 16:04:18 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/22 16:04:23 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/22 16:04:23 App: TestN1QLGraceSufficientTimeOut got un-deployed
2021/12/22 16:04:23 No eventing-con process running
2021/12/22 16:04:23 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut deleting in background"
}
2021/12/22 16:04:25 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:04:35 Waiting for dst bucket item count to get to: 0 curr count: 30000
2021/12/22 16:04:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:04:36 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:04:46 Waiting for dst bucket item count to get to: 0 curr count: 30001
2021/12/22 16:04:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLGraceSufficientTimeOut (163.37s)
=== RUN   TestN1QLQueryConsistency
2021/12/22 16:04:51 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/22 16:04:51 App: n1qlquery_consistency got un-deployed
2021/12/22 16:04:51 No eventing-con process running
2021/12/22 16:04:51 Function: n1qlquery_consistency delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: n1qlquery_consistency not found"
}
2021/12/22 16:04:53 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:04:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:05:00 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:05:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:05:05 Starting bucket ops to source bucket
2021/12/22 16:05:08 Deploying app: n1qlquery_consistency. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:05:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency stored in temp store"
}
2021/12/22 16:05:14 Waiting for app: n1qlquery_consistency to get deployed
2021/12/22 16:05:19 Waiting for app: n1qlquery_consistency to get deployed
2021/12/22 16:05:24 Waiting for app: n1qlquery_consistency to get deployed
2021/12/22 16:05:29 Waiting for app: n1qlquery_consistency to get deployed
2021/12/22 16:05:29 App: n1qlquery_consistency got deployed
2021/12/22 16:05:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/22 16:05:39 Waiting for dst bucket item count to get to: 5000 curr count: 4358
2021/12/22 16:05:44 Waiting for dst bucket item count to get to: 5000 curr count: 4358
2021/12/22 16:05:44 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/22 16:05:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/22 16:05:49 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/22 16:05:54 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/22 16:05:59 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/22 16:06:04 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/22 16:06:04 App: n1qlquery_consistency got un-deployed
2021/12/22 16:06:04 No eventing-con process running
2021/12/22 16:06:04 Function: n1qlquery_consistency delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency deleting in background"
}
2021/12/22 16:06:06 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:06:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/22 16:06:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:06:18 Context: Bucket flush, response code: 200 dump: 
2021/12/22 16:06:28 Waiting for dst bucket item count to get to: 0 curr count: 3455
2021/12/22 16:06:33 Waiting for dst bucket item count to get to: 0 curr count: 955
2021/12/22 16:06:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLQueryConsistency (106.59s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	1542.690s

N1ql tests took 0 hours, 25 minutes and 47 seconds.

Starting server
Starting server: attempt 1

Rebalance tests

2021/12/22 16:08:08 Started rebalance
Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:52902->127.0.0.1:9000: read: connection reset by peer
Quota setup Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:52902->127.0.0.1:9000: read: connection reset by peer
=== RUN   TestDuplicateWithEventingRebIn
2021/12/22 16:08:27 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/22 16:08:27 App: TestDuplicateWithEventingRebIn got un-deployed
2021/12/22 16:08:27 No eventing-con process running
2021/12/22 16:08:27 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebIn not found"
}
2021/12/22 16:08:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:08:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:08:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:08:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:08:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:08:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:08:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:08:45 Deploying app: TestDuplicateWithEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:08:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn stored in temp store"
}
2021/12/22 16:08:51 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/22 16:08:56 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/22 16:09:01 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/22 16:09:06 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/22 16:09:06 App: TestDuplicateWithEventingRebIn got deployed
2021/12/22 16:09:06 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:09:06 Starting bucket ops to source bucket
2021/12/22 16:09:21 Removing node(s): [] from the cluster
2021/12/22 16:09:26 Rebalance progress: 0
2021/12/22 16:09:31 Rebalance progress: 0
2021/12/22 16:09:36 Rebalance progress: 25
2021/12/22 16:09:41 Rebalance progress: 25
2021/12/22 16:09:46 Rebalance progress: 25
2021/12/22 16:09:51 Rebalance progress: 96.875
2021/12/22 16:09:56 Rebalance progress: 96.875
2021/12/22 16:10:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:10:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:10:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:10:01 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/22 16:10:01 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:10:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:10:06 Rebalance progress: 25
2021/12/22 16:10:11 Rebalance progress: 25
2021/12/22 16:10:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:10:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:10:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:10:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/22 16:10:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:10:16 Waiting for src bucket item count to get to: 200000 curr count: 103937
2021/12/22 16:10:21 Waiting for src bucket item count to get to: 200000 curr count: 103937
2021/12/22 16:10:26 Waiting for src bucket item count to get to: 200000 curr count: 120598
2021/12/22 16:10:31 Waiting for src bucket item count to get to: 200000 curr count: 120598
2021/12/22 16:10:36 Waiting for src bucket item count to get to: 200000 curr count: 137331
2021/12/22 16:10:41 Waiting for src bucket item count to get to: 200000 curr count: 137331
2021/12/22 16:10:46 Waiting for src bucket item count to get to: 200000 curr count: 154231
2021/12/22 16:10:51 Waiting for src bucket item count to get to: 200000 curr count: 154231
2021/12/22 16:10:56 Waiting for src bucket item count to get to: 200000 curr count: 170630
2021/12/22 16:11:01 Waiting for src bucket item count to get to: 200000 curr count: 170630
2021/12/22 16:11:06 Waiting for src bucket item count to get to: 200000 curr count: 186953
2021/12/22 16:11:11 Waiting for src bucket item count to get to: 200000 curr count: 186953
2021/12/22 16:11:16 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 16:11:16 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 16:11:21 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/22 16:11:26 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/22 16:11:31 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/22 16:11:36 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/22 16:11:36 App: TestDuplicateWithEventingRebIn got un-deployed
2021/12/22 16:11:36 No eventing-con process running
2021/12/22 16:11:36 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn deleting in background"
}
2021/12/22 16:11:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:11:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:11:48 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:11:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:11:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:11:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:11:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebIn (217.40s)
=== RUN   TestDuplicateWithEventingRebOut
2021/12/22 16:11:59 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:12:00 Removing node(s): [] from the cluster
2021/12/22 16:12:05 Rebalance progress: 100
2021/12/22 16:12:10 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/22 16:12:10 App: TestDuplicateWithEventingRebOut got un-deployed
2021/12/22 16:12:10 No eventing-con process running
2021/12/22 16:12:10 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebOut not found"
}
2021/12/22 16:12:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:12:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:12:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:12:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:12:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:12:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:12:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:12:28 Deploying app: TestDuplicateWithEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:12:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut stored in temp store"
}
2021/12/22 16:12:35 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/22 16:12:40 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/22 16:12:45 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/22 16:12:50 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/22 16:12:50 App: TestDuplicateWithEventingRebOut got deployed
2021/12/22 16:12:50 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:12:50 Starting bucket ops to source bucket
2021/12/22 16:12:55 Rebalance progress: 25
2021/12/22 16:13:00 Rebalance progress: 25
2021/12/22 16:13:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:13:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:13:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:13:05 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/22 16:13:05 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:13:05 Waiting for src bucket item count to get to: 200000 curr count: 15834
2021/12/22 16:13:10 Waiting for src bucket item count to get to: 200000 curr count: 15834
2021/12/22 16:13:15 Waiting for src bucket item count to get to: 200000 curr count: 32534
2021/12/22 16:13:20 Waiting for src bucket item count to get to: 200000 curr count: 32534
2021/12/22 16:13:25 Waiting for src bucket item count to get to: 200000 curr count: 49388
2021/12/22 16:13:30 Waiting for src bucket item count to get to: 200000 curr count: 65888
2021/12/22 16:13:35 Waiting for src bucket item count to get to: 200000 curr count: 65888
2021/12/22 16:13:40 Waiting for src bucket item count to get to: 200000 curr count: 65888
2021/12/22 16:13:45 Waiting for src bucket item count to get to: 200000 curr count: 82259
2021/12/22 16:13:50 Waiting for src bucket item count to get to: 200000 curr count: 82259
2021/12/22 16:13:55 Waiting for src bucket item count to get to: 200000 curr count: 98875
2021/12/22 16:14:00 Waiting for src bucket item count to get to: 200000 curr count: 98875
2021/12/22 16:14:05 Waiting for src bucket item count to get to: 200000 curr count: 115654
2021/12/22 16:14:10 Waiting for src bucket item count to get to: 200000 curr count: 115654
2021/12/22 16:14:15 Waiting for src bucket item count to get to: 200000 curr count: 132590
2021/12/22 16:14:20 Waiting for src bucket item count to get to: 200000 curr count: 132590
2021/12/22 16:14:25 Waiting for src bucket item count to get to: 200000 curr count: 149597
2021/12/22 16:14:30 Waiting for src bucket item count to get to: 200000 curr count: 149597
2021/12/22 16:14:35 Waiting for src bucket item count to get to: 200000 curr count: 166545
2021/12/22 16:14:40 Waiting for src bucket item count to get to: 200000 curr count: 166545
2021/12/22 16:14:45 Waiting for src bucket item count to get to: 200000 curr count: 183018
2021/12/22 16:14:50 Waiting for src bucket item count to get to: 200000 curr count: 183018
2021/12/22 16:14:55 Waiting for src bucket item count to get to: 200000 curr count: 199700
2021/12/22 16:15:00 Waiting for src bucket item count to get to: 200000 curr count: 199700
2021/12/22 16:15:05 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 16:15:05 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 16:15:10 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/22 16:15:15 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/22 16:15:20 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/22 16:15:25 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/22 16:15:25 App: TestDuplicateWithEventingRebOut got un-deployed
2021/12/22 16:15:25 No eventing-con process running
2021/12/22 16:15:25 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut deleting in background"
}
2021/12/22 16:15:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:15:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:15:37 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:15:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:15:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:15:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:15:48 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:15:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebOut (234.02s)
=== RUN   TestDuplicateWithEventingSwapReb
2021/12/22 16:15:58 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/22 16:15:58 App: TestDuplicateWithEventingSwapReb got un-deployed
2021/12/22 16:15:58 No eventing-con process running
2021/12/22 16:15:58 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingSwapReb not found"
}
2021/12/22 16:16:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:16:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:16:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:16:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:16:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:16:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:16:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:16:17 Deploying app: TestDuplicateWithEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:16:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb stored in temp store"
}
2021/12/22 16:16:23 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/22 16:16:28 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/22 16:16:33 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/22 16:16:38 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/22 16:16:38 App: TestDuplicateWithEventingSwapReb got deployed
2021/12/22 16:16:38 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:16:38 Starting bucket ops to source bucket
2021/12/22 16:16:38 Removing node(s): [] from the cluster
2021/12/22 16:16:43 Rebalance progress: 25
2021/12/22 16:16:48 Rebalance progress: 25
2021/12/22 16:16:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:16:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:16:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:16:53 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/22 16:16:53 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:16:53 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:17:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:17:05 Rebalance progress: 16.66666666666667
2021/12/22 16:17:10 Rebalance progress: 16.66666666666667
2021/12/22 16:17:15 Rebalance progress: 16.66666666666667
2021/12/22 16:17:20 Rebalance progress: 26.81159420289855
2021/12/22 16:17:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:17:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:17:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:17:25 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:17:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 16:17:30 Rebalance progress: 16.66666666666667
2021/12/22 16:17:35 Rebalance progress: 16.66666666666667
2021/12/22 16:17:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:17:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:17:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:17:41 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:17:41 Waiting for src bucket item count to get to: 200000 curr count: 75904
2021/12/22 16:17:46 Waiting for src bucket item count to get to: 200000 curr count: 92503
2021/12/22 16:17:51 Waiting for src bucket item count to get to: 200000 curr count: 92503
2021/12/22 16:17:56 Waiting for src bucket item count to get to: 200000 curr count: 108904
2021/12/22 16:18:01 Waiting for src bucket item count to get to: 200000 curr count: 108904
2021/12/22 16:18:06 Waiting for src bucket item count to get to: 200000 curr count: 125885
2021/12/22 16:18:11 Waiting for src bucket item count to get to: 200000 curr count: 125885
2021/12/22 16:18:16 Waiting for src bucket item count to get to: 200000 curr count: 142197
2021/12/22 16:18:21 Waiting for src bucket item count to get to: 200000 curr count: 142197
2021/12/22 16:18:26 Waiting for src bucket item count to get to: 200000 curr count: 158701
2021/12/22 16:18:31 Waiting for src bucket item count to get to: 200000 curr count: 158701
2021/12/22 16:18:36 Waiting for src bucket item count to get to: 200000 curr count: 174844
2021/12/22 16:18:41 Waiting for src bucket item count to get to: 200000 curr count: 174844
2021/12/22 16:18:46 Waiting for src bucket item count to get to: 200000 curr count: 191480
2021/12/22 16:18:51 Waiting for src bucket item count to get to: 200000 curr count: 191480
2021/12/22 16:18:56 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 16:18:56 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 16:19:01 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/22 16:19:06 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/22 16:19:11 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/22 16:19:16 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/22 16:19:16 App: TestDuplicateWithEventingSwapReb got un-deployed
2021/12/22 16:19:16 No eventing-con process running
2021/12/22 16:19:16 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb deleting in background"
}
2021/12/22 16:19:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:19:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:19:28 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:19:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:19:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:19:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:19:39 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:19:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingSwapReb (230.92s)
=== RUN   TestDuplicateWithKVRebIn
2021/12/22 16:19:49 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/22 16:19:49 App: TestDuplicateWithKVRebIn got un-deployed
2021/12/22 16:19:49 No eventing-con process running
2021/12/22 16:19:49 Function: TestDuplicateWithKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebIn not found"
}
2021/12/22 16:19:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:19:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:19:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:19:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:20:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:20:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:20:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:20:08 Deploying app: TestDuplicateWithKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:20:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn stored in temp store"
}
2021/12/22 16:20:14 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/22 16:20:19 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/22 16:20:24 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/22 16:20:29 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/22 16:20:29 App: TestDuplicateWithKVRebIn got deployed
2021/12/22 16:20:29 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 16:20:29 Starting bucket ops to source bucket
2021/12/22 16:20:29 Removing node(s): [] from the cluster
2021/12/22 16:20:34 Rebalance progress: 16.66666666666667
2021/12/22 16:20:39 Rebalance progress: 16.66666666666667
2021/12/22 16:20:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:20:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:20:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:20:44 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:20:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:20:49 Rebalance progress: 16.66666666666667
2021/12/22 16:20:54 Rebalance progress: 16.66666666666667
2021/12/22 16:20:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:20:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:20:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:20:59 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:20:59 Waiting for src bucket item count to get to: 200000 curr count: 32035
2021/12/22 16:21:04 Waiting for src bucket item count to get to: 200000 curr count: 48248
2021/12/22 16:21:09 Waiting for src bucket item count to get to: 200000 curr count: 48248
2021/12/22 16:21:14 Waiting for src bucket item count to get to: 200000 curr count: 64584
2021/12/22 16:21:19 Waiting for src bucket item count to get to: 200000 curr count: 64584
2021/12/22 16:21:24 Waiting for src bucket item count to get to: 200000 curr count: 80228
2021/12/22 16:21:29 Waiting for src bucket item count to get to: 200000 curr count: 80228
2021/12/22 16:21:34 Waiting for src bucket item count to get to: 200000 curr count: 96330
2021/12/22 16:21:39 Waiting for src bucket item count to get to: 200000 curr count: 96330
2021/12/22 16:21:44 Waiting for src bucket item count to get to: 200000 curr count: 96330
2021/12/22 16:21:49 Waiting for src bucket item count to get to: 200000 curr count: 113032
2021/12/22 16:21:54 Waiting for src bucket item count to get to: 200000 curr count: 129899
2021/12/22 16:21:59 Waiting for src bucket item count to get to: 200000 curr count: 129899
2021/12/22 16:22:04 Waiting for src bucket item count to get to: 200000 curr count: 146755
2021/12/22 16:22:09 Waiting for src bucket item count to get to: 200000 curr count: 146755
2021/12/22 16:22:14 Waiting for src bucket item count to get to: 200000 curr count: 163098
2021/12/22 16:22:19 Waiting for src bucket item count to get to: 200000 curr count: 163098
2021/12/22 16:22:24 Waiting for src bucket item count to get to: 200000 curr count: 178745
2021/12/22 16:22:29 Waiting for src bucket item count to get to: 200000 curr count: 178745
2021/12/22 16:22:34 Waiting for src bucket item count to get to: 200000 curr count: 194608
2021/12/22 16:22:39 Waiting for src bucket item count to get to: 200000 curr count: 194608
2021/12/22 16:22:44 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 16:22:44 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 16:22:50 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/22 16:22:55 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/22 16:23:00 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/22 16:23:05 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/22 16:23:05 App: TestDuplicateWithKVRebIn got un-deployed
2021/12/22 16:23:05 No eventing-con process running
2021/12/22 16:23:05 Function: TestDuplicateWithKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn deleting in background"
}
2021/12/22 16:23:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:23:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:23:16 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:23:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:23:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:23:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:23:28 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:23:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebIn (228.91s)
=== RUN   TestDuplicateWithKVRebOut
2021/12/22 16:23:33 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 16:23:34 Removing node(s): [] from the cluster
2021/12/22 16:23:39 Rebalance progress: 100
2021/12/22 16:23:44 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/22 16:23:44 App: TestDuplicateWithKVRebOut got un-deployed
2021/12/22 16:23:44 No eventing-con process running
2021/12/22 16:23:44 Function: TestDuplicateWithKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebOut not found"
}
2021/12/22 16:23:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:23:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:23:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:23:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:23:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:23:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:24:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:24:02 Deploying app: TestDuplicateWithKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:24:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut stored in temp store"
}
2021/12/22 16:24:08 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/22 16:24:13 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/22 16:24:18 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/22 16:24:23 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/22 16:24:23 App: TestDuplicateWithKVRebOut got deployed
2021/12/22 16:24:23 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:24:23 Starting bucket ops to source bucket
2021/12/22 16:24:28 Rebalance progress: 16.66666666666667
2021/12/22 16:24:33 Rebalance progress: 16.66666666666667
2021/12/22 16:24:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:24:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:24:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:24:38 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:24:38 Waiting for src bucket item count to get to: 200000 curr count: 9071
2021/12/22 16:24:43 Waiting for src bucket item count to get to: 200000 curr count: 25417
2021/12/22 16:24:48 Waiting for src bucket item count to get to: 200000 curr count: 25417
2021/12/22 16:24:53 Waiting for src bucket item count to get to: 200000 curr count: 42140
2021/12/22 16:24:58 Waiting for src bucket item count to get to: 200000 curr count: 42140
2021/12/22 16:25:03 Waiting for src bucket item count to get to: 200000 curr count: 58997
2021/12/22 16:25:08 Waiting for src bucket item count to get to: 200000 curr count: 58997
2021/12/22 16:25:13 Waiting for src bucket item count to get to: 200000 curr count: 58997
2021/12/22 16:25:18 Waiting for src bucket item count to get to: 200000 curr count: 75307
2021/12/22 16:25:23 Waiting for src bucket item count to get to: 200000 curr count: 75307
2021/12/22 16:25:28 Waiting for src bucket item count to get to: 200000 curr count: 91441
2021/12/22 16:25:33 Waiting for src bucket item count to get to: 200000 curr count: 91441
2021/12/22 16:25:38 Waiting for src bucket item count to get to: 200000 curr count: 107850
2021/12/22 16:25:43 Waiting for src bucket item count to get to: 200000 curr count: 107850
2021/12/22 16:25:48 Waiting for src bucket item count to get to: 200000 curr count: 124553
2021/12/22 16:25:53 Waiting for src bucket item count to get to: 200000 curr count: 124553
2021/12/22 16:25:58 Waiting for src bucket item count to get to: 200000 curr count: 141301
2021/12/22 16:26:03 Waiting for src bucket item count to get to: 200000 curr count: 141301
2021/12/22 16:26:08 Waiting for src bucket item count to get to: 200000 curr count: 158083
2021/12/22 16:26:13 Waiting for src bucket item count to get to: 200000 curr count: 158083
2021/12/22 16:26:18 Waiting for src bucket item count to get to: 200000 curr count: 174484
2021/12/22 16:26:24 Waiting for src bucket item count to get to: 200000 curr count: 174484
2021/12/22 16:26:29 Waiting for src bucket item count to get to: 200000 curr count: 190311
2021/12/22 16:26:34 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 16:26:34 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 16:26:39 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/22 16:26:44 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/22 16:26:49 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/22 16:26:54 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/22 16:26:54 App: TestDuplicateWithKVRebOut got un-deployed
2021/12/22 16:26:54 No eventing-con process running
2021/12/22 16:26:54 Function: TestDuplicateWithKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut deleting in background"
}
2021/12/22 16:26:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:27:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:27:05 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:27:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:27:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:27:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:27:17 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:27:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebOut (229.03s)
=== RUN   TestDuplicateWithKVSwapReb
2021/12/22 16:27:27 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/22 16:27:27 App: TestDuplicateWithKVSwapReb got un-deployed
2021/12/22 16:27:27 No eventing-con process running
2021/12/22 16:27:27 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVSwapReb not found"
}
2021/12/22 16:27:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:27:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:27:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:27:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:27:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:27:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:27:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:27:46 Deploying app: TestDuplicateWithKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:27:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb stored in temp store"
}
2021/12/22 16:27:52 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/22 16:27:57 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/22 16:28:02 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/22 16:28:07 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/22 16:28:07 App: TestDuplicateWithKVSwapReb got deployed
2021/12/22 16:28:07 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 16:28:07 Starting bucket ops to source bucket
2021/12/22 16:28:08 Removing node(s): [] from the cluster
2021/12/22 16:28:13 Rebalance progress: 16.66666666666667
2021/12/22 16:28:18 Rebalance progress: 16.66666666666667
2021/12/22 16:28:23 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:28:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:28:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:28:23 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:28:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 16:28:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:28:29 Rebalance progress: 16.66666666666667
2021/12/22 16:28:34 Rebalance progress: 16.66666666666667
2021/12/22 16:28:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:28:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:28:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:28:39 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:28:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 16:28:44 Rebalance progress: 16.66666666666667
2021/12/22 16:28:49 Rebalance progress: 16.66666666666667
2021/12/22 16:28:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:28:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:28:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:28:54 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:28:54 Waiting for src bucket item count to get to: 200000 curr count: 67560
2021/12/22 16:28:59 Waiting for src bucket item count to get to: 200000 curr count: 67560
2021/12/22 16:29:04 Waiting for src bucket item count to get to: 200000 curr count: 82945
2021/12/22 16:29:09 Waiting for src bucket item count to get to: 200000 curr count: 82945
2021/12/22 16:29:14 Waiting for src bucket item count to get to: 200000 curr count: 99591
2021/12/22 16:29:19 Waiting for src bucket item count to get to: 200000 curr count: 99591
2021/12/22 16:29:24 Waiting for src bucket item count to get to: 200000 curr count: 116285
2021/12/22 16:29:29 Waiting for src bucket item count to get to: 200000 curr count: 116285
2021/12/22 16:29:34 Waiting for src bucket item count to get to: 200000 curr count: 133105
2021/12/22 16:29:39 Waiting for src bucket item count to get to: 200000 curr count: 133105
2021/12/22 16:29:44 Waiting for src bucket item count to get to: 200000 curr count: 149879
2021/12/22 16:29:49 Waiting for src bucket item count to get to: 200000 curr count: 149879
2021/12/22 16:29:54 Waiting for src bucket item count to get to: 200000 curr count: 166602
2021/12/22 16:29:59 Waiting for src bucket item count to get to: 200000 curr count: 166602
2021/12/22 16:30:04 Waiting for src bucket item count to get to: 200000 curr count: 182482
2021/12/22 16:30:09 Waiting for src bucket item count to get to: 200000 curr count: 182482
2021/12/22 16:30:14 Waiting for src bucket item count to get to: 200000 curr count: 199035
2021/12/22 16:30:19 Waiting for src bucket item count to get to: 200000 curr count: 199035
2021/12/22 16:30:24 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 16:30:24 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 16:30:29 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/22 16:30:34 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/22 16:30:39 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/22 16:30:44 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/22 16:30:44 App: TestDuplicateWithKVSwapReb got un-deployed
2021/12/22 16:30:44 No eventing-con process running
2021/12/22 16:30:44 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb deleting in background"
}
2021/12/22 16:30:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:30:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:30:56 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:30:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:30:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:31:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:31:08 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/22 16:31:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVSwapReb (230.38s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpOneByOne
2021/12/22 16:31:18 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:31:18 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/22 16:31:18 No eventing-con process running
2021/12/22 16:31:18 Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/22 16:31:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:31:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:31:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:31:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:31:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:31:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:31:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:31:36 Deploying app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:31:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/22 16:31:42 Starting bucket ops to source bucket
2021/12/22 16:31:47 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/22 16:31:52 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/22 16:31:57 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/22 16:31:57 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:31:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:31:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:31:57 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:31:57 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:31:58 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:32:03 Rebalance progress: 16.66666666666667
2021/12/22 16:32:08 Rebalance progress: 16.66666666666667
2021/12/22 16:32:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:32:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:32:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:32:13 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:32:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:32:13 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:32:18 Rebalance progress: 16.66666666666667
2021/12/22 16:32:23 Rebalance progress: 16.66666666666667
2021/12/22 16:32:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:32:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:32:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:32:28 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/22 16:32:28 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/22 16:32:33 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:32:38 Rebalance progress: 12.5
2021/12/22 16:32:43 Rebalance progress: 12.5
2021/12/22 16:32:48 Rebalance progress: 12.5
2021/12/22 16:32:53 Rebalance progress: 97.91666666666666
2021/12/22 16:32:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:32:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:32:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:32:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:33:03 Rebalance progress: 12.5
2021/12/22 16:33:08 Rebalance progress: 12.5
2021/12/22 16:33:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:33:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:33:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:33:13 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 16:33:18 Rebalance progress: 12.5
2021/12/22 16:33:23 Rebalance progress: 12.5
2021/12/22 16:33:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:33:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:33:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:33:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/22 16:33:34 Rebalance progress: 12.5
2021/12/22 16:33:39 Rebalance progress: 12.5
2021/12/22 16:33:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:33:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:33:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:33:49 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:33:54 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:33:59 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:34:04 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:34:04 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/22 16:34:04 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:34:04 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/22 16:34:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:34:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:34:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12137
2021/12/22 16:34:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:34:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:34:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:34:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12137
2021/12/22 16:34:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpOneByOne (199.85s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce
2021/12/22 16:34:37 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/22 16:34:37 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2021/12/22 16:34:37 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:34:37 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce not found"
}
2021/12/22 16:34:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:34:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:34:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:34:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:34:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:34:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:34:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:34:56 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:34:57 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce stored in temp store"
}
2021/12/22 16:35:02 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 16:35:07 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/22 16:35:12 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/22 16:35:17 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/22 16:35:17 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:35:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:35:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:35:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:35:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:35:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/22 16:35:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:35:23 Rebalance progress: 12.5
2021/12/22 16:35:28 Rebalance progress: 12.5
2021/12/22 16:35:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:35:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:35:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:35:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/22 16:35:38 Rebalance progress: 12.5
2021/12/22 16:35:43 Rebalance progress: 12.5
2021/12/22 16:35:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:35:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:35:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:35:53 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/22 16:35:59 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/22 16:36:04 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/22 16:36:09 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/22 16:36:09 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2021/12/22 16:36:09 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:36:09 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce deleting in background"
}
2021/12/22 16:36:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:36:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:36:20 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2211
2021/12/22 16:36:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2211
2021/12/22 16:36:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:36:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:36:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:36:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4615
2021/12/22 16:36:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce (129.71s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings
2021/12/22 16:36:47 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/22 16:36:47 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/22 16:36:47 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:36:47 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings not found"
}
2021/12/22 16:36:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:36:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:36:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:36:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:37:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:37:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:37:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:37:06 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:37:07 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2021/12/22 16:37:12 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 16:37:17 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/22 16:37:22 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/22 16:37:27 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/22 16:37:27 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:37:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:37:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:37:27 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:37:27 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:37:32 Rebalance progress: 12.5
2021/12/22 16:37:37 Rebalance progress: 12.5
2021/12/22 16:37:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:37:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:37:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:37:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:37:43 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:37:48 Rebalance progress: 12.5
2021/12/22 16:37:53 Rebalance progress: 12.5
2021/12/22 16:37:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:37:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:37:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:37:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/22 16:37:58 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:38:03 Rebalance progress: 12.5
2021/12/22 16:38:08 Rebalance progress: 12.5
2021/12/22 16:38:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:38:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:38:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:38:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:38:19 Rebalance progress: 12.5
2021/12/22 16:38:24 Rebalance progress: 12.5
2021/12/22 16:38:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:38:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:38:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:38:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 16:38:34 Rebalance progress: 12.5
2021/12/22 16:38:39 Rebalance progress: 12.5
2021/12/22 16:38:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:38:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:38:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:38:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/22 16:38:49 Rebalance progress: 12.5
2021/12/22 16:38:54 Rebalance progress: 12.5
2021/12/22 16:38:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:38:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:38:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:39:04 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/22 16:39:09 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/22 16:39:14 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/22 16:39:19 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/22 16:39:19 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/22 16:39:19 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:39:19 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2021/12/22 16:39:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:39:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:39:31 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9695
2021/12/22 16:39:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9695
2021/12/22 16:39:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:39:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:39:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:39:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10687
2021/12/22 16:39:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings (190.44s)
=== RUN   TestEventingSwapRebOnUpdateBucketOp
2021/12/22 16:39:58 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/22 16:39:58 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2021/12/22 16:39:58 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:39:58 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebOnUpdateBucketOp not found"
}
2021/12/22 16:39:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:40:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:40:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:40:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:40:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:40:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:40:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:40:11 eventingSetup.go:125: Deploying app: TestEventingSwapRebOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:40:12 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp stored in temp store"
}
2021/12/22 16:40:17 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 16:40:22 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/22 16:40:27 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/22 16:40:32 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/22 16:40:32 clusterSetup.go:354: App: TestEventingSwapRebOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:40:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:40:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:40:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:40:33 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:40:38 Rebalance progress: 12.5
2021/12/22 16:40:43 Rebalance progress: 12.5
2021/12/22 16:40:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:40:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:40:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:40:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:40:48 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:40:53 Rebalance progress: 12.5
2021/12/22 16:40:58 Rebalance progress: 12.5
2021/12/22 16:41:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:41:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:41:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:41:03 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 16:41:08 Rebalance progress: 12.5
2021/12/22 16:41:13 Rebalance progress: 12.5
2021/12/22 16:41:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:41:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:41:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:41:23 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/22 16:41:28 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/22 16:41:33 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/22 16:41:38 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/22 16:41:38 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2021/12/22 16:41:38 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:41:38 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp deleting in background"
}
2021/12/22 16:41:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:41:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:41:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 384
2021/12/22 16:41:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 384
2021/12/22 16:41:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:41:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:42:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:42:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6062
2021/12/22 16:42:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebOnUpdateBucketOp (139.12s)
=== RUN   TestMetaRollbackWithEventingReb
2021/12/22 16:42:12 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:42:12 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:42:17 Rebalance progress: 100
2021/12/22 16:42:22 Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/22 16:42:22 App: TestMetaRollbackWithEventingReb got un-deployed
2021/12/22 16:42:22 No eventing-con process running
2021/12/22 16:42:22 Function: TestMetaRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaRollbackWithEventingReb not found"
}
2021/12/22 16:42:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:42:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:42:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:42:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:42:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:42:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:42:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:42:35 Deploying app: TestMetaRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:42:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb stored in temp store"
}
2021/12/22 16:42:42 Starting bucket ops to source bucket
2021/12/22 16:42:47 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/22 16:42:52 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/22 16:42:57 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/22 16:42:57 App: TestMetaRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:42:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:42:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:42:57 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:42:57 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:43:02 Rebalance progress: 12.5
2021/12/22 16:43:07 Rebalance progress: 12.5
2021/12/22 16:43:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:43:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:43:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:43:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/22 16:43:13 bucketOps.go:134: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/22 16:43:18 Rebalance progress: 12.5
2021/12/22 16:43:23 Rebalance progress: 12.5
2021/12/22 16:43:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:43:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:43:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:43:33 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/22 16:43:38 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/22 16:43:43 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/22 16:43:48 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/22 16:43:48 clusterSetup.go:405: App: TestMetaRollbackWithEventingReb got un-deployed
2021/12/22 16:43:48 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:43:48 eventingSetup.go:418: Function: TestMetaRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb deleting in background"
}
2021/12/22 16:43:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:43:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:43:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:43:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:44:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:44:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4589
2021/12/22 16:44:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaRollbackWithEventingReb (119.57s)
=== RUN   TestMetaPartialRollbackWithEventingReb
2021/12/22 16:44:11 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:44:11 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:44:17 Rebalance progress: 100
2021/12/22 16:44:22 Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/22 16:44:22 App: TestMetaPartialRollbackWithEventingReb got un-deployed
2021/12/22 16:44:22 No eventing-con process running
2021/12/22 16:44:22 Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaPartialRollbackWithEventingReb not found"
}
2021/12/22 16:44:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:44:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:44:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:44:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:44:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:44:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:44:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:44:35 Deploying app: TestMetaPartialRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:44:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb stored in temp store"
}
2021/12/22 16:44:41 Starting bucket ops to source bucket
2021/12/22 16:44:46 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/22 16:44:51 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/22 16:44:56 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/22 16:44:56 App: TestMetaPartialRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:44:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:44:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:44:56 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:44:57 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:45:02 Rebalance progress: 12.5
2021/12/22 16:45:07 Rebalance progress: 12.5
2021/12/22 16:45:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:45:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:45:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:45:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/22 16:45:12 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/22 16:45:17 Rebalance progress: 12.5
2021/12/22 16:45:22 Rebalance progress: 12.5
2021/12/22 16:45:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:45:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:45:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:45:27 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/22 16:45:32 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/22 16:45:37 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/22 16:45:42 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/22 16:45:47 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/22 16:45:47 clusterSetup.go:405: App: TestMetaPartialRollbackWithEventingReb got un-deployed
2021/12/22 16:45:47 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:45:47 eventingSetup.go:418: Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb deleting in background"
}
2021/12/22 16:45:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:45:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:45:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 38110
2021/12/22 16:45:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:46:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:46:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:46:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 33048
2021/12/22 16:46:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 33048
2021/12/22 16:46:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaPartialRollbackWithEventingReb (129.54s)
=== RUN   TestEventingRebMultipleHandlersOneByOne
2021/12/22 16:46:26 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/22 16:46:26 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2021/12/22 16:46:26 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:46:26 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op not found"
}
2021/12/22 16:46:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:46:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:46:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:46:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:46:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:46:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:46:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:46:44 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:46:45 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:46:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:46:45 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:46:47 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update stored in temp store"
}
2021/12/22 16:46:52 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 16:46:57 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/22 16:47:02 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/22 16:47:07 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/22 16:47:07 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got deployed
2021/12/22 16:47:12 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/22 16:47:17 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/22 16:47:22 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/22 16:47:22 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:47:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:47:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:47:22 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:47:22 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:47:27 Rebalance progress: 12.5
2021/12/22 16:47:32 Rebalance progress: 12.5
2021/12/22 16:47:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:47:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:47:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:47:37 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:47:38 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:47:43 Rebalance progress: 12.5
2021/12/22 16:47:48 Rebalance progress: 12.5
2021/12/22 16:47:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:47:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:47:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:47:53 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/22 16:47:53 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:47:58 Rebalance progress: 12.5
2021/12/22 16:48:03 Rebalance progress: 12.5
2021/12/22 16:48:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:48:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:48:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:48:08 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:48:13 Rebalance progress: 12.5
2021/12/22 16:48:18 Rebalance progress: 12.5
2021/12/22 16:48:23 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:48:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:48:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:48:23 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 16:48:28 Rebalance progress: 12.5
2021/12/22 16:48:33 Rebalance progress: 12.5
2021/12/22 16:48:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:48:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:48:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:48:38 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/22 16:48:44 Rebalance progress: 12.5
2021/12/22 16:48:49 Rebalance progress: 12.5
2021/12/22 16:48:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:48:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:48:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:48:59 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/22 16:49:04 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/22 16:49:09 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/22 16:49:14 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/22 16:49:14 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2021/12/22 16:49:14 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:49:14 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op deleting in background"
}
2021/12/22 16:49:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:49:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:49:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12193
2021/12/22 16:49:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:49:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:49:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:49:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12193
2021/12/22 16:49:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:49:44 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/22 16:49:49 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/22 16:49:54 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/22 16:49:59 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/22 16:49:59 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got un-deployed
2021/12/22 16:49:59 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:49:59 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update deleting in background"
}
2021/12/22 16:50:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:50:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:50:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:50:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:50:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:50:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersOneByOne (236.79s)
=== RUN   TestEventingRebMultipleHandlersAllAtOnce
2021/12/22 16:50:23 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/22 16:50:23 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2021/12/22 16:50:23 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:50:23 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op not found"
}
2021/12/22 16:50:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:50:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:50:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:50:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:50:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:50:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:50:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:50:41 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:50:42 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:50:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:50:42 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:50:43 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update stored in temp store"
}
2021/12/22 16:50:48 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 16:50:53 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/22 16:50:58 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/22 16:51:03 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/22 16:51:03 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got deployed
2021/12/22 16:51:08 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/22 16:51:14 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/22 16:51:19 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/22 16:51:19 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:51:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:51:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:51:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:51:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:51:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/22 16:51:19 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:51:24 Rebalance progress: 12.5
2021/12/22 16:51:29 Rebalance progress: 12.5
2021/12/22 16:51:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:51:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:51:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:51:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/22 16:51:39 Rebalance progress: 12.5
2021/12/22 16:51:44 Rebalance progress: 12.5
2021/12/22 16:51:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:51:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:51:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:51:55 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/22 16:52:00 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/22 16:52:05 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/22 16:52:10 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/22 16:52:10 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2021/12/22 16:52:10 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:52:10 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op deleting in background"
}
2021/12/22 16:52:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:52:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:52:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6104
2021/12/22 16:52:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6104
2021/12/22 16:52:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:52:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:52:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:52:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1797
2021/12/22 16:52:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1797
2021/12/22 16:52:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:52:50 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/22 16:52:55 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/22 16:53:00 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/22 16:53:05 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/22 16:53:05 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got un-deployed
2021/12/22 16:53:05 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:53:06 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update deleting in background"
}
2021/12/22 16:53:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:53:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:53:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:53:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:53:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:53:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersAllAtOnce (186.39s)
=== RUN   TestEventingSwapRebMultipleHandlers
2021/12/22 16:53:29 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/22 16:53:29 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2021/12/22 16:53:29 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:53:29 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update not found"
}
2021/12/22 16:53:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:53:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:53:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:53:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:53:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:53:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:53:47 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/22 16:53:47 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2021/12/22 16:53:47 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:53:48 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op not found"
}
2021/12/22 16:53:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:53:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:53:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:53:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:54:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:54:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:54:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:54:01 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlersbucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:54:02 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:54:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:54:02 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:54:03 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op stored in temp store"
}
2021/12/22 16:54:08 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 16:54:13 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/22 16:54:18 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/22 16:54:23 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/22 16:54:23 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got deployed
2021/12/22 16:54:28 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/22 16:54:33 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/22 16:54:38 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/22 16:54:38 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:54:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:54:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:54:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:54:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:54:44 Rebalance progress: 12.5
2021/12/22 16:54:49 Rebalance progress: 12.5
2021/12/22 16:54:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:54:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:54:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:54:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:54:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:54:59 Rebalance progress: 12.5
2021/12/22 16:55:04 Rebalance progress: 12.5
2021/12/22 16:55:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:55:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:55:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:55:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 16:55:14 Rebalance progress: 12.5
2021/12/22 16:55:19 Rebalance progress: 12.5
2021/12/22 16:55:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:55:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:55:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:55:29 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/22 16:55:35 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/22 16:55:40 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/22 16:55:45 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/22 16:55:45 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2021/12/22 16:55:45 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:55:45 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update deleting in background"
}
2021/12/22 16:55:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:55:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:55:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7604
2021/12/22 16:55:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:55:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:56:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:56:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:56:10 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/22 16:56:15 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/22 16:56:20 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/22 16:56:25 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/22 16:56:25 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2021/12/22 16:56:25 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:56:25 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op deleting in background"
}
2021/12/22 16:56:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:56:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:56:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:56:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:56:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:56:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebMultipleHandlers (199.14s)
=== RUN   TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/22 16:56:48 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:56:48 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/22 16:56:48 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:56:48 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/22 16:56:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:56:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:56:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:56:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:57:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:57:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:57:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:57:07 eventingSetup.go:125: Deploying app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/22 16:57:08 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/22 16:57:13 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 16:57:18 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/22 16:57:23 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/22 16:57:28 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/22 16:57:28 clusterSetup.go:354: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:57:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:57:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:57:28 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 16:57:28 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:57:48 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:57:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:57:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:58:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:58:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:58:19 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 16:58:24 Rebalance progress: 12.5
2021/12/22 16:58:29 Rebalance progress: 12.5
2021/12/22 16:58:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:58:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:58:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:58:34 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 16:58:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 16:58:40 Rebalance progress: 12.5
2021/12/22 16:58:45 Rebalance progress: 12.5
2021/12/22 16:58:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:58:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:58:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:58:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 16:58:55 Rebalance progress: 12.5
2021/12/22 16:59:00 Rebalance progress: 12.5
2021/12/22 16:59:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:59:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:59:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 16:59:10 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:59:15 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:59:20 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:59:25 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:59:25 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/22 16:59:25 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:59:25 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/22 16:59:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:59:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:59:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11185
2021/12/22 16:59:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 16:59:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 16:59:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 16:59:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11185
2021/12/22 16:59:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne (190.33s)
=== RUN   TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/22 16:59:58 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 16:59:58 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/22 16:59:59 eventingSetup.go:46: No eventing-con process running
2021/12/22 16:59:59 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/22 17:00:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:00:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:00:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:00:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:00:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:00:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:00:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:00:17 eventingSetup.go:125: Deploying app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:00:18 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/22 17:00:23 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 17:00:28 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/22 17:00:33 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/22 17:00:38 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/22 17:00:38 clusterSetup.go:354: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:00:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:00:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:00:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:00:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 17:00:59 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:00:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:00:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:01:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:01:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:01:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:01:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 17:01:30 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:01:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:01:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:01:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:01:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:01:40 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:01:41 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 17:02:01 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:02:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:02:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:02:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:02:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:02:11 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:02:12 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 17:02:32 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:02:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:02:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:02:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:02:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:02:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:02:42 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 17:03:02 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:03:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:03:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:03:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:03:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:03:13 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 17:03:18 Rebalance progress: 12.5
2021/12/22 17:03:23 Rebalance progress: 12.5
2021/12/22 17:03:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:03:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:03:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:03:28 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 17:03:28 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 17:03:33 Rebalance progress: 12.5
2021/12/22 17:03:38 Rebalance progress: 12.5
2021/12/22 17:03:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:03:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:03:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:03:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 17:03:48 Rebalance progress: 12.5
2021/12/22 17:03:53 Rebalance progress: 12.5
2021/12/22 17:03:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:03:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:03:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:04:04 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 17:04:09 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 17:04:14 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 17:04:19 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/22 17:04:19 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/22 17:04:19 eventingSetup.go:46: No eventing-con process running
2021/12/22 17:04:19 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/22 17:04:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:04:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:04:31 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12251
2021/12/22 17:04:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12251
2021/12/22 17:04:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:04:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:04:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:04:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21515
2021/12/22 17:04:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne (298.86s)
=== RUN   TestEventingFailoverOnUpdateBucketOp
2021/12/22 17:04:57 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/22 17:04:57 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2021/12/22 17:04:57 eventingSetup.go:46: No eventing-con process running
2021/12/22 17:04:57 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingFailoverOnUpdateBucketOp not found"
}
2021/12/22 17:04:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:05:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:05:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:05:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:05:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:05:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:05:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:05:16 eventingSetup.go:125: Deploying app: TestEventingFailoverOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:05:17 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp stored in temp store"
}
2021/12/22 17:05:22 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 17:05:27 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/22 17:05:32 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/22 17:05:37 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/22 17:05:37 clusterSetup.go:354: App: TestEventingFailoverOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:05:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:05:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:05:37 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:05:38 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 17:05:43 Rebalance progress: 12.5
2021/12/22 17:05:48 Rebalance progress: 12.5
2021/12/22 17:05:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:05:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:05:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:05:53 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:06:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:06:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:06:03 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 17:06:08 Rebalance progress: 12.5
2021/12/22 17:06:13 Rebalance progress: 12.5
2021/12/22 17:06:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:06:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:06:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:06:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 17:06:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 17:06:24 Rebalance progress: 12.5
2021/12/22 17:06:29 Rebalance progress: 12.5
2021/12/22 17:06:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:06:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:06:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:06:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 17:06:39 Rebalance progress: 12.5
2021/12/22 17:06:44 Rebalance progress: 12.5
2021/12/22 17:06:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:06:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:06:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:06:54 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/22 17:06:59 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/22 17:07:04 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/22 17:07:09 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/22 17:07:09 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2021/12/22 17:07:09 eventingSetup.go:46: No eventing-con process running
2021/12/22 17:07:09 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp deleting in background"
}
2021/12/22 17:07:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:07:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:07:21 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8052
2021/12/22 17:07:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8052
2021/12/22 17:07:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:07:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:07:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:07:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8674
2021/12/22 17:07:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingFailoverOnUpdateBucketOp (170.28s)
=== RUN   TestEventingKVRebalanceOnUpdateBucketOp
2021/12/22 17:07:48 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/22 17:07:48 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2021/12/22 17:07:48 eventingSetup.go:46: No eventing-con process running
2021/12/22 17:07:48 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingKVRebalanceOnUpdateBucketOp not found"
}
2021/12/22 17:07:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:07:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:07:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:07:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:08:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:08:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:08:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:08:06 eventingSetup.go:125: Deploying app: TestEventingKVRebalanceOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:08:07 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp stored in temp store"
}
2021/12/22 17:08:12 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 17:08:17 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/22 17:08:22 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/22 17:08:27 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/22 17:08:27 clusterSetup.go:354: App: TestEventingKVRebalanceOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:08:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:08:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:08:27 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing,kv to the cluster
2021/12/22 17:08:28 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 17:08:33 Rebalance progress: 12.5
2021/12/22 17:08:38 Rebalance progress: 12.5
2021/12/22 17:08:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:08:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:08:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:08:43 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing,kv to the cluster
2021/12/22 17:08:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 17:08:48 Rebalance progress: 12.5
2021/12/22 17:08:53 Rebalance progress: 12.5
2021/12/22 17:08:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:08:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:08:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:08:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 17:09:03 Rebalance progress: 12.5
2021/12/22 17:09:08 Rebalance progress: 12.5
2021/12/22 17:09:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:09:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:09:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:09:18 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/22 17:09:23 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/22 17:09:29 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/22 17:09:34 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/22 17:09:34 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2021/12/22 17:09:34 eventingSetup.go:46: No eventing-con process running
2021/12/22 17:09:34 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp deleting in background"
}
2021/12/22 17:09:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:09:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:09:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6076
2021/12/22 17:09:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:09:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:09:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:09:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6076
2021/12/22 17:09:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingKVRebalanceOnUpdateBucketOp (139.44s)
=== RUN   TestEventingRebInWithOps
2021/12/22 17:10:07 clusterSetup.go:397: Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/22 17:10:07 clusterSetup.go:405: App: TestEventingRebInWithOps got un-deployed
2021/12/22 17:10:07 eventingSetup.go:46: No eventing-con process running
2021/12/22 17:10:07 eventingSetup.go:418: Function: TestEventingRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithOps not found"
}
2021/12/22 17:10:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:10:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:10:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:10:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:10:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:10:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:10:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:10:26 eventingSetup.go:125: Deploying app: TestEventingRebInWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:10:27 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps stored in temp store"
}
2021/12/22 17:10:32 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/22 17:10:37 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/22 17:10:42 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/22 17:10:47 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/22 17:10:47 clusterSetup.go:354: App: TestEventingRebInWithOps got deployed
2021/12/22 17:10:47 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:10:47 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 17:10:47 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 17:10:52 Rebalance progress: 12.5
2021/12/22 17:10:57 Rebalance progress: 12.5
2021/12/22 17:11:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:11:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:11:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:11:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 17:11:07 Rebalance progress: 12.5
2021/12/22 17:11:12 Rebalance progress: 12.5
2021/12/22 17:11:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:11:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:11:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:11:17 Waiting for src bucket item count to get to: 200000 curr count: 34974
2021/12/22 17:11:22 Waiting for src bucket item count to get to: 200000 curr count: 50710
2021/12/22 17:11:27 Waiting for src bucket item count to get to: 200000 curr count: 50710
2021/12/22 17:11:32 Waiting for src bucket item count to get to: 200000 curr count: 67042
2021/12/22 17:11:37 Waiting for src bucket item count to get to: 200000 curr count: 67042
2021/12/22 17:11:42 Waiting for src bucket item count to get to: 200000 curr count: 81869
2021/12/22 17:11:47 Waiting for src bucket item count to get to: 200000 curr count: 81869
2021/12/22 17:11:52 Waiting for src bucket item count to get to: 200000 curr count: 81869
2021/12/22 17:11:57 Waiting for src bucket item count to get to: 200000 curr count: 98284
2021/12/22 17:12:02 Waiting for src bucket item count to get to: 200000 curr count: 98284
2021/12/22 17:12:07 Waiting for src bucket item count to get to: 200000 curr count: 114679
2021/12/22 17:12:12 Waiting for src bucket item count to get to: 200000 curr count: 114679
2021/12/22 17:12:17 Waiting for src bucket item count to get to: 200000 curr count: 131320
2021/12/22 17:12:22 Waiting for src bucket item count to get to: 200000 curr count: 131320
2021/12/22 17:12:27 Waiting for src bucket item count to get to: 200000 curr count: 147619
2021/12/22 17:12:32 Waiting for src bucket item count to get to: 200000 curr count: 147619
2021/12/22 17:12:37 Waiting for src bucket item count to get to: 200000 curr count: 164074
2021/12/22 17:12:42 Waiting for src bucket item count to get to: 200000 curr count: 164074
2021/12/22 17:12:47 Waiting for src bucket item count to get to: 200000 curr count: 178810
2021/12/22 17:12:52 Waiting for src bucket item count to get to: 200000 curr count: 178810
2021/12/22 17:12:57 Waiting for src bucket item count to get to: 200000 curr count: 194921
2021/12/22 17:13:02 Waiting for src bucket item count to get to: 200000 curr count: 194921
2021/12/22 17:13:07 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 17:13:07 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 17:13:07 Starting bucket ops to source bucket
2021/12/22 17:16:53 Waiting for dst bucket item count to get to: 0 curr count: 16016
2021/12/22 17:16:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:16:53 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 17:16:58 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/22 17:17:03 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/22 17:17:08 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/22 17:17:13 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/22 17:17:13 App: TestEventingRebInWithOps got un-deployed
2021/12/22 17:17:13 No eventing-con process running
2021/12/22 17:17:13 Function: TestEventingRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps deleting in background"
}
2021/12/22 17:17:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:17:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:17:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:17:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:17:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:17:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithOps (449.57s)
=== RUN   TestEventingRebOutWithOps
2021/12/22 17:17:32 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:17:32 Removing node(s): [] from the cluster
2021/12/22 17:17:37 Rebalance progress: 100
2021/12/22 17:17:42 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/22 17:17:42 App: TestEventingRebOutWithOps got un-deployed
2021/12/22 17:17:42 No eventing-con process running
2021/12/22 17:17:42 Function: TestEventingRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithOps not found"
}
2021/12/22 17:17:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:17:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:17:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:17:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:17:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:17:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:18:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:18:00 Deploying app: TestEventingRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:18:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps stored in temp store"
}
2021/12/22 17:18:07 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/22 17:18:12 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/22 17:18:17 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/22 17:18:22 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/22 17:18:22 App: TestEventingRebOutWithOps got deployed
2021/12/22 17:18:22 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 17:18:22 Starting bucket ops to source bucket
2021/12/22 17:18:27 Rebalance progress: 12.5
2021/12/22 17:18:32 Rebalance progress: 12.5
2021/12/22 17:18:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:18:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:18:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:18:37 Waiting for src bucket item count to get to: 200000 curr count: 11619
2021/12/22 17:18:42 Waiting for src bucket item count to get to: 200000 curr count: 27739
2021/12/22 17:18:47 Waiting for src bucket item count to get to: 200000 curr count: 27739
2021/12/22 17:18:52 Waiting for src bucket item count to get to: 200000 curr count: 44017
2021/12/22 17:18:57 Waiting for src bucket item count to get to: 200000 curr count: 44017
2021/12/22 17:19:02 Waiting for src bucket item count to get to: 200000 curr count: 60118
2021/12/22 17:19:07 Waiting for src bucket item count to get to: 200000 curr count: 60118
2021/12/22 17:19:12 Waiting for src bucket item count to get to: 200000 curr count: 60118
2021/12/22 17:19:17 Waiting for src bucket item count to get to: 200000 curr count: 75275
2021/12/22 17:19:22 Waiting for src bucket item count to get to: 200000 curr count: 75275
2021/12/22 17:19:27 Waiting for src bucket item count to get to: 200000 curr count: 91098
2021/12/22 17:19:32 Waiting for src bucket item count to get to: 200000 curr count: 91098
2021/12/22 17:19:37 Waiting for src bucket item count to get to: 200000 curr count: 106991
2021/12/22 17:19:42 Waiting for src bucket item count to get to: 200000 curr count: 106991
2021/12/22 17:19:47 Waiting for src bucket item count to get to: 200000 curr count: 123269
2021/12/22 17:19:52 Waiting for src bucket item count to get to: 200000 curr count: 123269
2021/12/22 17:19:57 Waiting for src bucket item count to get to: 200000 curr count: 139441
2021/12/22 17:20:02 Waiting for src bucket item count to get to: 200000 curr count: 139441
2021/12/22 17:20:07 Waiting for src bucket item count to get to: 200000 curr count: 155707
2021/12/22 17:20:12 Waiting for src bucket item count to get to: 200000 curr count: 155707
2021/12/22 17:20:17 Waiting for src bucket item count to get to: 200000 curr count: 171017
2021/12/22 17:20:22 Waiting for src bucket item count to get to: 200000 curr count: 171017
2021/12/22 17:20:27 Waiting for src bucket item count to get to: 200000 curr count: 187229
2021/12/22 17:20:32 Waiting for src bucket item count to get to: 200000 curr count: 187229
2021/12/22 17:20:37 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 17:20:37 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 17:20:37 Starting bucket ops to source bucket
2021/12/22 17:24:23 Waiting for dst bucket item count to get to: 0 curr count: 15469
2021/12/22 17:24:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:24:23 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 17:24:28 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/22 17:24:33 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/22 17:24:38 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/22 17:24:43 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/22 17:24:43 App: TestEventingRebOutWithOps got un-deployed
2021/12/22 17:24:43 No eventing-con process running
2021/12/22 17:24:43 Function: TestEventingRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps deleting in background"
}
2021/12/22 17:24:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:24:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:24:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:24:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:24:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:24:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithOps (449.87s)
=== RUN   TestEventingSwapRebWithOps
2021/12/22 17:25:06 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/22 17:25:07 App: TestEventingSwapRebWithOps got un-deployed
2021/12/22 17:25:07 No eventing-con process running
2021/12/22 17:25:07 Function: TestEventingSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithOps not found"
}
2021/12/22 17:25:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:25:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:25:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:25:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:25:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:25:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:25:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:25:25 Deploying app: TestEventingSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:25:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps stored in temp store"
}
2021/12/22 17:25:31 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/22 17:25:36 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/22 17:25:41 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/22 17:25:46 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/22 17:25:46 App: TestEventingSwapRebWithOps got deployed
2021/12/22 17:25:46 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:25:46 Starting bucket ops to source bucket
2021/12/22 17:25:46 Removing node(s): [] from the cluster
2021/12/22 17:25:51 Rebalance progress: 12.5
2021/12/22 17:25:56 Rebalance progress: 12.5
2021/12/22 17:26:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:26:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:26:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:26:02 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 17:26:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 17:26:07 Rebalance progress: 12.5
2021/12/22 17:26:12 Rebalance progress: 12.5
2021/12/22 17:26:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:26:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:26:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:26:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 17:26:22 Rebalance progress: 12.5
2021/12/22 17:26:27 Rebalance progress: 12.5
2021/12/22 17:26:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:26:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:26:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:26:32 Waiting for src bucket item count to get to: 200000 curr count: 66064
2021/12/22 17:26:37 Waiting for src bucket item count to get to: 200000 curr count: 66064
2021/12/22 17:26:42 Waiting for src bucket item count to get to: 200000 curr count: 80414
2021/12/22 17:26:47 Waiting for src bucket item count to get to: 200000 curr count: 80414
2021/12/22 17:26:52 Waiting for src bucket item count to get to: 200000 curr count: 96600
2021/12/22 17:26:57 Waiting for src bucket item count to get to: 200000 curr count: 96600
2021/12/22 17:27:02 Waiting for src bucket item count to get to: 200000 curr count: 112717
2021/12/22 17:27:07 Waiting for src bucket item count to get to: 200000 curr count: 112717
2021/12/22 17:27:12 Waiting for src bucket item count to get to: 200000 curr count: 128780
2021/12/22 17:27:17 Waiting for src bucket item count to get to: 200000 curr count: 128780
2021/12/22 17:27:22 Waiting for src bucket item count to get to: 200000 curr count: 144991
2021/12/22 17:27:27 Waiting for src bucket item count to get to: 200000 curr count: 144991
2021/12/22 17:27:32 Waiting for src bucket item count to get to: 200000 curr count: 161110
2021/12/22 17:27:37 Waiting for src bucket item count to get to: 200000 curr count: 161110
2021/12/22 17:27:42 Waiting for src bucket item count to get to: 200000 curr count: 176132
2021/12/22 17:27:47 Waiting for src bucket item count to get to: 200000 curr count: 176132
2021/12/22 17:27:52 Waiting for src bucket item count to get to: 200000 curr count: 176132
2021/12/22 17:27:57 Waiting for src bucket item count to get to: 200000 curr count: 192154
2021/12/22 17:28:02 Waiting for src bucket item count to get to: 200000 curr count: 192154
2021/12/22 17:28:07 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 17:28:07 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 17:28:07 Starting bucket ops to source bucket
2021/12/22 17:31:54 Waiting for dst bucket item count to get to: 0 curr count: 17324
2021/12/22 17:31:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:31:54 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 17:31:59 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/22 17:32:04 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/22 17:32:09 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/22 17:32:14 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/22 17:32:14 App: TestEventingSwapRebWithOps got un-deployed
2021/12/22 17:32:14 No eventing-con process running
2021/12/22 17:32:14 Function: TestEventingSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps deleting in background"
}
2021/12/22 17:32:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:32:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:32:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:32:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:32:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:32:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithOps (450.90s)
=== RUN   TestKVRebInWithOps
2021/12/22 17:32:37 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/22 17:32:37 App: TestKVRebInWithOps got un-deployed
2021/12/22 17:32:37 No eventing-con process running
2021/12/22 17:32:37 Function: TestKVRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithOps not found"
}
2021/12/22 17:32:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:32:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:32:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:32:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:32:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:32:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:32:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:32:56 Deploying app: TestKVRebInWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:32:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps stored in temp store"
}
2021/12/22 17:33:02 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/22 17:33:07 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/22 17:33:12 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/22 17:33:17 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/22 17:33:17 App: TestKVRebInWithOps got deployed
2021/12/22 17:33:17 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 17:33:17 Starting bucket ops to source bucket
2021/12/22 17:33:18 Removing node(s): [] from the cluster
2021/12/22 17:33:23 Rebalance progress: 12.5
2021/12/22 17:33:28 Rebalance progress: 12.5
2021/12/22 17:33:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:33:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:33:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:33:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 17:33:38 Rebalance progress: 12.5
2021/12/22 17:33:43 Rebalance progress: 12.5
2021/12/22 17:33:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:33:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:33:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:33:48 Waiting for src bucket item count to get to: 200000 curr count: 33521
2021/12/22 17:33:53 Waiting for src bucket item count to get to: 200000 curr count: 49897
2021/12/22 17:33:58 Waiting for src bucket item count to get to: 200000 curr count: 49897
2021/12/22 17:34:03 Waiting for src bucket item count to get to: 200000 curr count: 66477
2021/12/22 17:34:08 Waiting for src bucket item count to get to: 200000 curr count: 66477
2021/12/22 17:34:13 Waiting for src bucket item count to get to: 200000 curr count: 81359
2021/12/22 17:34:18 Waiting for src bucket item count to get to: 200000 curr count: 81359
2021/12/22 17:34:23 Waiting for src bucket item count to get to: 200000 curr count: 97838
2021/12/22 17:34:28 Waiting for src bucket item count to get to: 200000 curr count: 97838
2021/12/22 17:34:33 Waiting for src bucket item count to get to: 200000 curr count: 97838
2021/12/22 17:34:38 Waiting for src bucket item count to get to: 200000 curr count: 114160
2021/12/22 17:34:43 Waiting for src bucket item count to get to: 200000 curr count: 114160
2021/12/22 17:34:48 Waiting for src bucket item count to get to: 200000 curr count: 130355
2021/12/22 17:34:53 Waiting for src bucket item count to get to: 200000 curr count: 130355
2021/12/22 17:34:58 Waiting for src bucket item count to get to: 200000 curr count: 146773
2021/12/22 17:35:03 Waiting for src bucket item count to get to: 200000 curr count: 146773
2021/12/22 17:35:08 Waiting for src bucket item count to get to: 200000 curr count: 163208
2021/12/22 17:35:13 Waiting for src bucket item count to get to: 200000 curr count: 163208
2021/12/22 17:35:18 Waiting for src bucket item count to get to: 200000 curr count: 178507
2021/12/22 17:35:23 Waiting for src bucket item count to get to: 200000 curr count: 178507
2021/12/22 17:35:28 Waiting for src bucket item count to get to: 200000 curr count: 194867
2021/12/22 17:35:33 Waiting for src bucket item count to get to: 200000 curr count: 194867
2021/12/22 17:35:38 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 17:35:38 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 17:35:38 Starting bucket ops to source bucket
2021/12/22 17:39:24 Waiting for dst bucket item count to get to: 0 curr count: 17568
2021/12/22 17:39:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:39:24 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 17:39:29 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/22 17:39:34 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/22 17:39:39 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/22 17:39:44 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/22 17:39:44 App: TestKVRebInWithOps got un-deployed
2021/12/22 17:39:44 No eventing-con process running
2021/12/22 17:39:44 Function: TestKVRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps deleting in background"
}
2021/12/22 17:39:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:39:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:39:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:39:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:39:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:39:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithOps (450.09s)
=== RUN   TestKVRebOutWithOps
2021/12/22 17:40:02 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 17:40:03 Removing node(s): [] from the cluster
2021/12/22 17:40:08 Rebalance progress: 100
2021/12/22 17:40:13 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/22 17:40:13 App: TestKVRebOutWithOps got un-deployed
2021/12/22 17:40:13 No eventing-con process running
2021/12/22 17:40:13 Function: TestKVRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithOps not found"
}
2021/12/22 17:40:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:40:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:40:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:40:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:40:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:40:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:40:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:40:31 Deploying app: TestKVRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:40:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps stored in temp store"
}
2021/12/22 17:40:37 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/22 17:40:42 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/22 17:40:47 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/22 17:40:52 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/22 17:40:52 App: TestKVRebOutWithOps got deployed
2021/12/22 17:40:52 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 17:40:52 Starting bucket ops to source bucket
2021/12/22 17:40:58 Rebalance progress: 12.5
2021/12/22 17:41:03 Rebalance progress: 12.5
2021/12/22 17:41:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:41:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:41:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:41:08 Waiting for src bucket item count to get to: 200000 curr count: 10183
2021/12/22 17:41:13 Waiting for src bucket item count to get to: 200000 curr count: 26253
2021/12/22 17:41:18 Waiting for src bucket item count to get to: 200000 curr count: 26253
2021/12/22 17:41:23 Waiting for src bucket item count to get to: 200000 curr count: 42662
2021/12/22 17:41:28 Waiting for src bucket item count to get to: 200000 curr count: 42662
2021/12/22 17:41:33 Waiting for src bucket item count to get to: 200000 curr count: 59100
2021/12/22 17:41:38 Waiting for src bucket item count to get to: 200000 curr count: 59100
2021/12/22 17:41:43 Waiting for src bucket item count to get to: 200000 curr count: 59100
2021/12/22 17:41:48 Waiting for src bucket item count to get to: 200000 curr count: 74573
2021/12/22 17:41:53 Waiting for src bucket item count to get to: 200000 curr count: 74573
2021/12/22 17:41:58 Waiting for src bucket item count to get to: 200000 curr count: 90715
2021/12/22 17:42:03 Waiting for src bucket item count to get to: 200000 curr count: 90715
2021/12/22 17:42:08 Waiting for src bucket item count to get to: 200000 curr count: 107325
2021/12/22 17:42:13 Waiting for src bucket item count to get to: 200000 curr count: 107325
2021/12/22 17:42:18 Waiting for src bucket item count to get to: 200000 curr count: 123590
2021/12/22 17:42:23 Waiting for src bucket item count to get to: 200000 curr count: 123590
2021/12/22 17:42:28 Waiting for src bucket item count to get to: 200000 curr count: 139537
2021/12/22 17:42:33 Waiting for src bucket item count to get to: 200000 curr count: 139537
2021/12/22 17:42:38 Waiting for src bucket item count to get to: 200000 curr count: 155974
2021/12/22 17:42:43 Waiting for src bucket item count to get to: 200000 curr count: 155974
2021/12/22 17:42:48 Waiting for src bucket item count to get to: 200000 curr count: 171442
2021/12/22 17:42:53 Waiting for src bucket item count to get to: 200000 curr count: 171442
2021/12/22 17:42:58 Waiting for src bucket item count to get to: 200000 curr count: 187240
2021/12/22 17:43:03 Waiting for src bucket item count to get to: 200000 curr count: 187240
2021/12/22 17:43:08 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 17:43:08 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 17:43:08 Starting bucket ops to source bucket
2021/12/22 17:46:53 Waiting for dst bucket item count to get to: 0 curr count: 16382
2021/12/22 17:46:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:46:53 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 17:46:58 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/22 17:47:04 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/22 17:47:09 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/22 17:47:14 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/22 17:47:14 App: TestKVRebOutWithOps got un-deployed
2021/12/22 17:47:14 No eventing-con process running
2021/12/22 17:47:14 Function: TestKVRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps deleting in background"
}
2021/12/22 17:47:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:47:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:47:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:47:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:47:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:47:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithOps (449.66s)
=== RUN   TestKVSwapRebWithOps
2021/12/22 17:47:37 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/22 17:47:37 App: TestKVSwapRebWithOps got un-deployed
2021/12/22 17:47:37 No eventing-con process running
2021/12/22 17:47:37 Function: TestKVSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithOps not found"
}
2021/12/22 17:47:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:47:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:47:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:47:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:47:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:47:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:47:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:47:56 Deploying app: TestKVSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:47:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps stored in temp store"
}
2021/12/22 17:48:02 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/22 17:48:07 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/22 17:48:12 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/22 17:48:17 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/22 17:48:17 App: TestKVSwapRebWithOps got deployed
2021/12/22 17:48:17 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 17:48:17 Starting bucket ops to source bucket
2021/12/22 17:48:18 Removing node(s): [] from the cluster
2021/12/22 17:48:23 Rebalance progress: 12.5
2021/12/22 17:48:28 Rebalance progress: 12.5
2021/12/22 17:48:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:48:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:48:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:48:33 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 17:48:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 17:48:38 Rebalance progress: 12.5
2021/12/22 17:48:43 Rebalance progress: 12.5
2021/12/22 17:48:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:48:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:48:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:48:48 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 17:48:53 Rebalance progress: 12.5
2021/12/22 17:48:58 Rebalance progress: 12.5
2021/12/22 17:49:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:49:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:49:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:49:03 Waiting for src bucket item count to get to: 200000 curr count: 66544
2021/12/22 17:49:08 Waiting for src bucket item count to get to: 200000 curr count: 66544
2021/12/22 17:49:13 Waiting for src bucket item count to get to: 200000 curr count: 81425
2021/12/22 17:49:18 Waiting for src bucket item count to get to: 200000 curr count: 81425
2021/12/22 17:49:23 Waiting for src bucket item count to get to: 200000 curr count: 97930
2021/12/22 17:49:28 Waiting for src bucket item count to get to: 200000 curr count: 97930
2021/12/22 17:49:33 Waiting for src bucket item count to get to: 200000 curr count: 114530
2021/12/22 17:49:38 Waiting for src bucket item count to get to: 200000 curr count: 114530
2021/12/22 17:49:43 Waiting for src bucket item count to get to: 200000 curr count: 130947
2021/12/22 17:49:48 Waiting for src bucket item count to get to: 200000 curr count: 130947
2021/12/22 17:49:53 Waiting for src bucket item count to get to: 200000 curr count: 147627
2021/12/22 17:49:58 Waiting for src bucket item count to get to: 200000 curr count: 147627
2021/12/22 17:50:03 Waiting for src bucket item count to get to: 200000 curr count: 164053
2021/12/22 17:50:08 Waiting for src bucket item count to get to: 200000 curr count: 164053
2021/12/22 17:50:13 Waiting for src bucket item count to get to: 200000 curr count: 179288
2021/12/22 17:50:18 Waiting for src bucket item count to get to: 200000 curr count: 179288
2021/12/22 17:50:23 Waiting for src bucket item count to get to: 200000 curr count: 195853
2021/12/22 17:50:28 Waiting for src bucket item count to get to: 200000 curr count: 195853
2021/12/22 17:50:33 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/22 17:50:33 Post SET ops. Expected item count: 200000 got 200000
2021/12/22 17:50:33 Starting bucket ops to source bucket
2021/12/22 17:54:19 Waiting for dst bucket item count to get to: 0 curr count: 9061
2021/12/22 17:54:24 Waiting for dst bucket item count to get to: 0 curr count: 9061
2021/12/22 17:54:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:54:24 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 17:54:29 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/22 17:54:34 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/22 17:54:39 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/22 17:54:44 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/22 17:54:44 App: TestKVSwapRebWithOps got un-deployed
2021/12/22 17:54:44 No eventing-con process running
2021/12/22 17:54:44 Function: TestKVSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps deleting in background"
}
2021/12/22 17:54:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:54:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:54:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:54:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:54:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:54:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithOps (450.75s)
=== RUN   TestEventingRebInWithTimers
2021/12/22 17:55:08 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/22 17:55:08 App: TestEventingRebInWithTimers got un-deployed
2021/12/22 17:55:08 No eventing-con process running
2021/12/22 17:55:08 Function: TestEventingRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithTimers not found"
}
2021/12/22 17:55:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:55:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:55:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:55:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:55:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:55:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:55:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:55:26 Deploying app: TestEventingRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:55:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers stored in temp store"
}
2021/12/22 17:55:33 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/22 17:55:38 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/22 17:55:43 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/22 17:55:48 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/22 17:55:48 App: TestEventingRebInWithTimers got deployed
2021/12/22 17:55:48 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:55:48 Starting bucket ops to source bucket
2021/12/22 17:55:48 Removing node(s): [] from the cluster
2021/12/22 17:55:53 Rebalance progress: 12.5
2021/12/22 17:55:58 Rebalance progress: 12.5
2021/12/22 17:56:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:56:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:56:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:56:03 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 17:56:08 Rebalance progress: 12.5
2021/12/22 17:56:13 Rebalance progress: 12.5
2021/12/22 17:56:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:56:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:56:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 17:56:18 Waiting for src bucket item count to get to: 50000 curr count: 27741
2021/12/22 17:56:23 Waiting for src bucket item count to get to: 50000 curr count: 38081
2021/12/22 17:56:28 Waiting for src bucket item count to get to: 50000 curr count: 38081
2021/12/22 17:56:38 Waiting for dst bucket item count to get to: 50000 curr count: 30101
2021/12/22 17:56:43 Waiting for dst bucket item count to get to: 50000 curr count: 30101
2021/12/22 17:56:48 Waiting for dst bucket item count to get to: 50000 curr count: 45250
2021/12/22 17:56:53 Waiting for dst bucket item count to get to: 50000 curr count: 45250
2021/12/22 17:56:53 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 17:56:53 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 17:56:53 Starting bucket ops to source bucket
2021/12/22 17:58:02 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 17:58:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 17:58:12 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 17:58:17 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 17:58:22 Waiting for dst bucket item count to get to: 0 curr count: 39770
2021/12/22 17:58:27 Waiting for dst bucket item count to get to: 0 curr count: 39770
2021/12/22 17:58:32 Waiting for dst bucket item count to get to: 0 curr count: 29787
2021/12/22 17:58:37 Waiting for dst bucket item count to get to: 0 curr count: 29787
2021/12/22 17:58:42 Waiting for dst bucket item count to get to: 0 curr count: 10635
2021/12/22 17:58:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:58:42 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 17:58:47 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/22 17:58:53 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/22 17:58:58 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/22 17:59:03 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/22 17:59:03 App: TestEventingRebInWithTimers got un-deployed
2021/12/22 17:59:03 No eventing-con process running
2021/12/22 17:59:03 Function: TestEventingRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers deleting in background"
}
2021/12/22 17:59:04 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:59:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:59:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:59:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:59:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:59:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithTimers (258.17s)
=== RUN   TestEventingRebOutWithTimers
2021/12/22 17:59:21 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 17:59:21 Removing node(s): [] from the cluster
2021/12/22 17:59:26 Rebalance progress: 100
2021/12/22 17:59:31 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/22 17:59:31 App: TestEventingRebOutWithTimers got un-deployed
2021/12/22 17:59:31 No eventing-con process running
2021/12/22 17:59:31 Function: TestEventingRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithTimers not found"
}
2021/12/22 17:59:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:59:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:59:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 17:59:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:59:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:59:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 17:59:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 17:59:50 Deploying app: TestEventingRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/22 17:59:51 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers stored in temp store"
}
2021/12/22 17:59:56 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/22 18:00:01 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/22 18:00:06 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/22 18:00:11 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/22 18:00:11 App: TestEventingRebOutWithTimers got deployed
2021/12/22 18:00:11 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:00:11 Starting bucket ops to source bucket
2021/12/22 18:00:16 Rebalance progress: 12.5
2021/12/22 18:00:21 Rebalance progress: 12.5
2021/12/22 18:00:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:00:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:00:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:00:26 Waiting for src bucket item count to get to: 50000 curr count: 10938
2021/12/22 18:00:31 Waiting for src bucket item count to get to: 50000 curr count: 23200
2021/12/22 18:00:36 Waiting for src bucket item count to get to: 50000 curr count: 23200
2021/12/22 18:00:41 Waiting for src bucket item count to get to: 50000 curr count: 33962
2021/12/22 18:00:46 Waiting for src bucket item count to get to: 50000 curr count: 33962
2021/12/22 18:00:51 Waiting for src bucket item count to get to: 50000 curr count: 44870
2021/12/22 18:00:56 Waiting for src bucket item count to get to: 50000 curr count: 44870
2021/12/22 18:01:01 Waiting for src bucket item count to get to: 50000 curr count: 44870
2021/12/22 18:01:11 Waiting for dst bucket item count to get to: 50000 curr count: 40368
2021/12/22 18:01:16 Waiting for dst bucket item count to get to: 50000 curr count: 40368
2021/12/22 18:01:16 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:01:16 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:01:16 Starting bucket ops to source bucket
2021/12/22 18:02:25 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:02:30 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:02:35 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:02:40 Waiting for dst bucket item count to get to: 0 curr count: 47616
2021/12/22 18:02:46 Waiting for dst bucket item count to get to: 0 curr count: 47616
2021/12/22 18:02:51 Waiting for dst bucket item count to get to: 0 curr count: 31526
2021/12/22 18:02:56 Waiting for dst bucket item count to get to: 0 curr count: 31526
2021/12/22 18:03:01 Waiting for dst bucket item count to get to: 0 curr count: 12117
2021/12/22 18:03:06 Waiting for dst bucket item count to get to: 0 curr count: 12117
2021/12/22 18:03:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:03:06 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 18:03:11 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/22 18:03:16 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/22 18:03:21 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/22 18:03:26 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/22 18:03:26 App: TestEventingRebOutWithTimers got un-deployed
2021/12/22 18:03:26 No eventing-con process running
2021/12/22 18:03:26 Function: TestEventingRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers deleting in background"
}
2021/12/22 18:03:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:03:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:03:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:03:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:03:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:03:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithTimers (263.30s)
=== RUN   TestEventingSwapRebWithTimers
2021/12/22 18:03:49 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/22 18:03:49 App: TestEventingSwapRebWithTimers got un-deployed
2021/12/22 18:03:49 No eventing-con process running
2021/12/22 18:03:49 Function: TestEventingSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithTimers not found"
}
2021/12/22 18:03:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:03:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:03:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:03:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:04:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:04:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:04:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:04:08 Deploying app: TestEventingSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:04:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers stored in temp store"
}
2021/12/22 18:04:14 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/22 18:04:19 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/22 18:04:24 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/22 18:04:29 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/22 18:04:29 App: TestEventingSwapRebWithTimers got deployed
2021/12/22 18:04:29 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 18:04:29 Starting bucket ops to source bucket
2021/12/22 18:04:29 Removing node(s): [] from the cluster
2021/12/22 18:04:34 Rebalance progress: 12.5
2021/12/22 18:04:39 Rebalance progress: 12.5
2021/12/22 18:04:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:04:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:04:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:04:44 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 18:04:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:04:50 Rebalance progress: 12.5
2021/12/22 18:04:55 Rebalance progress: 12.5
2021/12/22 18:05:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:05:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:05:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:05:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 18:05:05 Rebalance progress: 12.5
2021/12/22 18:05:10 Rebalance progress: 12.5
2021/12/22 18:05:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:05:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:05:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:05:15 Waiting for src bucket item count to get to: 50000 curr count: 47011
2021/12/22 18:05:20 Waiting for src bucket item count to get to: 50000 curr count: 47011
2021/12/22 18:05:30 Waiting for dst bucket item count to get to: 50000 curr count: 47853
2021/12/22 18:05:35 Waiting for dst bucket item count to get to: 50000 curr count: 47853
2021/12/22 18:05:35 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:05:35 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:05:35 Starting bucket ops to source bucket
2021/12/22 18:06:45 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:06:50 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:06:55 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:07:00 Waiting for dst bucket item count to get to: 0 curr count: 41656
2021/12/22 18:07:05 Waiting for dst bucket item count to get to: 0 curr count: 41656
2021/12/22 18:07:10 Waiting for dst bucket item count to get to: 0 curr count: 24506
2021/12/22 18:07:15 Waiting for dst bucket item count to get to: 0 curr count: 24506
2021/12/22 18:07:20 Waiting for dst bucket item count to get to: 0 curr count: 12081
2021/12/22 18:07:25 Waiting for dst bucket item count to get to: 0 curr count: 12081
2021/12/22 18:07:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:07:25 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 18:07:30 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/22 18:07:35 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/22 18:07:40 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/22 18:07:45 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/22 18:07:45 App: TestEventingSwapRebWithTimers got un-deployed
2021/12/22 18:07:45 No eventing-con process running
2021/12/22 18:07:45 Function: TestEventingSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers deleting in background"
}
2021/12/22 18:07:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:07:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:07:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:07:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:07:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:07:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithTimers (259.02s)
=== RUN   TestKVRebInWithTimers
2021/12/22 18:08:08 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/22 18:08:08 App: TestKVRebInWithTimers got un-deployed
2021/12/22 18:08:08 No eventing-con process running
2021/12/22 18:08:08 Function: TestKVRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithTimers not found"
}
2021/12/22 18:08:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:08:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:08:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:08:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:08:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:08:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:08:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:08:27 Deploying app: TestKVRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:08:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers stored in temp store"
}
2021/12/22 18:08:33 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/22 18:08:38 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/22 18:08:43 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/22 18:08:48 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/22 18:08:48 App: TestKVRebInWithTimers got deployed
2021/12/22 18:08:48 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:08:48 Starting bucket ops to source bucket
2021/12/22 18:08:48 Removing node(s): [] from the cluster
2021/12/22 18:08:53 Rebalance progress: 12.5
2021/12/22 18:08:58 Rebalance progress: 12.5
2021/12/22 18:09:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:09:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:09:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:09:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:09:09 Rebalance progress: 12.5
2021/12/22 18:09:14 Rebalance progress: 12.5
2021/12/22 18:09:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:09:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:09:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:09:19 Waiting for src bucket item count to get to: 50000 curr count: 26010
2021/12/22 18:09:24 Waiting for src bucket item count to get to: 50000 curr count: 36579
2021/12/22 18:09:29 Waiting for src bucket item count to get to: 50000 curr count: 36579
2021/12/22 18:09:34 Waiting for src bucket item count to get to: 50000 curr count: 49165
2021/12/22 18:09:39 Waiting for src bucket item count to get to: 50000 curr count: 49165
2021/12/22 18:09:49 Waiting for dst bucket item count to get to: 50000 curr count: 49273
2021/12/22 18:09:54 Waiting for dst bucket item count to get to: 50000 curr count: 49273
2021/12/22 18:09:54 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:09:54 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:09:54 Starting bucket ops to source bucket
2021/12/22 18:11:03 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:11:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:11:13 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:11:18 Waiting for dst bucket item count to get to: 0 curr count: 37459
2021/12/22 18:11:23 Waiting for dst bucket item count to get to: 0 curr count: 37459
2021/12/22 18:11:28 Waiting for dst bucket item count to get to: 0 curr count: 23607
2021/12/22 18:11:33 Waiting for dst bucket item count to get to: 0 curr count: 23607
2021/12/22 18:11:38 Waiting for dst bucket item count to get to: 0 curr count: 7831
2021/12/22 18:11:43 Waiting for dst bucket item count to get to: 0 curr count: 7831
2021/12/22 18:11:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:11:43 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 18:11:48 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/22 18:11:53 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/22 18:11:58 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/22 18:12:04 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/22 18:12:04 App: TestKVRebInWithTimers got un-deployed
2021/12/22 18:12:04 No eventing-con process running
2021/12/22 18:12:04 Function: TestKVRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers deleting in background"
}
2021/12/22 18:12:05 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:12:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:12:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:12:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:12:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:12:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithTimers (258.65s)
=== RUN   TestKVRebOutWithTimers
2021/12/22 18:12:22 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:12:23 Removing node(s): [] from the cluster
2021/12/22 18:12:28 Rebalance progress: 100
2021/12/22 18:12:33 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/22 18:12:33 App: TestKVRebOutWithTimers got un-deployed
2021/12/22 18:12:33 No eventing-con process running
2021/12/22 18:12:33 Function: TestKVRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithTimers not found"
}
2021/12/22 18:12:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:12:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:12:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:12:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:12:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:12:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:12:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:12:51 Deploying app: TestKVRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:12:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers stored in temp store"
}
2021/12/22 18:12:57 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/22 18:13:02 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/22 18:13:07 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/22 18:13:12 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/22 18:13:12 App: TestKVRebOutWithTimers got deployed
2021/12/22 18:13:12 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:13:12 Starting bucket ops to source bucket
2021/12/22 18:13:18 Rebalance progress: 12.5
2021/12/22 18:13:23 Rebalance progress: 12.5
2021/12/22 18:13:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:13:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:13:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:13:28 Waiting for src bucket item count to get to: 50000 curr count: 9034
2021/12/22 18:13:33 Waiting for src bucket item count to get to: 50000 curr count: 23134
2021/12/22 18:13:38 Waiting for src bucket item count to get to: 50000 curr count: 23134
2021/12/22 18:13:43 Waiting for src bucket item count to get to: 50000 curr count: 34713
2021/12/22 18:13:48 Waiting for src bucket item count to get to: 50000 curr count: 34713
2021/12/22 18:13:53 Waiting for src bucket item count to get to: 50000 curr count: 44360
2021/12/22 18:13:58 Waiting for src bucket item count to get to: 50000 curr count: 44360
2021/12/22 18:14:08 Waiting for dst bucket item count to get to: 50000 curr count: 35267
2021/12/22 18:14:13 Waiting for dst bucket item count to get to: 50000 curr count: 35267
2021/12/22 18:14:18 Waiting for dst bucket item count to get to: 50000 curr count: 35267
2021/12/22 18:14:23 Waiting for dst bucket item count to get to: 50000 curr count: 49014
2021/12/22 18:14:28 Waiting for dst bucket item count to get to: 50000 curr count: 49014
2021/12/22 18:14:28 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:14:28 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:14:28 Starting bucket ops to source bucket
2021/12/22 18:15:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:15:42 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:15:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:15:52 Waiting for dst bucket item count to get to: 0 curr count: 47666
2021/12/22 18:15:57 Waiting for dst bucket item count to get to: 0 curr count: 47666
2021/12/22 18:16:02 Waiting for dst bucket item count to get to: 0 curr count: 34954
2021/12/22 18:16:07 Waiting for dst bucket item count to get to: 0 curr count: 34954
2021/12/22 18:16:12 Waiting for dst bucket item count to get to: 0 curr count: 24402
2021/12/22 18:16:17 Waiting for dst bucket item count to get to: 0 curr count: 2266
2021/12/22 18:16:22 Waiting for dst bucket item count to get to: 0 curr count: 2266
2021/12/22 18:16:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:16:22 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 18:16:27 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/22 18:16:32 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/22 18:16:37 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/22 18:16:42 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/22 18:16:42 App: TestKVRebOutWithTimers got un-deployed
2021/12/22 18:16:42 No eventing-con process running
2021/12/22 18:16:42 Function: TestKVRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers deleting in background"
}
2021/12/22 18:16:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:16:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:16:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:16:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:16:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:16:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithTimers (278.92s)
=== RUN   TestKVSwapRebWithTimers
2021/12/22 18:17:06 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/22 18:17:06 App: TestKVSwapRebWithTimers got un-deployed
2021/12/22 18:17:06 No eventing-con process running
2021/12/22 18:17:06 Function: TestKVSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithTimers not found"
}
2021/12/22 18:17:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:17:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:17:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:17:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:17:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:17:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:17:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:17:24 Deploying app: TestKVSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:17:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers stored in temp store"
}
2021/12/22 18:17:31 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/22 18:17:36 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/22 18:17:41 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/22 18:17:46 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/22 18:17:46 App: TestKVSwapRebWithTimers got deployed
2021/12/22 18:17:46 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:17:46 Starting bucket ops to source bucket
2021/12/22 18:17:46 Removing node(s): [] from the cluster
2021/12/22 18:17:51 Rebalance progress: 12.5
2021/12/22 18:17:56 Rebalance progress: 12.5
2021/12/22 18:18:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:18:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:18:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:18:01 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 18:18:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:18:06 Rebalance progress: 12.5
2021/12/22 18:18:11 Rebalance progress: 12.5
2021/12/22 18:18:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:18:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:18:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:18:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 18:18:22 Rebalance progress: 12.5
2021/12/22 18:18:27 Rebalance progress: 12.5
2021/12/22 18:18:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:18:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:18:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:18:37 Waiting for dst bucket item count to get to: 50000 curr count: 35042
2021/12/22 18:18:42 Waiting for dst bucket item count to get to: 50000 curr count: 35042
2021/12/22 18:18:47 Waiting for dst bucket item count to get to: 50000 curr count: 41065
2021/12/22 18:18:52 Waiting for dst bucket item count to get to: 50000 curr count: 41065
2021/12/22 18:18:52 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:18:52 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:18:52 Starting bucket ops to source bucket
2021/12/22 18:20:01 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:20:06 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:20:11 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:20:16 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:20:21 Waiting for dst bucket item count to get to: 0 curr count: 41207
2021/12/22 18:20:26 Waiting for dst bucket item count to get to: 0 curr count: 41207
2021/12/22 18:20:31 Waiting for dst bucket item count to get to: 0 curr count: 30210
2021/12/22 18:20:36 Waiting for dst bucket item count to get to: 0 curr count: 30210
2021/12/22 18:20:41 Waiting for dst bucket item count to get to: 0 curr count: 9995
2021/12/22 18:20:46 Waiting for dst bucket item count to get to: 0 curr count: 9995
2021/12/22 18:20:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:20:46 Post DELETE ops. Expected item count: 0 got 0
2021/12/22 18:20:52 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/22 18:20:57 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/22 18:21:02 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/22 18:21:07 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/22 18:21:12 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/22 18:21:17 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/22 18:21:17 App: TestKVSwapRebWithTimers got un-deployed
2021/12/22 18:21:17 No eventing-con process running
2021/12/22 18:21:17 Function: TestKVSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers deleting in background"
}
2021/12/22 18:21:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:21:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:21:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:21:25 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:21:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:21:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithTimers (274.47s)
=== RUN   TestDuplicateTimerCreationEventingRebIn
2021/12/22 18:21:40 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/22 18:21:40 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2021/12/22 18:21:40 No eventing-con process running
2021/12/22 18:21:40 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebIn not found"
}
2021/12/22 18:21:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:21:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:21:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:21:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:21:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:21:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:21:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:21:59 Deploying app: TestDuplicateTimerCreationEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:22:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn stored in temp store"
}
2021/12/22 18:22:05 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/22 18:22:10 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/22 18:22:15 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/22 18:22:20 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/22 18:22:20 App: TestDuplicateTimerCreationEventingRebIn got deployed
2021/12/22 18:22:20 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 18:22:20 Starting bucket ops to source bucket
2021/12/22 18:22:20 Removing node(s): [] from the cluster
2021/12/22 18:22:25 Rebalance progress: 12.5
2021/12/22 18:22:30 Rebalance progress: 12.5
2021/12/22 18:22:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:22:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:22:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:22:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:22:41 Rebalance progress: 12.5
2021/12/22 18:22:46 Rebalance progress: 12.5
2021/12/22 18:22:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:22:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:22:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:22:51 Waiting for src bucket item count to get to: 50000 curr count: 36488
2021/12/22 18:22:56 Waiting for src bucket item count to get to: 50000 curr count: 36488
2021/12/22 18:23:01 Waiting for src bucket item count to get to: 50000 curr count: 45999
2021/12/22 18:23:06 Waiting for src bucket item count to get to: 50000 curr count: 45999
2021/12/22 18:23:16 Waiting for dst bucket item count to get to: 50000 curr count: 37425
2021/12/22 18:23:21 Waiting for dst bucket item count to get to: 50000 curr count: 37425
2021/12/22 18:23:26 Waiting for dst bucket item count to get to: 50000 curr count: 47633
2021/12/22 18:23:31 Waiting for dst bucket item count to get to: 50000 curr count: 47633
2021/12/22 18:23:31 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:23:31 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:23:36 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/22 18:23:41 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/22 18:23:46 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/22 18:23:51 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/22 18:23:56 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/22 18:23:56 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2021/12/22 18:23:56 No eventing-con process running
2021/12/22 18:23:56 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn deleting in background"
}
2021/12/22 18:23:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:24:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:24:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:24:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:24:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:24:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:24:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebIn (164.25s)
=== RUN   TestDuplicateTimerCreationEventingRebOut
2021/12/22 18:24:20 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 18:24:20 Removing node(s): [] from the cluster
2021/12/22 18:24:25 Rebalance progress: 100
2021/12/22 18:24:30 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/22 18:24:30 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2021/12/22 18:24:30 No eventing-con process running
2021/12/22 18:24:30 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebOut not found"
}
2021/12/22 18:24:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:24:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:24:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:24:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:24:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:24:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:24:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:24:49 Deploying app: TestDuplicateTimerCreationEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:24:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut stored in temp store"
}
2021/12/22 18:24:55 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/22 18:25:00 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/22 18:25:05 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/22 18:25:05 App: TestDuplicateTimerCreationEventingRebOut got deployed
2021/12/22 18:25:05 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:25:05 Starting bucket ops to source bucket
2021/12/22 18:25:10 Rebalance progress: 12.5
2021/12/22 18:25:15 Rebalance progress: 12.5
2021/12/22 18:25:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:25:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:25:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:25:20 Waiting for src bucket item count to get to: 50000 curr count: 5139
2021/12/22 18:25:25 Waiting for src bucket item count to get to: 50000 curr count: 19398
2021/12/22 18:25:30 Waiting for src bucket item count to get to: 50000 curr count: 33206
2021/12/22 18:25:35 Waiting for src bucket item count to get to: 50000 curr count: 33206
2021/12/22 18:25:40 Waiting for src bucket item count to get to: 50000 curr count: 43149
2021/12/22 18:25:45 Waiting for src bucket item count to get to: 50000 curr count: 43149
2021/12/22 18:25:55 Waiting for dst bucket item count to get to: 50000 curr count: 30621
2021/12/22 18:26:00 Waiting for dst bucket item count to get to: 50000 curr count: 30621
2021/12/22 18:26:05 Waiting for dst bucket item count to get to: 50000 curr count: 41873
2021/12/22 18:26:10 Waiting for dst bucket item count to get to: 50000 curr count: 41873
2021/12/22 18:26:15 Waiting for dst bucket item count to get to: 50000 curr count: 41873
2021/12/22 18:26:15 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:26:15 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:26:20 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/22 18:26:25 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/22 18:26:31 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/22 18:26:36 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/22 18:26:41 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/22 18:26:46 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/22 18:26:46 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2021/12/22 18:26:46 No eventing-con process running
2021/12/22 18:26:46 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut deleting in background"
}
2021/12/22 18:26:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:26:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:26:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:26:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:26:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:27:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:27:09 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:27:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebOut (174.63s)
=== RUN   TestDuplicateTimerCreationEventingSwapReb
2021/12/22 18:27:19 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/22 18:27:19 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2021/12/22 18:27:19 No eventing-con process running
2021/12/22 18:27:19 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingSwapReb not found"
}
2021/12/22 18:27:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:27:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:27:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:27:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:27:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:27:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:27:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:27:38 Deploying app: TestDuplicateTimerCreationEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:27:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb stored in temp store"
}
2021/12/22 18:27:44 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/22 18:27:49 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/22 18:27:54 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/22 18:27:59 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/22 18:27:59 App: TestDuplicateTimerCreationEventingSwapReb got deployed
2021/12/22 18:27:59 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 18:27:59 Starting bucket ops to source bucket
2021/12/22 18:27:59 Removing node(s): [] from the cluster
2021/12/22 18:28:05 Rebalance progress: 12.5
2021/12/22 18:28:10 Rebalance progress: 12.5
2021/12/22 18:28:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:28:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:28:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:28:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 18:28:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:28:21 Rebalance progress: 12.5
2021/12/22 18:28:26 Rebalance progress: 12.5
2021/12/22 18:28:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:28:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:28:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:28:31 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 18:28:36 Rebalance progress: 12.5
2021/12/22 18:28:41 Rebalance progress: 12.5
2021/12/22 18:28:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:28:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:28:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:28:46 Waiting for src bucket item count to get to: 50000 curr count: 47044
2021/12/22 18:28:51 Waiting for src bucket item count to get to: 50000 curr count: 47044
2021/12/22 18:29:01 Waiting for dst bucket item count to get to: 50000 curr count: 35491
2021/12/22 18:29:06 Waiting for dst bucket item count to get to: 50000 curr count: 35491
2021/12/22 18:29:11 Waiting for dst bucket item count to get to: 50000 curr count: 41591
2021/12/22 18:29:16 Waiting for dst bucket item count to get to: 50000 curr count: 41591
2021/12/22 18:29:16 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:29:16 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:29:21 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/22 18:29:26 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/22 18:29:31 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/22 18:29:36 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/22 18:29:41 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/22 18:29:41 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2021/12/22 18:29:41 No eventing-con process running
2021/12/22 18:29:41 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb deleting in background"
}
2021/12/22 18:29:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:29:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:29:53 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:29:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:29:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:30:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:30:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:30:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingSwapReb (175.54s)
=== RUN   TestDuplicateTimerCreationKVRebIn
2021/12/22 18:30:15 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/22 18:30:15 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2021/12/22 18:30:15 No eventing-con process running
2021/12/22 18:30:15 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebIn not found"
}
2021/12/22 18:30:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:30:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:30:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:30:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:30:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:30:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:30:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:30:33 Deploying app: TestDuplicateTimerCreationKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:30:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn stored in temp store"
}
2021/12/22 18:30:40 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/22 18:30:45 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/22 18:30:50 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/22 18:30:55 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/22 18:30:55 App: TestDuplicateTimerCreationKVRebIn got deployed
2021/12/22 18:30:55 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:30:55 Starting bucket ops to source bucket
2021/12/22 18:30:55 Removing node(s): [] from the cluster
2021/12/22 18:31:00 Rebalance progress: 12.5
2021/12/22 18:31:05 Rebalance progress: 12.5
2021/12/22 18:31:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:31:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:31:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:31:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:31:15 Rebalance progress: 12.5
2021/12/22 18:31:20 Rebalance progress: 12.5
2021/12/22 18:31:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:31:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:31:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:31:25 Waiting for src bucket item count to get to: 50000 curr count: 32291
2021/12/22 18:31:30 Waiting for src bucket item count to get to: 50000 curr count: 32291
2021/12/22 18:31:35 Waiting for src bucket item count to get to: 50000 curr count: 42842
2021/12/22 18:31:45 Waiting for dst bucket item count to get to: 50000 curr count: 29720
2021/12/22 18:31:50 Waiting for dst bucket item count to get to: 50000 curr count: 29720
2021/12/22 18:31:55 Waiting for dst bucket item count to get to: 50000 curr count: 35852
2021/12/22 18:32:00 Waiting for dst bucket item count to get to: 50000 curr count: 35852
2021/12/22 18:32:00 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:32:00 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:32:06 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/22 18:32:11 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/22 18:32:16 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/22 18:32:21 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/22 18:32:26 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/22 18:32:26 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2021/12/22 18:32:26 No eventing-con process running
2021/12/22 18:32:26 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn deleting in background"
}
2021/12/22 18:32:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:32:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:32:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:32:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:32:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:32:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:32:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebIn (159.76s)
=== RUN   TestDuplicateTimerCreationKVRebOut
2021/12/22 18:32:50 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:32:50 Removing node(s): [] from the cluster
2021/12/22 18:32:55 Rebalance progress: 100
2021/12/22 18:33:00 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/22 18:33:00 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2021/12/22 18:33:00 No eventing-con process running
2021/12/22 18:33:00 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebOut not found"
}
2021/12/22 18:33:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:33:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:33:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:33:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:33:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:33:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:33:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:33:19 Deploying app: TestDuplicateTimerCreationKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:33:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut stored in temp store"
}
2021/12/22 18:33:25 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/22 18:33:30 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/22 18:33:35 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/22 18:33:40 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/22 18:33:40 App: TestDuplicateTimerCreationKVRebOut got deployed
2021/12/22 18:33:40 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:33:40 Starting bucket ops to source bucket
2021/12/22 18:33:45 Rebalance progress: 12.5
2021/12/22 18:33:50 Rebalance progress: 12.5
2021/12/22 18:33:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:33:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:33:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:33:55 Waiting for src bucket item count to get to: 50000 curr count: 12277
2021/12/22 18:34:00 Waiting for src bucket item count to get to: 50000 curr count: 12277
2021/12/22 18:34:05 Waiting for src bucket item count to get to: 50000 curr count: 26313
2021/12/22 18:34:10 Waiting for src bucket item count to get to: 50000 curr count: 37396
2021/12/22 18:34:15 Waiting for src bucket item count to get to: 50000 curr count: 37396
2021/12/22 18:34:20 Waiting for src bucket item count to get to: 50000 curr count: 47822
2021/12/22 18:34:25 Waiting for src bucket item count to get to: 50000 curr count: 47822
2021/12/22 18:34:30 Waiting for src bucket item count to get to: 50000 curr count: 47822
2021/12/22 18:34:40 Waiting for dst bucket item count to get to: 50000 curr count: 38118
2021/12/22 18:34:45 Waiting for dst bucket item count to get to: 50000 curr count: 38118
2021/12/22 18:34:50 Waiting for dst bucket item count to get to: 50000 curr count: 48088
2021/12/22 18:34:55 Waiting for dst bucket item count to get to: 50000 curr count: 48088
2021/12/22 18:34:55 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:34:55 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:35:00 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/22 18:35:05 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/22 18:35:10 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/22 18:35:16 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/22 18:35:21 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/22 18:35:26 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/22 18:35:26 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2021/12/22 18:35:26 No eventing-con process running
2021/12/22 18:35:26 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut deleting in background"
}
2021/12/22 18:35:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:35:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:35:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:35:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:35:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:35:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:35:49 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:35:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebOut (184.61s)
=== RUN   TestDuplicateTimerCreationKVSwapReb
2021/12/22 18:35:59 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/22 18:35:59 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2021/12/22 18:35:59 No eventing-con process running
2021/12/22 18:35:59 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVSwapReb not found"
}
2021/12/22 18:36:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:36:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:36:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:36:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:36:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:36:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:36:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:36:18 Deploying app: TestDuplicateTimerCreationKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:36:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb stored in temp store"
}
2021/12/22 18:36:24 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/22 18:36:29 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/22 18:36:34 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/22 18:36:39 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/22 18:36:39 App: TestDuplicateTimerCreationKVSwapReb got deployed
2021/12/22 18:36:39 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:36:39 Starting bucket ops to source bucket
2021/12/22 18:36:39 Removing node(s): [] from the cluster
2021/12/22 18:36:44 Rebalance progress: 12.5
2021/12/22 18:36:49 Rebalance progress: 12.5
2021/12/22 18:36:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:36:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:36:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:36:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 18:36:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:37:00 Rebalance progress: 12.5
2021/12/22 18:37:05 Rebalance progress: 12.5
2021/12/22 18:37:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:37:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:37:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:37:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 18:37:15 Rebalance progress: 12.5
2021/12/22 18:37:20 Rebalance progress: 12.5
2021/12/22 18:37:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:37:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:37:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:37:25 Waiting for src bucket item count to get to: 50000 curr count: 48190
2021/12/22 18:37:30 Waiting for src bucket item count to get to: 50000 curr count: 48190
2021/12/22 18:37:40 Waiting for dst bucket item count to get to: 50000 curr count: 36225
2021/12/22 18:37:45 Waiting for dst bucket item count to get to: 50000 curr count: 36225
2021/12/22 18:37:50 Waiting for dst bucket item count to get to: 50000 curr count: 42483
2021/12/22 18:37:55 Waiting for dst bucket item count to get to: 50000 curr count: 42483
2021/12/22 18:37:55 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:37:55 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:38:00 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/22 18:38:05 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/22 18:38:10 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/22 18:38:15 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/22 18:38:20 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/22 18:38:21 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2021/12/22 18:38:21 No eventing-con process running
2021/12/22 18:38:21 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb deleting in background"
}
2021/12/22 18:38:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:38:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:38:32 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:38:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:38:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:38:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:38:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:38:49 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:38:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVSwapReb (179.92s)
=== RUN   TestDuplicateTimerFiringEventingRebIn
2021/12/22 18:38:59 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/22 18:38:59 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2021/12/22 18:38:59 No eventing-con process running
2021/12/22 18:38:59 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebIn not found"
}
2021/12/22 18:39:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:39:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:39:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:39:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:39:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:39:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:39:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:39:18 Deploying app: TestDuplicateTimerFiringEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:39:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn stored in temp store"
}
2021/12/22 18:39:24 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/22 18:39:29 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/22 18:39:34 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/22 18:39:39 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/22 18:39:39 App: TestDuplicateTimerFiringEventingRebIn got deployed
2021/12/22 18:39:39 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 18:39:39 Starting bucket ops to source bucket
2021/12/22 18:39:39 Removing node(s): [] from the cluster
2021/12/22 18:39:44 Rebalance progress: 12.5
2021/12/22 18:39:49 Rebalance progress: 12.5
2021/12/22 18:39:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:39:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:39:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:39:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:39:59 Rebalance progress: 12.5
2021/12/22 18:40:04 Rebalance progress: 12.5
2021/12/22 18:40:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:40:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:40:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:40:09 Waiting for src bucket item count to get to: 50000 curr count: 26139
2021/12/22 18:40:15 Waiting for src bucket item count to get to: 50000 curr count: 35100
2021/12/22 18:40:20 Waiting for src bucket item count to get to: 50000 curr count: 35100
2021/12/22 18:40:25 Waiting for src bucket item count to get to: 50000 curr count: 47872
2021/12/22 18:40:30 Waiting for src bucket item count to get to: 50000 curr count: 47872
2021/12/22 18:40:40 Waiting for dst bucket item count to get to: 50000 curr count: 45148
2021/12/22 18:40:45 Waiting for dst bucket item count to get to: 50000 curr count: 45148
2021/12/22 18:40:45 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:40:45 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:40:50 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/22 18:40:55 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/22 18:41:00 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/22 18:41:05 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/22 18:41:10 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/22 18:41:10 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2021/12/22 18:41:10 No eventing-con process running
2021/12/22 18:41:10 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn deleting in background"
}
2021/12/22 18:41:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:41:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:41:22 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:41:27 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:41:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:41:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:41:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:41:39 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:41:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebIn (169.50s)
=== RUN   TestDuplicateTimerFiringEventingRebOut
2021/12/22 18:41:44 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 18:41:44 Removing node(s): [] from the cluster
2021/12/22 18:41:49 Rebalance progress: 100
2021/12/22 18:41:54 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/22 18:41:54 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2021/12/22 18:41:54 No eventing-con process running
2021/12/22 18:41:54 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebOut not found"
}
2021/12/22 18:41:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:42:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:42:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:42:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:42:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:42:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:42:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:42:12 Deploying app: TestDuplicateTimerFiringEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:42:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut stored in temp store"
}
2021/12/22 18:42:19 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/22 18:42:24 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/22 18:42:29 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/22 18:42:34 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/22 18:42:34 App: TestDuplicateTimerFiringEventingRebOut got deployed
2021/12/22 18:42:34 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:42:34 Starting bucket ops to source bucket
2021/12/22 18:42:39 Rebalance progress: 12.5
2021/12/22 18:42:44 Rebalance progress: 12.5
2021/12/22 18:42:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:42:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:42:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:42:49 Waiting for src bucket item count to get to: 50000 curr count: 7046
2021/12/22 18:42:54 Waiting for src bucket item count to get to: 50000 curr count: 19727
2021/12/22 18:42:59 Waiting for src bucket item count to get to: 50000 curr count: 19727
2021/12/22 18:43:04 Waiting for src bucket item count to get to: 50000 curr count: 31141
2021/12/22 18:43:09 Waiting for src bucket item count to get to: 50000 curr count: 31141
2021/12/22 18:43:14 Waiting for src bucket item count to get to: 50000 curr count: 42161
2021/12/22 18:43:19 Waiting for src bucket item count to get to: 50000 curr count: 42161
2021/12/22 18:43:24 Waiting for src bucket item count to get to: 50000 curr count: 42161
2021/12/22 18:43:34 Waiting for dst bucket item count to get to: 50000 curr count: 37592
2021/12/22 18:43:39 Waiting for dst bucket item count to get to: 50000 curr count: 37592
2021/12/22 18:43:44 Waiting for dst bucket item count to get to: 50000 curr count: 47281
2021/12/22 18:43:49 Waiting for dst bucket item count to get to: 50000 curr count: 47281
2021/12/22 18:43:49 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:43:49 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:43:54 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/22 18:43:59 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/22 18:44:04 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/22 18:44:09 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/22 18:44:14 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/22 18:44:14 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2021/12/22 18:44:14 No eventing-con process running
2021/12/22 18:44:14 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut deleting in background"
}
2021/12/22 18:44:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:44:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:44:26 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:44:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:44:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:44:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:44:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:44:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebOut (179.32s)
=== RUN   TestDuplicateTimerFiringEventingSwapReb
2021/12/22 18:44:48 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/22 18:44:48 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2021/12/22 18:44:48 No eventing-con process running
2021/12/22 18:44:48 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingSwapReb not found"
}
2021/12/22 18:44:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:44:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:44:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:44:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:45:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:45:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:45:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:45:06 Deploying app: TestDuplicateTimerFiringEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:45:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb stored in temp store"
}
2021/12/22 18:45:13 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/22 18:45:18 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/22 18:45:23 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/22 18:45:28 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/22 18:45:28 App: TestDuplicateTimerFiringEventingSwapReb got deployed
2021/12/22 18:45:28 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/22 18:45:28 Starting bucket ops to source bucket
2021/12/22 18:45:28 Removing node(s): [] from the cluster
2021/12/22 18:45:33 Rebalance progress: 12.5
2021/12/22 18:45:38 Rebalance progress: 12.5
2021/12/22 18:45:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:45:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:45:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:45:43 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 18:45:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:45:49 Rebalance progress: 12.5
2021/12/22 18:45:54 Rebalance progress: 12.5
2021/12/22 18:45:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:45:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:45:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:45:59 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 18:46:04 Rebalance progress: 12.5
2021/12/22 18:46:09 Rebalance progress: 12.5
2021/12/22 18:46:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:46:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:46:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:46:14 Waiting for src bucket item count to get to: 50000 curr count: 47379
2021/12/22 18:46:19 Waiting for src bucket item count to get to: 50000 curr count: 47379
2021/12/22 18:46:29 Waiting for dst bucket item count to get to: 50000 curr count: 44997
2021/12/22 18:46:34 Waiting for dst bucket item count to get to: 50000 curr count: 44997
2021/12/22 18:46:34 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:46:34 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:46:39 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/22 18:46:44 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/22 18:46:49 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/22 18:46:55 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/22 18:47:00 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/22 18:47:00 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2021/12/22 18:47:00 No eventing-con process running
2021/12/22 18:47:00 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb deleting in background"
}
2021/12/22 18:47:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:47:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:47:11 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:47:16 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:47:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:47:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:47:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:47:28 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:47:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingSwapReb (170.23s)
=== RUN   TestDuplicateTimerFiringKVRebIn
2021/12/22 18:47:38 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/22 18:47:38 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2021/12/22 18:47:38 No eventing-con process running
2021/12/22 18:47:38 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebIn not found"
}
2021/12/22 18:47:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:47:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:47:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:47:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:47:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:47:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:47:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:47:57 Deploying app: TestDuplicateTimerFiringKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:47:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn stored in temp store"
}
2021/12/22 18:48:03 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/22 18:48:08 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/22 18:48:13 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/22 18:48:18 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/22 18:48:18 App: TestDuplicateTimerFiringKVRebIn got deployed
2021/12/22 18:48:18 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:48:18 Starting bucket ops to source bucket
2021/12/22 18:48:18 Removing node(s): [] from the cluster
2021/12/22 18:48:23 Rebalance progress: 12.5
2021/12/22 18:48:28 Rebalance progress: 12.5
2021/12/22 18:48:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:48:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:48:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:48:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:48:39 Rebalance progress: 12.5
2021/12/22 18:48:44 Rebalance progress: 12.5
2021/12/22 18:48:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:48:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:48:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:48:49 Waiting for src bucket item count to get to: 50000 curr count: 27554
2021/12/22 18:48:54 Waiting for src bucket item count to get to: 50000 curr count: 37117
2021/12/22 18:48:59 Waiting for src bucket item count to get to: 50000 curr count: 37117
2021/12/22 18:49:09 Waiting for dst bucket item count to get to: 50000 curr count: 27544
2021/12/22 18:49:14 Waiting for dst bucket item count to get to: 50000 curr count: 27544
2021/12/22 18:49:19 Waiting for dst bucket item count to get to: 50000 curr count: 44765
2021/12/22 18:49:24 Waiting for dst bucket item count to get to: 50000 curr count: 44765
2021/12/22 18:49:24 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:49:24 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:49:29 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/22 18:49:34 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/22 18:49:39 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/22 18:49:44 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/22 18:49:49 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/22 18:49:49 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2021/12/22 18:49:49 No eventing-con process running
2021/12/22 18:49:49 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn deleting in background"
}
2021/12/22 18:49:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:49:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:50:01 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:50:06 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:50:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:50:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:50:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:50:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:50:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebIn (169.67s)
=== RUN   TestDuplicateTimerFiringKVRebOut
2021/12/22 18:50:23 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:50:23 Removing node(s): [] from the cluster
2021/12/22 18:50:28 Rebalance progress: 100
2021/12/22 18:50:33 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/22 18:50:33 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2021/12/22 18:50:33 No eventing-con process running
2021/12/22 18:50:34 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebOut not found"
}
2021/12/22 18:50:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:50:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:50:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:50:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:50:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:50:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:50:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:50:52 Deploying app: TestDuplicateTimerFiringKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:50:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut stored in temp store"
}
2021/12/22 18:50:58 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/22 18:51:03 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/22 18:51:08 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/22 18:51:13 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/22 18:51:13 App: TestDuplicateTimerFiringKVRebOut got deployed
2021/12/22 18:51:13 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:51:13 Starting bucket ops to source bucket
2021/12/22 18:51:18 Rebalance progress: 12.5
2021/12/22 18:51:23 Rebalance progress: 12.5
2021/12/22 18:51:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:51:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:51:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:51:28 Waiting for src bucket item count to get to: 50000 curr count: 7990
2021/12/22 18:51:33 Waiting for src bucket item count to get to: 50000 curr count: 21289
2021/12/22 18:51:38 Waiting for src bucket item count to get to: 50000 curr count: 21289
2021/12/22 18:51:43 Waiting for src bucket item count to get to: 50000 curr count: 32587
2021/12/22 18:51:48 Waiting for src bucket item count to get to: 50000 curr count: 32587
2021/12/22 18:51:53 Waiting for src bucket item count to get to: 50000 curr count: 42574
2021/12/22 18:51:58 Waiting for src bucket item count to get to: 50000 curr count: 42574
2021/12/22 18:52:08 Waiting for dst bucket item count to get to: 50000 curr count: 34227
2021/12/22 18:52:13 Waiting for dst bucket item count to get to: 50000 curr count: 34227
2021/12/22 18:52:18 Waiting for dst bucket item count to get to: 50000 curr count: 34227
2021/12/22 18:52:23 Waiting for dst bucket item count to get to: 50000 curr count: 47543
2021/12/22 18:52:28 Waiting for dst bucket item count to get to: 50000 curr count: 47543
2021/12/22 18:52:28 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:52:28 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:52:34 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/22 18:52:39 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/22 18:52:44 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/22 18:52:49 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/22 18:52:54 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/22 18:52:54 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2021/12/22 18:52:54 No eventing-con process running
2021/12/22 18:52:54 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut deleting in background"
}
2021/12/22 18:52:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:53:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:53:06 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:53:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:53:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:53:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:53:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:53:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebOut (179.80s)
=== RUN   TestDuplicateTimerFiringKVSwapReb
2021/12/22 18:53:28 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/22 18:53:28 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2021/12/22 18:53:28 No eventing-con process running
2021/12/22 18:53:28 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVSwapReb not found"
}
2021/12/22 18:53:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:53:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:53:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:53:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:53:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:53:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:53:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:53:46 Deploying app: TestDuplicateTimerFiringKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:53:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb stored in temp store"
}
2021/12/22 18:53:52 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/22 18:53:57 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/22 18:54:02 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/22 18:54:07 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/22 18:54:07 App: TestDuplicateTimerFiringKVSwapReb got deployed
2021/12/22 18:54:07 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:54:07 Starting bucket ops to source bucket
2021/12/22 18:54:08 Removing node(s): [] from the cluster
2021/12/22 18:54:13 Rebalance progress: 12.5
2021/12/22 18:54:18 Rebalance progress: 12.5
2021/12/22 18:54:23 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:54:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:54:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:54:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 18:54:23 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:54:28 Rebalance progress: 12.5
2021/12/22 18:54:33 Rebalance progress: 12.5
2021/12/22 18:54:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:54:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:54:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:54:38 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 18:54:43 Rebalance progress: 12.5
2021/12/22 18:54:48 Rebalance progress: 12.5
2021/12/22 18:54:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:54:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:54:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:54:53 Waiting for src bucket item count to get to: 50000 curr count: 48715
2021/12/22 18:54:58 Waiting for src bucket item count to get to: 50000 curr count: 48715
2021/12/22 18:55:08 Waiting for dst bucket item count to get to: 50000 curr count: 43547
2021/12/22 18:55:13 Waiting for dst bucket item count to get to: 50000 curr count: 43547
2021/12/22 18:55:13 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/22 18:55:13 Post SET ops. Expected item count: 50000 got 50000
2021/12/22 18:55:18 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/22 18:55:23 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/22 18:55:29 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/22 18:55:34 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/22 18:55:39 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/22 18:55:39 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2021/12/22 18:55:39 No eventing-con process running
2021/12/22 18:55:39 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb deleting in background"
}
2021/12/22 18:55:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:55:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:55:51 Waiting for dst bucket item count to get to: 0 curr count: 32896
2021/12/22 18:55:56 Waiting for dst bucket item count to get to: 0 curr count: 32896
2021/12/22 18:55:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:55:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:56:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:56:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/22 18:56:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVSwapReb (169.69s)
=== RUN   TestKVRebOnUpdateBucketOpOneByOne
2021/12/22 18:56:17 Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 18:56:17 App: bucket_op_on_update got un-deployed
2021/12/22 18:56:17 No eventing-con process running
2021/12/22 18:56:17 Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/22 18:56:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:56:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:56:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:56:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:56:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:56:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:56:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:56:36 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:56:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/22 18:56:42 Starting bucket ops to source bucket
2021/12/22 18:56:47 Waiting for app: bucket_op_on_update to get deployed
2021/12/22 18:56:52 Waiting for app: bucket_op_on_update to get deployed
2021/12/22 18:56:57 Waiting for app: bucket_op_on_update to get deployed
2021/12/22 18:56:57 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:56:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:56:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:56:57 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:56:57 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 18:57:02 Rebalance progress: 12.5
2021/12/22 18:57:07 Rebalance progress: 12.5
2021/12/22 18:57:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:57:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:57:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:57:12 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 18:57:13 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 18:57:18 Rebalance progress: 12.5
2021/12/22 18:57:23 Rebalance progress: 12.5
2021/12/22 18:57:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:57:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:57:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:57:28 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/22 18:57:28 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 18:57:33 Rebalance progress: 12.5
2021/12/22 18:57:38 Rebalance progress: 12.5
2021/12/22 18:57:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:57:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:57:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:57:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 18:57:48 Rebalance progress: 12.5
2021/12/22 18:57:53 Rebalance progress: 12.5
2021/12/22 18:57:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:57:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:57:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:57:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 18:58:04 Rebalance progress: 12.5
2021/12/22 18:58:09 Rebalance progress: 12.5
2021/12/22 18:58:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:58:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:58:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:58:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/22 18:58:19 Rebalance progress: 12.5
2021/12/22 18:58:24 Rebalance progress: 12.5
2021/12/22 18:58:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:58:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:58:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 18:58:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 18:58:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 18:58:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 18:58:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 18:58:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 18:58:54 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 18:58:54 eventingSetup.go:46: No eventing-con process running
2021/12/22 18:58:54 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/22 18:58:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:59:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:59:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10647
2021/12/22 18:59:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:59:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:59:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:59:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10647
2021/12/22 18:59:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpOneByOne (190.43s)
=== RUN   TestKVForceFailover
2021/12/22 18:59:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 18:59:33 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 18:59:33 eventingSetup.go:46: No eventing-con process running
2021/12/22 18:59:33 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/22 18:59:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:59:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:59:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:59:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:59:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:59:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 18:59:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 18:59:47 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 18:59:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 18:59:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 18:59:52 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 18:59:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/22 18:59:53 Starting bucket ops to source bucket
2021/12/22 18:59:58 Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:00:03 Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:00:08 Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:00:13 Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:00:13 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:00:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:00:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:00:13 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2021/12/22 19:00:33 clusterSetup.go:237: Kicking off failover recovery, type: full
2021/12/22 19:00:33 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/22 19:00:38 Rebalance progress: 12.5
2021/12/22 19:00:43 Rebalance progress: 12.5
2021/12/22 19:00:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:00:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:00:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:00:48 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/22 19:00:54 Rebalance progress: 12.5
2021/12/22 19:00:59 Rebalance progress: 12.5
2021/12/22 19:01:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:01:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:01:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:01:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:01:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:01:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:01:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:01:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:01:29 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:01:29 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:01:29 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/22 19:01:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:01:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:01:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7047
2021/12/22 19:01:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7047
2021/12/22 19:01:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:01:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:01:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:01:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7047
2021/12/22 19:01:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVForceFailover (160.04s)
=== RUN   TestKVHardFailoverRecovery
2021/12/22 19:02:08 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:02:08 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:02:08 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:02:08 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/22 19:02:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:02:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:02:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:02:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:02:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:02:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:02:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:02:26 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 19:02:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/22 19:02:33 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 19:02:38 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:02:43 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:02:48 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:02:48 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:02:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:02:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:02:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 19:02:48 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:02:53 Rebalance progress: 12.5
2021/12/22 19:02:58 Rebalance progress: 12.5
2021/12/22 19:03:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:03:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:03:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:03:03 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2021/12/22 19:04:03 clusterSetup.go:237: Kicking off failover recovery, type: full
2021/12/22 19:04:08 Rebalance progress: 12.5
2021/12/22 19:04:13 Rebalance progress: 12.5
2021/12/22 19:04:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:04:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:04:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:04:18 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 19:04:23 Rebalance progress: 12.5
2021/12/22 19:04:28 Rebalance progress: 12.5
2021/12/22 19:04:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:04:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:04:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:04:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:04:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:04:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:04:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:04:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:04:59 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:04:59 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:04:59 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/22 19:05:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:05:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:05:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11557
2021/12/22 19:05:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11557
2021/12/22 19:05:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:05:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:05:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:05:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12089
2021/12/22 19:05:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVHardFailoverRecovery (209.84s)
=== RUN   TestKVRebOnUpdateBucketOpAllAtOnce
2021/12/22 19:05:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:05:38 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:05:38 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:05:38 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/22 19:05:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:05:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:05:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:05:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:05:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:05:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:05:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:05:56 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 19:05:57 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/22 19:06:02 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 19:06:07 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:06:12 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:06:17 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:06:17 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:06:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:06:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:06:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 19:06:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 19:06:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/22 19:06:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:06:23 Rebalance progress: 12.5
2021/12/22 19:06:28 Rebalance progress: 12.5
2021/12/22 19:06:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:06:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:06:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:06:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/22 19:06:39 Rebalance progress: 12.5
2021/12/22 19:06:44 Rebalance progress: 12.5
2021/12/22 19:06:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:06:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:06:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:06:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:06:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:07:04 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:07:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:07:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:07:14 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:07:14 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:07:14 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/22 19:07:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:07:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:07:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4621
2021/12/22 19:07:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:07:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:07:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:07:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4621
2021/12/22 19:07:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpAllAtOnce (129.93s)
=== RUN   TestKVSwapRebOnUpdateBucketOp
2021/12/22 19:07:48 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:07:48 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:07:48 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:07:48 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/22 19:07:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:07:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:07:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:07:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:08:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:08:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:08:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:08:01 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 19:08:02 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/22 19:08:07 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 19:08:12 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:08:17 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:08:22 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:08:22 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:08:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:08:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:08:22 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 19:08:23 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:08:28 Rebalance progress: 12.5
2021/12/22 19:08:33 Rebalance progress: 12.5
2021/12/22 19:08:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:08:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:08:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:08:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 19:08:38 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 19:08:43 Rebalance progress: 12.5
2021/12/22 19:08:48 Rebalance progress: 12.5
2021/12/22 19:08:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:08:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:08:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:08:53 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 19:08:58 Rebalance progress: 12.5
2021/12/22 19:09:03 Rebalance progress: 12.5
2021/12/22 19:09:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:09:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:09:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:09:13 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:09:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:09:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:09:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:09:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:09:34 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:09:34 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:09:34 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/22 19:09:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:09:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:09:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6076
2021/12/22 19:09:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:09:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:09:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:09:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6076
2021/12/22 19:09:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:10:03 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:10:03 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:10:03 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:10:03 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/22 19:10:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:10:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:10:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:10:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:10:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:10:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebOnUpdateBucketOp (158.45s)
=== RUN   TestKVRebalanceWithMultipleHandlers
2021/12/22 19:10:26 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:10:26 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:10:26 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:10:26 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/22 19:10:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:10:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:10:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:10:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:10:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:10:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:10:45 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:10:45 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/22 19:10:45 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:10:45 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2021/12/22 19:10:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:10:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:10:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:10:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:10:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:10:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:10:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:10:58 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 19:10:59 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:10:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:10:59 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/22 19:11:00 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2021/12/22 19:11:05 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 19:11:10 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:11:15 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:11:20 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:11:20 clusterSetup.go:354: App: bucket_op_on_update got deployed
2021/12/22 19:11:25 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/22 19:11:30 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/22 19:11:35 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/22 19:11:36 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:11:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:11:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:11:36 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 19:11:36 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:11:41 Rebalance progress: 12.5
2021/12/22 19:11:46 Rebalance progress: 12.5
2021/12/22 19:11:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:11:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:11:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:11:51 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 19:11:52 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:11:57 Rebalance progress: 12.5
2021/12/22 19:12:02 Rebalance progress: 12.5
2021/12/22 19:12:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:12:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:12:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:12:07 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/22 19:12:07 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:12:12 Rebalance progress: 12.5
2021/12/22 19:12:17 Rebalance progress: 12.5
2021/12/22 19:12:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:12:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:12:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:12:22 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 19:12:27 Rebalance progress: 12.5
2021/12/22 19:12:32 Rebalance progress: 12.5
2021/12/22 19:12:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:12:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:12:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:12:37 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 19:12:42 Rebalance progress: 12.5
2021/12/22 19:12:47 Rebalance progress: 12.5
2021/12/22 19:12:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:12:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:12:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:12:52 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/22 19:12:58 Rebalance progress: 12.5
2021/12/22 19:13:03 Rebalance progress: 12.5
2021/12/22 19:13:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:13:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:13:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:13:13 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:13:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:13:23 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:13:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:13:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:13:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:13:43 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:13:43 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:13:43 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:13:43 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/22 19:13:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:13:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:13:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12199
2021/12/22 19:13:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:13:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:14:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:14:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:14:10 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:14:15 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:14:20 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:14:25 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:14:30 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:14:30 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/22 19:14:30 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:14:30 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2021/12/22 19:14:32 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:14:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:14:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:14:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:14:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:14:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebalanceWithMultipleHandlers (267.61s)
=== RUN   TestKVSwapRebalanceWithMultipleHandlers
2021/12/22 19:14:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:14:54 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:14:54 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:14:54 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/22 19:14:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:15:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:15:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:15:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:15:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:15:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:15:12 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:15:12 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/22 19:15:12 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:15:12 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2021/12/22 19:15:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:15:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:15:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:15:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:15:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:15:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:15:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:15:26 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 19:15:27 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:15:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:15:27 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/22 19:15:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2021/12/22 19:15:33 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 19:15:38 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:15:43 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:15:48 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:15:48 clusterSetup.go:354: App: bucket_op_on_update got deployed
2021/12/22 19:15:53 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/22 19:15:58 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/22 19:16:03 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/22 19:16:03 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:16:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:16:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:16:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 19:16:04 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:16:09 Rebalance progress: 12.5
2021/12/22 19:16:14 Rebalance progress: 12.5
2021/12/22 19:16:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:16:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:16:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:16:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 19:16:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 19:16:25 Rebalance progress: 12.5
2021/12/22 19:16:30 Rebalance progress: 12.5
2021/12/22 19:16:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:16:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:16:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:16:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 19:16:40 Rebalance progress: 12.5
2021/12/22 19:16:45 Rebalance progress: 12.5
2021/12/22 19:16:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:16:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:16:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:16:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:17:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:17:06 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:17:11 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:17:16 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:17:16 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:17:16 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:17:16 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/22 19:17:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:17:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:17:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7709
2021/12/22 19:17:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:17:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:17:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:17:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7709
2021/12/22 19:17:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7709
2021/12/22 19:17:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:17:51 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:17:56 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:18:02 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:18:07 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:18:12 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/22 19:18:12 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/22 19:18:12 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:18:12 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2021/12/22 19:18:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:18:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:18:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:18:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:18:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:18:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebalanceWithMultipleHandlers (221.67s)
=== RUN   TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/22 19:18:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:18:35 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:18:35 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:18:35 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/22 19:18:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:18:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:18:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:18:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:18:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:18:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:18:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:18:54 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 19:18:55 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/22 19:19:00 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 19:19:05 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:19:10 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:19:15 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:19:15 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:19:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:19:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:19:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 19:19:15 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:19:35 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:19:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:19:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:19:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:19:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:19:46 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:19:51 Rebalance progress: 12.5
2021/12/22 19:19:56 Rebalance progress: 12.5
2021/12/22 19:20:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:20:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:20:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:20:01 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 19:20:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 19:20:07 Rebalance progress: 12.5
2021/12/22 19:20:12 Rebalance progress: 12.5
2021/12/22 19:20:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:20:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:20:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:20:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 19:20:22 Rebalance progress: 12.5
2021/12/22 19:20:27 Rebalance progress: 12.5
2021/12/22 19:20:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:20:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:20:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:20:37 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:20:42 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:20:47 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:20:53 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:20:58 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:20:58 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:20:58 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:20:58 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/22 19:21:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:21:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:21:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:21:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:21:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:21:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9172
2021/12/22 19:21:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne (170.97s)
=== RUN   TestKVFailoverOnUpdateBucketOp
2021/12/22 19:21:26 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:21:26 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:21:26 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:21:26 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/22 19:21:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:21:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:21:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:21:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:21:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:21:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:21:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:21:45 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 19:21:46 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/22 19:21:51 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/22 19:21:56 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:22:01 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:22:06 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:22:06 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:22:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:22:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:22:06 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 19:22:06 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:22:12 Rebalance progress: 12.5
2021/12/22 19:22:17 Rebalance progress: 12.5
2021/12/22 19:22:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:22:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:22:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:22:22 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:22:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:22:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:22:32 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:22:37 Rebalance progress: 12.5
2021/12/22 19:22:42 Rebalance progress: 12.5
2021/12/22 19:22:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:22:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:22:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:22:47 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/22 19:22:47 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/22 19:22:52 Rebalance progress: 12.5
2021/12/22 19:22:57 Rebalance progress: 12.5
2021/12/22 19:23:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:23:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:23:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:23:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/22 19:23:07 Rebalance progress: 12.5
2021/12/22 19:23:12 Rebalance progress: 12.5
2021/12/22 19:23:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:23:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:23:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:23:22 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:23:27 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:23:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:23:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:23:43 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:23:43 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:23:43 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:23:43 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/22 19:23:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:23:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:23:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8608
2021/12/22 19:23:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:23:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:24:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:24:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8608
2021/12/22 19:24:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVFailoverOnUpdateBucketOp (170.03s)
=== RUN   TestBootstrapAfterKVHardFailover
2021/12/22 19:24:11 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/22 19:24:12 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/22 19:24:17 Rebalance progress: 100
2021/12/22 19:24:17 Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:24:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:24:47 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/22 19:24:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/22 19:24:53 Removing node(s): [] from the cluster
2021/12/22 19:24:53 Starting bucket ops to source bucket
2021/12/22 19:24:58 Rebalance failed. See logs for detailed reason. You can try again.
2021/12/22 19:25:03 Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:25:08 Waiting for app: bucket_op_on_update to get deployed
2021/12/22 19:25:08 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:25:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:25:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/22 19:25:13 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:25:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:25:23 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:25:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:25:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/22 19:25:34 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/22 19:25:34 eventingSetup.go:46: No eventing-con process running
2021/12/22 19:25:34 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/22 19:25:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:25:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:25:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1511
2021/12/22 19:25:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/22 19:25:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/22 19:25:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/22 19:25:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1511
2021/12/22 19:25:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBootstrapAfterKVHardFailover (110.73s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	11866.735s

Rebalance tests took 3 hours, 17 minutes and 49 seconds.

Testing Succeeded


Version: versions-22.12.2021-11.50.cfg
Build Log: make-22.12.2021-11.50.log
Server Log: logs-22.12.2021-11.50.tar.gz

Finished