Building

Started building at 2022/04/04 13:46:19
Using pegged server, 2543 build
Calculating base
Updating mirror
Basing run on 7.1.0-2543 d704ad4b8
Updating tree for run 04.04.2022-13.46
gocb is at 40020ee, changes since last good build: none
libcouchbase is at e4de408, changes since last good build: none
indexing is at 99c7797, changes since last good build: 
 99c77974 MB-51636: Make vbucket fetch in kv_sender and projector synchronous
 c7736f2b MB-51499: [BP to Neo] Unify backfillMonitor, logStats routines
kv_engine is at f9c565b, changes since last good build: 
 f9c565b58 MB-51639: Unconditionally persist disk snapshot end for HPS
 dc531f247 MB-47139 magma-kvstore: Adapt to SetMaxOpenFiles API change
ns_server is at 0787ff8, changes since last good build: 
 0787ff802 MB-51655 check docs!read instead of meta!read for /_goxdcr/_pre_replicate
 17f83c80b MB-51602: Filter out tls options that are not supported by tls1.3
 9f81132c1 MB-51467 Add min-height to .wb-results-wrapper
 ed00949aa MB-51573 Add storageBackend to terse bucket info
 7b08404c7 Merge remote-tracking branch 'gerrit/cheshire-cat' into neo
 3ffb51f4d [BP] MB-51458 do not truncate long dcp connection names if the version
 20a233014 MB-51458 check if consumer truncates names when constructing
 ab322999c MB-51458 do not check project_intact key when computing quirks
 aa89b2afb MB-51458 do not copy the whole ns_config when computing quirks
 0fb42c72a MB-51458 do not truncate long dcp connection names if the version
couchstore is at 56b0f7b, changes since last good build: 
 56b0f7b MB-51421: Merge 'couchbase/cheshire-cat' into 'couchbase/neo'
 b35acc4 MB-51421: [BP] couch_dbdump incorrect decode of flex_code for deletion source
couchdb is at 27d1470, changes since last good build: none
testrunner is at 6c09d4f, changes since last good build: 
 6c09d4fb3 Initial basic working script for deploying E2E App
 3c883d6b1 add release build of 6.6.4 and 6.6.5
 9e1fe28ee increasing sleep time after scope deleting in fts collection tests
 6bb2b3333 CBQE-7537: Fix TLS teardown in backup FTS test
 6af0c380d Fix for os_certify_job.
 a275abe63 comment out flaky tests and fix system event logging tests.
 8c19bcc8f CE does not support https
 728183092 Install non root user on deb and rpm using cb-nonpackage-installer from couchbase website.
 8615841ab CBQE-7534: Update expected error messages for backup/CLI
 a341593c8 Fix XDCR cert selection for backup
 9f78c5016 OS Certification test fixes
 f28e91802 commenting not required cases for fts
 569f435c6 MB-51600: Test case for iterator limit
 74d3f5bb4 Disabling unstable tests
 662088bc1 CBQE-7527: 1/n Test TLS minimum version
 e2227c918 fix for ansi_joins and ansi_nest_unnest.
 6500920bb Comment out failing test cases to be fixed.
 17bc76997 Wait for create scope/collection
 d9d3951f3 system event log fixes
 aace2524a Fix for sample tc
 ca3b50db9 Fixes for os_certify_n1ql.
 057e7ac36 Revert "use https port in get port when use https is true"
 377343ddb speculative fix for aggr pushdown tests + some extra logging.
 205d103fe MB-51590: add test case for multiple query statement (inner)
 de0eaac94 Disable KV error condition test failing for a long time
 00bfb62a3 CBQE-7524: Update CBBM XDCR tests to use new cert retrieval
 9a1304292 CBQE-7525: Change syslog failures param to prevent overlap
 318fe959c Conf file fixes backup_restore/os_certify
 694917b81 Fix for GSI failure in build test case
 429356b0b use https port in get port when use https is true
 d37fd5c75 Retry prepare post upgrade
 8c13ffa89 Add wait time before checking scope/collection
 943f12887 Enabling 7.0.4 in testrunner
 cebcf3507 Split job into groups and disable unstable ephemeral bucket testcase
 80eb8726b Fix for misc test cases: - advise: update recommended index - skip range: disable query d - window function: add non null predicate
 eaf39aa99 Neo regression fixes - 3
 9a733f1f1 Disabling unstable jobs for Neo tests
 de85adb05 Change server-add
 2a1a8fced Disabling Magma jobs for memcached errors
 3906275a3 Eventing: fix minor testware issue and comment out unstable tests
 a755f6847 CBQE-7509: 4/n Delete few tests from py-collection-rbac.conf
 2ee7d9087 Fix log issues in audit test: use --hard instead of --force for failover
 7af8ef9b8 Comment out unstable tests
 e6ec05e13 Neo regression fixes - 2
 24293e6d8 CBQE-7519: Fix backup restore directory checking on windows
 057bb2a0a remove dup tc's as sasl buckets dont exist anymore
 481c55a7c Fix log issues in audit tests
 d67d6dfca MB-49865 add upgrade test to future build sanity
 04337422d Fix for magma test case
 486f645c7 Fix for update stats test cases
 2a30f9c8e speculative fix for ansi_joins_clusterops.
Switching eventing to unstable
eventing is at 7e13bfe, changes since last good build: none
Switching eventing-ee to unstable
eventing-ee is at 539638b, changes since last good build: 
 539638b MB-31916: Queue / Topic Repair - Part #1
Pulling in uncommitted change 160397 at refs/changes/97/160397/3
Total 23 (delta 15), reused 17 (delta 15)
[unstable 1bb8575f] MB-100 : Do not fail n1ql timeout test if we are catching timeout exceptions successfully
 Author: abhijpes 
 Date: Mon Aug 30 08:24:38 2021 +0530
 1 file changed, 2 insertions(+), 2 deletions(-)
Pulling in uncommitted change 163449 at refs/changes/49/163449/1
Total 48 (delta 27), reused 39 (delta 27)
[unstable f0c69894] MB-100: collect data when test fails
 Author: AnkitPrabhu 
 Date: Tue Oct 12 14:02:31 2021 +0530
 1 file changed, 2 insertions(+)
Pulling in uncommitted change 172194 at refs/changes/94/172194/12
Total 8 (delta 5), reused 8 (delta 5)
[unstable aa7e703d] MB-44334 : Implement endpoint to return stats of a particular function
 Author: M. Nawazish. Khan 
 Date: Mon Mar 14 16:45:18 2022 +0530
 4 files changed, 187 insertions(+), 82 deletions(-)
 create mode 100644 service_manager/app_stats.go
Pulling in uncommitted change 173178 at refs/changes/78/173178/1
Total 4 (delta 3), reused 4 (delta 3)
[unstable 29289d52] MB-51670: Include vb remaing to own and give up only when worker rebalance ongoing
 Author: AnkitPrabhu 
 Date: Mon Apr 4 11:13:16 2022 +0530
 1 file changed, 8 insertions(+), 3 deletions(-)
Building cmakefiles and deps
Building main product

Testing

Started testing at 2022/04/04 14:01:41
Testing mode: rebalance
Starting server
Starting server: attempt 1
Starting server
Starting server: attempt 1

Rebalance tests

2022/04/04 14:04:38 Started rebalance
=== RUN   TestDuplicateWithEventingRebIn
2022/04/04 14:04:57 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
running apps fetch error json: cannot unmarshal number into Go value of type string
2022/04/04 14:05:02 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/04/04 14:05:02 App: TestDuplicateWithEventingRebIn got un-deployed
2022/04/04 14:05:02 No eventing-con process running
2022/04/04 14:05:02 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebIn not found"
}
2022/04/04 14:05:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:05:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:05:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:05:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:05:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:05:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:05:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:05:20 Deploying app: TestDuplicateWithEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:05:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn stored in temp store"
}
2022/04/04 14:05:26 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/04/04 14:05:31 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/04/04 14:05:36 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/04/04 14:05:41 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/04/04 14:05:41 App: TestDuplicateWithEventingRebIn got deployed
2022/04/04 14:05:41 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:05:41 Starting bucket ops to source bucket
2022/04/04 14:06:02 Removing node(s): [] from the cluster
2022/04/04 14:06:07 Rebalance progress: 0
2022/04/04 14:06:12 Rebalance progress: 0
2022/04/04 14:06:17 Rebalance progress: 25
2022/04/04 14:06:22 Rebalance progress: 25
2022/04/04 14:06:27 Rebalance progress: 25
2022/04/04 14:06:32 Rebalance progress: 25
2022/04/04 14:06:37 Rebalance progress: 75
2022/04/04 14:06:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:06:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:06:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:06:42 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/04/04 14:06:42 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:06:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:06:47 Rebalance progress: 25
2022/04/04 14:06:52 Rebalance progress: 25
2022/04/04 14:06:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:06:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:06:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:06:57 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/04/04 14:06:57 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:06:57 Waiting for src bucket item count to get to: 200000 curr count: 117268
2022/04/04 14:07:02 Waiting for src bucket item count to get to: 200000 curr count: 134206
2022/04/04 14:07:07 Waiting for src bucket item count to get to: 200000 curr count: 134206
2022/04/04 14:07:12 Waiting for src bucket item count to get to: 200000 curr count: 151405
2022/04/04 14:07:17 Waiting for src bucket item count to get to: 200000 curr count: 151405
2022/04/04 14:07:22 Waiting for src bucket item count to get to: 200000 curr count: 168636
2022/04/04 14:07:27 Waiting for src bucket item count to get to: 200000 curr count: 168636
2022/04/04 14:07:32 Waiting for src bucket item count to get to: 200000 curr count: 168636
2022/04/04 14:07:37 Waiting for src bucket item count to get to: 200000 curr count: 185577
2022/04/04 14:07:42 Waiting for src bucket item count to get to: 200000 curr count: 185577
2022/04/04 14:07:52 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/04/04 14:07:57 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/04/04 14:08:02 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/04/04 14:08:07 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/04/04 14:08:12 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/04/04 14:08:17 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/04/04 14:08:22 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/04/04 14:08:27 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/04/04 14:08:32 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/04/04 14:08:37 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/04/04 14:08:37 Post SET ops. Expected item count: 200000 got 200001
2022/04/04 14:08:42 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/04/04 14:08:47 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/04/04 14:08:52 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/04/04 14:08:57 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/04/04 14:08:57 App: TestDuplicateWithEventingRebIn got un-deployed
2022/04/04 14:08:57 No eventing-con process running
2022/04/04 14:08:57 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn deleting in background"
}
2022/04/04 14:08:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:09:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:09:09 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/04/04 14:09:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:09:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:09:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:09:21 Waiting for dst bucket item count to get to: 0 curr count: 200001
2022/04/04 14:09:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebIn (274.36s)
=== RUN   TestDuplicateWithEventingRebOut
2022/04/04 14:09:26 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:09:26 Removing node(s): [] from the cluster
2022/04/04 14:09:31 Rebalance progress: 100
2022/04/04 14:09:36 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/04/04 14:09:36 App: TestDuplicateWithEventingRebOut got un-deployed
2022/04/04 14:09:36 No eventing-con process running
2022/04/04 14:09:36 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebOut not found"
}
2022/04/04 14:09:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:09:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:09:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:09:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:09:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:09:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:09:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:09:55 Deploying app: TestDuplicateWithEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:09:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut stored in temp store"
}
2022/04/04 14:10:01 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/04/04 14:10:06 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/04/04 14:10:11 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/04/04 14:10:16 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/04/04 14:10:16 App: TestDuplicateWithEventingRebOut got deployed
2022/04/04 14:10:16 Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:10:16 Starting bucket ops to source bucket
2022/04/04 14:10:21 Rebalance progress: 25
2022/04/04 14:10:26 Rebalance progress: 25
2022/04/04 14:10:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:10:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:10:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:10:31 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/04/04 14:10:31 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:10:31 Waiting for src bucket item count to get to: 200000 curr count: 9156
2022/04/04 14:10:36 Waiting for src bucket item count to get to: 200000 curr count: 26295
2022/04/04 14:10:41 Waiting for src bucket item count to get to: 200000 curr count: 26295
2022/04/04 14:10:46 Waiting for src bucket item count to get to: 200000 curr count: 43490
2022/04/04 14:10:51 Waiting for src bucket item count to get to: 200000 curr count: 43490
2022/04/04 14:10:56 Waiting for src bucket item count to get to: 200000 curr count: 61020
2022/04/04 14:11:01 Waiting for src bucket item count to get to: 200000 curr count: 61020
2022/04/04 14:11:06 Waiting for src bucket item count to get to: 200000 curr count: 61020
2022/04/04 14:11:11 Waiting for src bucket item count to get to: 200000 curr count: 78215
2022/04/04 14:11:16 Waiting for src bucket item count to get to: 200000 curr count: 78215
2022/04/04 14:11:21 Waiting for src bucket item count to get to: 200000 curr count: 95277
2022/04/04 14:11:26 Waiting for src bucket item count to get to: 200000 curr count: 95277
2022/04/04 14:11:31 Waiting for src bucket item count to get to: 200000 curr count: 112528
2022/04/04 14:11:36 Waiting for src bucket item count to get to: 200000 curr count: 112528
2022/04/04 14:11:41 Waiting for src bucket item count to get to: 200000 curr count: 129877
2022/04/04 14:11:46 Waiting for src bucket item count to get to: 200000 curr count: 147324
2022/04/04 14:11:51 Waiting for src bucket item count to get to: 200000 curr count: 147324
2022/04/04 14:11:56 Waiting for src bucket item count to get to: 200000 curr count: 164614
2022/04/04 14:12:01 Waiting for src bucket item count to get to: 200000 curr count: 164614
2022/04/04 14:12:06 Waiting for src bucket item count to get to: 200000 curr count: 181780
2022/04/04 14:12:11 Waiting for src bucket item count to get to: 200000 curr count: 181780
2022/04/04 14:12:16 Waiting for src bucket item count to get to: 200000 curr count: 198627
2022/04/04 14:12:21 Waiting for src bucket item count to get to: 200000 curr count: 198627
2022/04/04 14:12:26 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 14:12:26 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 14:12:31 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/04/04 14:12:36 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/04/04 14:12:41 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/04/04 14:12:46 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/04/04 14:12:46 App: TestDuplicateWithEventingRebOut got un-deployed
2022/04/04 14:12:46 No eventing-con process running
2022/04/04 14:12:46 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut deleting in background"
}
2022/04/04 14:12:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:12:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:12:58 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/04/04 14:12:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:13:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:13:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:13:10 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/04/04 14:13:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebOut (229.03s)
=== RUN   TestDuplicateWithEventingSwapReb
2022/04/04 14:13:20 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/04/04 14:13:20 App: TestDuplicateWithEventingSwapReb got un-deployed
2022/04/04 14:13:20 No eventing-con process running
2022/04/04 14:13:20 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingSwapReb not found"
}
2022/04/04 14:13:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:13:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:13:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:13:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:13:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:13:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:13:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:13:38 Deploying app: TestDuplicateWithEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:13:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb stored in temp store"
}
2022/04/04 14:13:45 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/04/04 14:13:50 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/04/04 14:13:55 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/04/04 14:14:00 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/04/04 14:14:00 App: TestDuplicateWithEventingSwapReb got deployed
2022/04/04 14:14:00 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:14:00 Starting bucket ops to source bucket
2022/04/04 14:14:00 Removing node(s): [] from the cluster
2022/04/04 14:14:05 Rebalance progress: 25
2022/04/04 14:14:10 Rebalance progress: 25
2022/04/04 14:14:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:14:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:14:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:14:15 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/04/04 14:14:15 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:14:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:14:22 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:14:27 Rebalance progress: 16.66666666666667
2022/04/04 14:14:32 Rebalance progress: 16.66666666666667
2022/04/04 14:14:37 Rebalance progress: 16.66666666666667
2022/04/04 14:14:42 Rebalance progress: 72.22222222222223
2022/04/04 14:14:47 Rebalance progress: 72.22222222222223
2022/04/04 14:14:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:14:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:14:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:14:52 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:14:52 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 14:14:57 Rebalance progress: 16.66666666666667
2022/04/04 14:15:02 Rebalance progress: 16.66666666666667
2022/04/04 14:15:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:15:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:15:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:15:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:15:07 Waiting for src bucket item count to get to: 200000 curr count: 99115
2022/04/04 14:15:12 Waiting for src bucket item count to get to: 200000 curr count: 99115
2022/04/04 14:15:17 Waiting for src bucket item count to get to: 200000 curr count: 115876
2022/04/04 14:15:22 Waiting for src bucket item count to get to: 200000 curr count: 115876
2022/04/04 14:15:27 Waiting for src bucket item count to get to: 200000 curr count: 133081
2022/04/04 14:15:32 Waiting for src bucket item count to get to: 200000 curr count: 133081
2022/04/04 14:15:37 Waiting for src bucket item count to get to: 200000 curr count: 150109
2022/04/04 14:15:42 Waiting for src bucket item count to get to: 200000 curr count: 150109
2022/04/04 14:15:47 Waiting for src bucket item count to get to: 200000 curr count: 167264
2022/04/04 14:15:52 Waiting for src bucket item count to get to: 200000 curr count: 167264
2022/04/04 14:15:57 Waiting for src bucket item count to get to: 200000 curr count: 183918
2022/04/04 14:16:02 Waiting for src bucket item count to get to: 200000 curr count: 183918
2022/04/04 14:16:07 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 14:16:07 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 14:16:12 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/04/04 14:16:17 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/04/04 14:16:22 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/04/04 14:16:27 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/04/04 14:16:27 App: TestDuplicateWithEventingSwapReb got un-deployed
2022/04/04 14:16:27 No eventing-con process running
2022/04/04 14:16:27 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb deleting in background"
}
2022/04/04 14:16:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:16:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:16:39 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/04/04 14:16:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:16:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:16:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:16:51 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/04/04 14:16:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingSwapReb (220.98s)
=== RUN   TestDuplicateWithKVRebIn
2022/04/04 14:17:01 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/04/04 14:17:01 App: TestDuplicateWithKVRebIn got un-deployed
2022/04/04 14:17:01 No eventing-con process running
2022/04/04 14:17:01 Function: TestDuplicateWithKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebIn not found"
}
2022/04/04 14:17:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:17:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:17:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:17:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:17:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:17:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:17:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:17:19 Deploying app: TestDuplicateWithKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:17:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn stored in temp store"
}
2022/04/04 14:17:26 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/04/04 14:17:31 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/04/04 14:17:36 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/04/04 14:17:41 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/04/04 14:17:41 App: TestDuplicateWithKVRebIn got deployed
2022/04/04 14:17:41 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 14:17:41 Starting bucket ops to source bucket
2022/04/04 14:17:41 Removing node(s): [] from the cluster
2022/04/04 14:17:46 Rebalance progress: 16.66666666666667
2022/04/04 14:17:51 Rebalance progress: 16.66666666666667
2022/04/04 14:17:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:17:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:17:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:17:56 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:17:56 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:18:01 Rebalance progress: 16.66666666666667
2022/04/04 14:18:06 Rebalance progress: 16.66666666666667
2022/04/04 14:18:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:18:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:18:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:18:11 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:18:11 Waiting for src bucket item count to get to: 200000 curr count: 33742
2022/04/04 14:18:16 Waiting for src bucket item count to get to: 200000 curr count: 50123
2022/04/04 14:18:21 Waiting for src bucket item count to get to: 200000 curr count: 50123
2022/04/04 14:18:26 Waiting for src bucket item count to get to: 200000 curr count: 67205
2022/04/04 14:18:31 Waiting for src bucket item count to get to: 200000 curr count: 67205
2022/04/04 14:18:36 Waiting for src bucket item count to get to: 200000 curr count: 83315
2022/04/04 14:18:41 Waiting for src bucket item count to get to: 200000 curr count: 83315
2022/04/04 14:18:46 Waiting for src bucket item count to get to: 200000 curr count: 99802
2022/04/04 14:18:51 Waiting for src bucket item count to get to: 200000 curr count: 99802
2022/04/04 14:18:56 Waiting for src bucket item count to get to: 200000 curr count: 116613
2022/04/04 14:19:01 Waiting for src bucket item count to get to: 200000 curr count: 116613
2022/04/04 14:19:06 Waiting for src bucket item count to get to: 200000 curr count: 116613
2022/04/04 14:19:11 Waiting for src bucket item count to get to: 200000 curr count: 133244
2022/04/04 14:19:16 Waiting for src bucket item count to get to: 200000 curr count: 133244
2022/04/04 14:19:21 Waiting for src bucket item count to get to: 200000 curr count: 149941
2022/04/04 14:19:26 Waiting for src bucket item count to get to: 200000 curr count: 149941
2022/04/04 14:19:31 Waiting for src bucket item count to get to: 200000 curr count: 166903
2022/04/04 14:19:36 Waiting for src bucket item count to get to: 200000 curr count: 183234
2022/04/04 14:19:41 Waiting for src bucket item count to get to: 200000 curr count: 183234
2022/04/04 14:19:46 Waiting for src bucket item count to get to: 200000 curr count: 199721
2022/04/04 14:19:51 Waiting for src bucket item count to get to: 200000 curr count: 199721
2022/04/04 14:19:56 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 14:19:56 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 14:20:01 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/04/04 14:20:06 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/04/04 14:20:11 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/04/04 14:20:16 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/04/04 14:20:17 App: TestDuplicateWithKVRebIn got un-deployed
2022/04/04 14:20:17 No eventing-con process running
2022/04/04 14:20:17 Function: TestDuplicateWithKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn deleting in background"
}
2022/04/04 14:20:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:20:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:20:28 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/04/04 14:20:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:20:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:20:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:20:40 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/04/04 14:20:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebIn (229.23s)
=== RUN   TestDuplicateWithKVRebOut
2022/04/04 14:20:45 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 14:20:45 Removing node(s): [] from the cluster
2022/04/04 14:20:50 Rebalance progress: 100
2022/04/04 14:20:55 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/04/04 14:20:55 App: TestDuplicateWithKVRebOut got un-deployed
2022/04/04 14:20:55 No eventing-con process running
2022/04/04 14:20:55 Function: TestDuplicateWithKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebOut not found"
}
2022/04/04 14:20:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:21:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:21:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:21:04 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:21:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:21:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:21:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:21:14 Deploying app: TestDuplicateWithKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:21:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut stored in temp store"
}
2022/04/04 14:21:20 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/04/04 14:21:25 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/04/04 14:21:30 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/04/04 14:21:35 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/04/04 14:21:35 App: TestDuplicateWithKVRebOut got deployed
2022/04/04 14:21:35 Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:21:35 Starting bucket ops to source bucket
2022/04/04 14:21:40 Rebalance progress: 16.66666666666667
2022/04/04 14:21:45 Rebalance progress: 16.66666666666667
2022/04/04 14:21:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:21:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:21:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:21:50 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:21:50 Waiting for src bucket item count to get to: 200000 curr count: 9869
2022/04/04 14:21:55 Waiting for src bucket item count to get to: 200000 curr count: 26713
2022/04/04 14:22:00 Waiting for src bucket item count to get to: 200000 curr count: 26713
2022/04/04 14:22:05 Waiting for src bucket item count to get to: 200000 curr count: 43577
2022/04/04 14:22:10 Waiting for src bucket item count to get to: 200000 curr count: 43577
2022/04/04 14:22:15 Waiting for src bucket item count to get to: 200000 curr count: 60458
2022/04/04 14:22:20 Waiting for src bucket item count to get to: 200000 curr count: 60458
2022/04/04 14:22:25 Waiting for src bucket item count to get to: 200000 curr count: 60458
2022/04/04 14:22:30 Waiting for src bucket item count to get to: 200000 curr count: 77099
2022/04/04 14:22:35 Waiting for src bucket item count to get to: 200000 curr count: 77099
2022/04/04 14:22:40 Waiting for src bucket item count to get to: 200000 curr count: 93860
2022/04/04 14:22:45 Waiting for src bucket item count to get to: 200000 curr count: 93860
2022/04/04 14:22:50 Waiting for src bucket item count to get to: 200000 curr count: 110778
2022/04/04 14:22:55 Waiting for src bucket item count to get to: 200000 curr count: 110778
2022/04/04 14:23:00 Waiting for src bucket item count to get to: 200000 curr count: 127822
2022/04/04 14:23:05 Waiting for src bucket item count to get to: 200000 curr count: 127822
2022/04/04 14:23:10 Waiting for src bucket item count to get to: 200000 curr count: 144787
2022/04/04 14:23:15 Waiting for src bucket item count to get to: 200000 curr count: 144787
2022/04/04 14:23:20 Waiting for src bucket item count to get to: 200000 curr count: 161707
2022/04/04 14:23:25 Waiting for src bucket item count to get to: 200000 curr count: 161707
2022/04/04 14:23:30 Waiting for src bucket item count to get to: 200000 curr count: 178373
2022/04/04 14:23:35 Waiting for src bucket item count to get to: 200000 curr count: 178373
2022/04/04 14:23:40 Waiting for src bucket item count to get to: 200000 curr count: 194867
2022/04/04 14:23:46 Waiting for src bucket item count to get to: 200000 curr count: 194867
2022/04/04 14:23:51 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 14:23:51 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 14:23:56 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/04/04 14:24:01 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/04/04 14:24:06 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/04/04 14:24:11 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/04/04 14:24:11 App: TestDuplicateWithKVRebOut got un-deployed
2022/04/04 14:24:11 No eventing-con process running
2022/04/04 14:24:11 Function: TestDuplicateWithKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut deleting in background"
}
2022/04/04 14:24:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:24:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:24:23 Waiting for dst bucket item count to get to: 0 curr count: 58955
2022/04/04 14:24:28 Waiting for dst bucket item count to get to: 0 curr count: 58955
2022/04/04 14:24:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:24:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:24:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:24:39 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/04/04 14:24:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebOut (239.27s)
=== RUN   TestDuplicateWithKVSwapReb
2022/04/04 14:24:49 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/04/04 14:24:49 App: TestDuplicateWithKVSwapReb got un-deployed
2022/04/04 14:24:49 No eventing-con process running
2022/04/04 14:24:49 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVSwapReb not found"
}
2022/04/04 14:24:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:24:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:24:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:24:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:25:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:25:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:25:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:25:08 Deploying app: TestDuplicateWithKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:25:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb stored in temp store"
}
2022/04/04 14:25:14 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/04/04 14:25:19 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/04/04 14:25:24 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/04/04 14:25:29 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/04/04 14:25:29 App: TestDuplicateWithKVSwapReb got deployed
2022/04/04 14:25:29 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 14:25:29 Starting bucket ops to source bucket
2022/04/04 14:25:30 Removing node(s): [] from the cluster
2022/04/04 14:25:35 Rebalance progress: 16.66666666666667
2022/04/04 14:25:40 Rebalance progress: 16.66666666666667
2022/04/04 14:25:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:25:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:25:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:25:45 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:25:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 14:25:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:25:50 Rebalance progress: 16.66666666666667
2022/04/04 14:25:55 Rebalance progress: 16.66666666666667
2022/04/04 14:26:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:26:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:26:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:26:00 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:26:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 14:26:05 Rebalance progress: 16.66666666666667
2022/04/04 14:26:10 Rebalance progress: 16.66666666666667
2022/04/04 14:26:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:26:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:26:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:26:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:26:16 Waiting for src bucket item count to get to: 200000 curr count: 68245
2022/04/04 14:26:21 Waiting for src bucket item count to get to: 200000 curr count: 68245
2022/04/04 14:26:26 Waiting for src bucket item count to get to: 200000 curr count: 83963
2022/04/04 14:26:31 Waiting for src bucket item count to get to: 200000 curr count: 83963
2022/04/04 14:26:36 Waiting for src bucket item count to get to: 200000 curr count: 100542
2022/04/04 14:26:41 Waiting for src bucket item count to get to: 200000 curr count: 100542
2022/04/04 14:26:46 Waiting for src bucket item count to get to: 200000 curr count: 117398
2022/04/04 14:26:51 Waiting for src bucket item count to get to: 200000 curr count: 117398
2022/04/04 14:26:56 Waiting for src bucket item count to get to: 200000 curr count: 134241
2022/04/04 14:27:01 Waiting for src bucket item count to get to: 200000 curr count: 134241
2022/04/04 14:27:06 Waiting for src bucket item count to get to: 200000 curr count: 150996
2022/04/04 14:27:11 Waiting for src bucket item count to get to: 200000 curr count: 150996
2022/04/04 14:27:16 Waiting for src bucket item count to get to: 200000 curr count: 167757
2022/04/04 14:27:21 Waiting for src bucket item count to get to: 200000 curr count: 167757
2022/04/04 14:27:26 Waiting for src bucket item count to get to: 200000 curr count: 183732
2022/04/04 14:27:31 Waiting for src bucket item count to get to: 200000 curr count: 183732
2022/04/04 14:27:36 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 14:27:36 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 14:27:41 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/04/04 14:27:46 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/04/04 14:27:51 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/04/04 14:27:51 App: TestDuplicateWithKVSwapReb got un-deployed
2022/04/04 14:27:51 No eventing-con process running
2022/04/04 14:27:51 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb deleting in background"
}
2022/04/04 14:27:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:27:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:28:03 Waiting for dst bucket item count to get to: 0 curr count: 83422
2022/04/04 14:28:08 Waiting for dst bucket item count to get to: 0 curr count: 83422
2022/04/04 14:28:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:28:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:28:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:28:19 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/04/04 14:28:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVSwapReb (220.07s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpOneByOne
2022/04/04 14:28:29 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:28:29 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/04/04 14:28:30 No eventing-con process running
2022/04/04 14:28:30 Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/04/04 14:28:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:28:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:28:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:28:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:28:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:28:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:28:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:28:48 Deploying app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:28:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/04/04 14:28:54 Starting bucket ops to source bucket
2022/04/04 14:28:59 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/04/04 14:29:04 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/04/04 14:29:09 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/04/04 14:29:09 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:29:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:29:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:29:09 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:29:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:29:10 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:29:15 Rebalance progress: 16.66666666666667
2022/04/04 14:29:20 Rebalance progress: 16.66666666666667
2022/04/04 14:29:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:29:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:29:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:29:25 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:29:25 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:29:25 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:29:30 Rebalance progress: 16.66666666666667
2022/04/04 14:29:35 Rebalance progress: 16.66666666666667
2022/04/04 14:29:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:29:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:29:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:29:40 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/04/04 14:29:40 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/04/04 14:29:45 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:29:50 Rebalance progress: 12.5
2022/04/04 14:29:55 Rebalance progress: 12.5
2022/04/04 14:30:00 Rebalance progress: 12.5
2022/04/04 14:30:05 Rebalance progress: 70.83333333333334
2022/04/04 14:30:10 Rebalance progress: 70.83333333333334
2022/04/04 14:30:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:30:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:30:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:30:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:30:20 Rebalance progress: 12.5
2022/04/04 14:30:25 Rebalance progress: 12.5
2022/04/04 14:30:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:30:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:30:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:30:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 14:30:35 Rebalance progress: 12.5
2022/04/04 14:30:40 Rebalance progress: 12.5
2022/04/04 14:30:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:30:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:30:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:30:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/04/04 14:30:50 Rebalance progress: 12.5
2022/04/04 14:30:55 Rebalance progress: 12.5
2022/04/04 14:31:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:31:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:31:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:31:06 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:31:11 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:31:16 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:31:21 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:31:21 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/04/04 14:31:21 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:31:21 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/04/04 14:31:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:31:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:31:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4616
2022/04/04 14:31:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4616
2022/04/04 14:31:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:31:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:31:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:31:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12623
2022/04/04 14:31:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpOneByOne (209.97s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce
2022/04/04 14:31:59 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/04/04 14:31:59 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2022/04/04 14:31:59 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:31:59 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce not found"
}
2022/04/04 14:32:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:32:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:32:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:32:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:32:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:32:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:32:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:32:18 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:32:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce stored in temp store"
}
2022/04/04 14:32:24 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 14:32:29 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/04/04 14:32:34 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/04/04 14:32:39 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/04/04 14:32:39 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:32:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:32:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:32:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:32:40 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:32:40 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/04/04 14:32:41 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:32:46 Rebalance progress: 12.5
2022/04/04 14:32:51 Rebalance progress: 12.5
2022/04/04 14:32:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:32:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:32:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:32:56 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/04/04 14:33:01 Rebalance progress: 12.5
2022/04/04 14:33:06 Rebalance progress: 12.5
2022/04/04 14:33:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:33:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:33:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:33:16 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/04/04 14:33:21 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/04/04 14:33:26 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/04/04 14:33:31 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/04/04 14:33:31 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2022/04/04 14:33:31 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:33:31 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce deleting in background"
}
2022/04/04 14:33:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:33:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:33:43 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2928
2022/04/04 14:33:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2928
2022/04/04 14:33:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:33:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:33:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:34:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4650
2022/04/04 14:34:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce (130.29s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings
2022/04/04 14:34:10 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/04/04 14:34:10 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/04/04 14:34:10 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:34:10 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings not found"
}
2022/04/04 14:34:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:34:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:34:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:34:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:34:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:34:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:34:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:34:28 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:34:29 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2022/04/04 14:34:34 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 14:34:39 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/04/04 14:34:44 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/04/04 14:34:49 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/04/04 14:34:49 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:34:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:34:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:34:50 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:34:50 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:34:55 Rebalance progress: 12.5
2022/04/04 14:35:00 Rebalance progress: 12.5
2022/04/04 14:35:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:35:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:35:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:35:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:35:06 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:35:11 Rebalance progress: 12.5
2022/04/04 14:35:16 Rebalance progress: 12.5
2022/04/04 14:35:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:35:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:35:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:35:21 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/04/04 14:35:21 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:35:26 Rebalance progress: 12.5
2022/04/04 14:35:31 Rebalance progress: 12.5
2022/04/04 14:35:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:35:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:35:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:35:36 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:35:41 Rebalance progress: 12.5
2022/04/04 14:35:46 Rebalance progress: 12.5
2022/04/04 14:35:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:35:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:35:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:35:51 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 14:35:56 Rebalance progress: 12.5
2022/04/04 14:36:01 Rebalance progress: 12.5
2022/04/04 14:36:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:36:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:36:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:36:06 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/04/04 14:36:12 Rebalance progress: 12.5
2022/04/04 14:36:17 Rebalance progress: 12.5
2022/04/04 14:36:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:36:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:36:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:36:27 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/04/04 14:36:32 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/04/04 14:36:37 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/04/04 14:36:42 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/04/04 14:36:42 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/04/04 14:36:42 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:36:42 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2022/04/04 14:36:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:36:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:36:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10702
2022/04/04 14:36:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10702
2022/04/04 14:36:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:37:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:37:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:37:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10700
2022/04/04 14:37:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings (190.75s)
=== RUN   TestEventingSwapRebOnUpdateBucketOp
2022/04/04 14:37:20 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/04/04 14:37:21 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2022/04/04 14:37:21 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:37:21 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebOnUpdateBucketOp not found"
}
2022/04/04 14:37:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:37:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:37:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:37:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:37:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:37:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:37:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:37:34 eventingSetup.go:125: Deploying app: TestEventingSwapRebOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:37:35 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp stored in temp store"
}
2022/04/04 14:37:40 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 14:37:45 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/04/04 14:37:50 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/04/04 14:37:55 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/04/04 14:37:55 clusterSetup.go:354: App: TestEventingSwapRebOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:37:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:37:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:37:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:37:55 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:38:00 Rebalance progress: 12.5
2022/04/04 14:38:05 Rebalance progress: 12.5
2022/04/04 14:38:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:38:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:38:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:38:10 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:38:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:38:16 Rebalance progress: 12.5
2022/04/04 14:38:21 Rebalance progress: 12.5
2022/04/04 14:38:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:38:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:38:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:38:26 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 14:38:31 Rebalance progress: 12.5
2022/04/04 14:38:36 Rebalance progress: 12.5
2022/04/04 14:38:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:38:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:38:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:38:46 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/04/04 14:38:52 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/04/04 14:38:57 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/04/04 14:39:02 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/04/04 14:39:02 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2022/04/04 14:39:02 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:39:02 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp deleting in background"
}
2022/04/04 14:39:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:39:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:39:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6110
2022/04/04 14:39:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6110
2022/04/04 14:39:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:39:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:39:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:39:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6110
2022/04/04 14:39:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebOnUpdateBucketOp (139.79s)
=== RUN   TestMetaRollbackWithEventingReb
2022/04/04 14:39:35 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:39:35 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:39:41 Rebalance progress: 100
2022/04/04 14:39:46 Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/04/04 14:39:46 App: TestMetaRollbackWithEventingReb got un-deployed
2022/04/04 14:39:46 No eventing-con process running
2022/04/04 14:39:46 Function: TestMetaRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaRollbackWithEventingReb not found"
}
2022/04/04 14:39:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:39:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:39:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:39:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:39:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:39:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:39:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:39:59 Deploying app: TestMetaRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:40:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb stored in temp store"
}
2022/04/04 14:40:05 Starting bucket ops to source bucket
2022/04/04 14:40:10 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/04/04 14:40:15 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/04/04 14:40:20 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/04/04 14:40:21 App: TestMetaRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:40:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:40:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:40:21 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:40:21 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:40:26 Rebalance progress: 12.5
2022/04/04 14:40:31 Rebalance progress: 12.5
2022/04/04 14:40:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:40:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:40:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:40:36 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/04/04 14:40:36 bucketOps.go:134: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/04/04 14:40:41 Rebalance progress: 12.5
2022/04/04 14:40:46 Rebalance progress: 12.5
2022/04/04 14:40:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:40:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:40:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:40:56 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/04/04 14:41:01 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/04/04 14:41:06 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/04/04 14:41:11 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/04/04 14:41:11 clusterSetup.go:405: App: TestMetaRollbackWithEventingReb got un-deployed
2022/04/04 14:41:11 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:41:11 eventingSetup.go:418: Function: TestMetaRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb deleting in background"
}
2022/04/04 14:41:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:41:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:41:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4095
2022/04/04 14:41:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4095
2022/04/04 14:41:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:41:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:41:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:41:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4559
2022/04/04 14:41:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaRollbackWithEventingReb (129.76s)
=== RUN   TestMetaPartialRollbackWithEventingReb
2022/04/04 14:41:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:41:45 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:41:51 Rebalance progress: 100
2022/04/04 14:41:56 Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/04/04 14:41:56 App: TestMetaPartialRollbackWithEventingReb got un-deployed
2022/04/04 14:41:56 No eventing-con process running
2022/04/04 14:41:56 Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaPartialRollbackWithEventingReb not found"
}
2022/04/04 14:41:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:42:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:42:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:42:04 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:42:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:42:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:42:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:42:09 Deploying app: TestMetaPartialRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:42:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb stored in temp store"
}
2022/04/04 14:42:15 Starting bucket ops to source bucket
2022/04/04 14:42:20 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/04/04 14:42:25 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/04/04 14:42:30 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/04/04 14:42:30 App: TestMetaPartialRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:42:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:42:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:42:30 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:42:31 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:42:36 Rebalance progress: 12.5
2022/04/04 14:42:41 Rebalance progress: 12.5
2022/04/04 14:42:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:42:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:42:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:42:46 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/04/04 14:42:46 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/04/04 14:42:51 Rebalance progress: 12.5
2022/04/04 14:42:56 Rebalance progress: 12.5
2022/04/04 14:43:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:43:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:43:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:43:01 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/04/04 14:43:06 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/04/04 14:43:11 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/04/04 14:43:16 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/04/04 14:43:21 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/04/04 14:43:21 clusterSetup.go:405: App: TestMetaPartialRollbackWithEventingReb got un-deployed
2022/04/04 14:43:21 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:43:21 eventingSetup.go:418: Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb deleting in background"
}
2022/04/04 14:43:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:43:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:43:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 32680
2022/04/04 14:43:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 32680
2022/04/04 14:43:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:43:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:43:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:43:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 38179
2022/04/04 14:43:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaPartialRollbackWithEventingReb (129.93s)
=== RUN   TestEventingRebMultipleHandlersOneByOne
2022/04/04 14:44:00 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/04/04 14:44:00 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2022/04/04 14:44:00 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:44:00 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op not found"
}
2022/04/04 14:44:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:44:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:44:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:44:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:44:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:44:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:44:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:44:19 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:44:20 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:44:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:44:20 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:44:21 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update stored in temp store"
}
2022/04/04 14:44:26 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 14:44:31 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/04/04 14:44:36 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/04/04 14:44:41 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/04/04 14:44:41 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got deployed
2022/04/04 14:44:46 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/04/04 14:44:51 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/04/04 14:44:56 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/04/04 14:44:56 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:44:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:44:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:44:56 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:44:56 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:45:01 Rebalance progress: 12.5
2022/04/04 14:45:06 Rebalance progress: 12.5
2022/04/04 14:45:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:45:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:45:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:45:12 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:45:12 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:45:17 Rebalance progress: 12.5
2022/04/04 14:45:22 Rebalance progress: 12.5
2022/04/04 14:45:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:45:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:45:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:45:27 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/04/04 14:45:27 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:45:32 Rebalance progress: 12.5
2022/04/04 14:45:37 Rebalance progress: 12.5
2022/04/04 14:45:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:45:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:45:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:45:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:45:48 Rebalance progress: 12.5
2022/04/04 14:45:53 Rebalance progress: 12.5
2022/04/04 14:45:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:45:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:45:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:45:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 14:46:03 Rebalance progress: 12.5
2022/04/04 14:46:08 Rebalance progress: 12.5
2022/04/04 14:46:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:46:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:46:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:46:13 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/04/04 14:46:18 Rebalance progress: 12.5
2022/04/04 14:46:23 Rebalance progress: 12.5
2022/04/04 14:46:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:46:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:46:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:46:33 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/04/04 14:46:38 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/04/04 14:46:43 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/04/04 14:46:48 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/04/04 14:46:48 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2022/04/04 14:46:48 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:46:48 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op deleting in background"
}
2022/04/04 14:46:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:46:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:47:01 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12183
2022/04/04 14:47:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:47:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:47:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:47:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9455
2022/04/04 14:47:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9455
2022/04/04 14:47:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:47:23 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/04/04 14:47:28 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/04/04 14:47:33 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/04/04 14:47:38 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/04/04 14:47:38 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got un-deployed
2022/04/04 14:47:38 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:47:39 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update deleting in background"
}
2022/04/04 14:47:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:47:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:47:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:47:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:47:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:47:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersOneByOne (242.17s)
=== RUN   TestEventingRebMultipleHandlersAllAtOnce
2022/04/04 14:48:02 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/04/04 14:48:02 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2022/04/04 14:48:02 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:48:02 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op not found"
}
2022/04/04 14:48:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:48:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:48:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:48:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:48:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:48:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:48:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:48:21 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:48:22 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:48:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:48:22 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:48:23 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update stored in temp store"
}
2022/04/04 14:48:28 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 14:48:33 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/04/04 14:48:38 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/04/04 14:48:43 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/04/04 14:48:43 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got deployed
2022/04/04 14:48:48 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/04/04 14:48:53 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/04/04 14:48:58 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/04/04 14:48:58 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:48:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:48:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:48:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:48:59 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:48:59 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/04/04 14:48:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:49:05 Rebalance progress: 12.5
2022/04/04 14:49:10 Rebalance progress: 12.5
2022/04/04 14:49:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:49:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:49:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:49:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/04/04 14:49:20 Rebalance progress: 12.5
2022/04/04 14:49:25 Rebalance progress: 12.5
2022/04/04 14:49:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:49:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:49:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:49:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/04/04 14:49:40 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/04/04 14:49:45 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/04/04 14:49:50 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/04/04 14:49:50 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2022/04/04 14:49:50 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:49:50 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op deleting in background"
}
2022/04/04 14:49:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:49:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:50:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1375
2022/04/04 14:50:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1375
2022/04/04 14:50:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:50:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:50:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:50:20 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6135
2022/04/04 14:50:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:50:25 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/04/04 14:50:30 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/04/04 14:50:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/04/04 14:50:40 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/04/04 14:50:40 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got un-deployed
2022/04/04 14:50:40 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:50:40 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update deleting in background"
}
2022/04/04 14:50:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:50:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:50:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:50:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:50:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:50:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersAllAtOnce (181.90s)
=== RUN   TestEventingSwapRebMultipleHandlers
2022/04/04 14:51:04 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/04/04 14:51:04 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2022/04/04 14:51:04 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:51:04 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update not found"
}
2022/04/04 14:51:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:51:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:51:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:51:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:51:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:51:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:51:23 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/04/04 14:51:23 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2022/04/04 14:51:23 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:51:23 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op not found"
}
2022/04/04 14:51:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:51:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:51:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:51:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:51:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:51:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:51:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:51:36 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlersbucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:51:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:51:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:51:38 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:51:39 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op stored in temp store"
}
2022/04/04 14:51:44 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 14:51:49 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/04/04 14:51:54 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/04/04 14:51:59 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/04/04 14:51:59 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got deployed
2022/04/04 14:52:04 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/04/04 14:52:09 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/04/04 14:52:14 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/04/04 14:52:14 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:52:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:52:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:52:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:52:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:52:19 Rebalance progress: 12.5
2022/04/04 14:52:24 Rebalance progress: 12.5
2022/04/04 14:52:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:52:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:52:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:52:29 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:52:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:52:35 Rebalance progress: 12.5
2022/04/04 14:52:40 Rebalance progress: 12.5
2022/04/04 14:52:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:52:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:52:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:52:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 14:52:50 Rebalance progress: 12.5
2022/04/04 14:52:55 Rebalance progress: 12.5
2022/04/04 14:53:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:53:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:53:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:53:05 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/04/04 14:53:10 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/04/04 14:53:15 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/04/04 14:53:20 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/04/04 14:53:20 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2022/04/04 14:53:20 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:53:20 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update deleting in background"
}
2022/04/04 14:53:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:53:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:53:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1990
2022/04/04 14:53:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1990
2022/04/04 14:53:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:53:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:53:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:53:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7609
2022/04/04 14:53:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:53:55 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/04/04 14:54:00 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/04/04 14:54:05 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/04/04 14:54:10 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/04/04 14:54:10 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2022/04/04 14:54:10 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:54:10 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op deleting in background"
}
2022/04/04 14:54:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:54:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:54:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:54:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:54:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:54:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebMultipleHandlers (209.88s)
=== RUN   TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne
2022/04/04 14:54:34 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:54:34 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/04/04 14:54:34 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:54:34 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/04/04 14:54:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:54:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:54:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:54:43 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:54:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:54:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:54:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:54:53 eventingSetup.go:125: Deploying app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:54:54 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/04/04 14:54:59 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 14:55:04 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/04/04 14:55:09 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/04/04 14:55:14 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/04/04 14:55:14 clusterSetup.go:354: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:55:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:55:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:55:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:55:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:55:34 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:55:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:55:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:56:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:56:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:56:05 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:56:10 Rebalance progress: 12.5
2022/04/04 14:56:15 Rebalance progress: 12.5
2022/04/04 14:56:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:56:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:56:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:56:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 14:56:21 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 14:56:26 Rebalance progress: 12.5
2022/04/04 14:56:31 Rebalance progress: 12.5
2022/04/04 14:56:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:56:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:56:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:56:36 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 14:56:41 Rebalance progress: 12.5
2022/04/04 14:56:46 Rebalance progress: 12.5
2022/04/04 14:56:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:56:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:56:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:56:56 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:57:01 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:57:06 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:57:11 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:57:11 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/04/04 14:57:11 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:57:11 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/04/04 14:57:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:57:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:57:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10404
2022/04/04 14:57:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10404
2022/04/04 14:57:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:57:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:57:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:57:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11228
2022/04/04 14:57:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne (196.12s)
=== RUN   TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne
2022/04/04 14:57:50 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 14:57:50 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/04/04 14:57:50 eventingSetup.go:46: No eventing-con process running
2022/04/04 14:57:50 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/04/04 14:57:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:57:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:57:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 14:57:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:58:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:58:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:58:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 14:58:09 eventingSetup.go:125: Deploying app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/04/04 14:58:10 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/04/04 14:58:15 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 14:58:20 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/04/04 14:58:25 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/04/04 14:58:30 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/04/04 14:58:30 clusterSetup.go:354: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:58:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:58:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:58:30 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:58:31 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:58:51 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:58:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:58:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:59:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:59:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:59:01 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:59:02 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:59:22 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:59:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:59:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:59:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:59:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 14:59:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 14:59:33 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 14:59:53 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:59:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 14:59:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:00:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:00:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:00:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 15:00:03 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 15:00:24 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:00:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:00:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:00:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:00:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:00:34 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 15:00:35 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 15:00:55 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:00:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:00:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:01:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:01:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:01:05 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 15:01:10 Rebalance progress: 12.5
2022/04/04 15:01:15 Rebalance progress: 12.5
2022/04/04 15:01:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:01:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:01:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:01:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 15:01:21 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:01:26 Rebalance progress: 12.5
2022/04/04 15:01:31 Rebalance progress: 12.5
2022/04/04 15:01:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:01:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:01:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:01:36 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 15:01:41 Rebalance progress: 12.5
2022/04/04 15:01:46 Rebalance progress: 12.5
2022/04/04 15:01:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:01:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:01:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:01:56 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 15:02:01 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 15:02:06 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 15:02:11 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/04/04 15:02:11 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/04/04 15:02:11 eventingSetup.go:46: No eventing-con process running
2022/04/04 15:02:11 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/04/04 15:02:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:02:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:02:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11219
2022/04/04 15:02:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11219
2022/04/04 15:02:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:02:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:02:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:02:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21575
2022/04/04 15:02:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne (299.64s)
=== RUN   TestEventingFailoverOnUpdateBucketOp
2022/04/04 15:02:50 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/04/04 15:02:50 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2022/04/04 15:02:50 eventingSetup.go:46: No eventing-con process running
2022/04/04 15:02:50 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingFailoverOnUpdateBucketOp not found"
}
2022/04/04 15:02:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:02:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:02:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:02:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:03:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:03:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:03:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:03:08 eventingSetup.go:125: Deploying app: TestEventingFailoverOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/04/04 15:03:10 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp stored in temp store"
}
2022/04/04 15:03:15 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 15:03:20 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/04/04 15:03:25 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/04/04 15:03:30 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/04/04 15:03:30 clusterSetup.go:354: App: TestEventingFailoverOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:03:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:03:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:03:30 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 15:03:30 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 15:03:35 Rebalance progress: 12.5
2022/04/04 15:03:40 Rebalance progress: 12.5
2022/04/04 15:03:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:03:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:03:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:03:45 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:03:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:03:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:03:55 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 15:04:01 Rebalance progress: 12.5
2022/04/04 15:04:06 Rebalance progress: 12.5
2022/04/04 15:04:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:04:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:04:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:04:11 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 15:04:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:04:16 Rebalance progress: 12.5
2022/04/04 15:04:21 Rebalance progress: 12.5
2022/04/04 15:04:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:04:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:04:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:04:26 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 15:04:31 Rebalance progress: 12.5
2022/04/04 15:04:36 Rebalance progress: 12.5
2022/04/04 15:04:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:04:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:04:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:04:46 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/04/04 15:04:51 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/04/04 15:04:56 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/04/04 15:05:01 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/04/04 15:05:01 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2022/04/04 15:05:01 eventingSetup.go:46: No eventing-con process running
2022/04/04 15:05:01 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp deleting in background"
}
2022/04/04 15:05:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:05:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:05:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6951
2022/04/04 15:05:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6951
2022/04/04 15:05:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:05:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:05:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:05:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8640
2022/04/04 15:05:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingFailoverOnUpdateBucketOp (170.22s)
=== RUN   TestEventingKVRebalanceOnUpdateBucketOp
2022/04/04 15:05:40 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/04/04 15:05:40 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2022/04/04 15:05:40 eventingSetup.go:46: No eventing-con process running
2022/04/04 15:05:40 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingKVRebalanceOnUpdateBucketOp not found"
}
2022/04/04 15:05:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:05:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:05:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:05:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:05:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:05:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:05:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:05:59 eventingSetup.go:125: Deploying app: TestEventingKVRebalanceOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/04/04 15:06:00 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp stored in temp store"
}
2022/04/04 15:06:05 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 15:06:10 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/04/04 15:06:15 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/04/04 15:06:20 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/04/04 15:06:20 clusterSetup.go:354: App: TestEventingKVRebalanceOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:06:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:06:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:06:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing,kv to the cluster
2022/04/04 15:06:20 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 15:06:25 Rebalance progress: 12.5
2022/04/04 15:06:30 Rebalance progress: 12.5
2022/04/04 15:06:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:06:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:06:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:06:35 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing,kv to the cluster
2022/04/04 15:06:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:06:40 Rebalance progress: 12.5
2022/04/04 15:06:45 Rebalance progress: 12.5
2022/04/04 15:06:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:06:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:06:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:06:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 15:06:55 Rebalance progress: 12.5
2022/04/04 15:07:00 Rebalance progress: 12.5
2022/04/04 15:07:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:07:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:07:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:07:11 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/04/04 15:07:16 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/04/04 15:07:21 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/04/04 15:07:26 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/04/04 15:07:26 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2022/04/04 15:07:26 eventingSetup.go:46: No eventing-con process running
2022/04/04 15:07:26 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp deleting in background"
}
2022/04/04 15:07:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:07:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:07:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6077
2022/04/04 15:07:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:07:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:07:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:07:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6077
2022/04/04 15:07:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingKVRebalanceOnUpdateBucketOp (139.60s)
=== RUN   TestEventingRebInWithOps
2022/04/04 15:08:00 clusterSetup.go:397: Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/04/04 15:08:00 clusterSetup.go:405: App: TestEventingRebInWithOps got un-deployed
2022/04/04 15:08:00 eventingSetup.go:46: No eventing-con process running
2022/04/04 15:08:00 eventingSetup.go:418: Function: TestEventingRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithOps not found"
}
2022/04/04 15:08:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:08:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:08:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:08:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:08:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:08:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:08:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:08:18 eventingSetup.go:125: Deploying app: TestEventingRebInWithOps. Item count src bucket: 0 dst bucket: 0
2022/04/04 15:08:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps stored in temp store"
}
2022/04/04 15:08:24 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/04/04 15:08:29 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/04/04 15:08:34 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/04/04 15:08:39 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/04/04 15:08:39 clusterSetup.go:354: App: TestEventingRebInWithOps got deployed
2022/04/04 15:08:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 15:08:39 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 15:08:40 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 15:08:45 Rebalance progress: 12.5
2022/04/04 15:08:50 Rebalance progress: 12.5
2022/04/04 15:08:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:08:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:08:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:08:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:09:00 Rebalance progress: 12.5
2022/04/04 15:09:05 Rebalance progress: 12.5
2022/04/04 15:09:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:09:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:09:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:09:10 Waiting for src bucket item count to get to: 200000 curr count: 34451
2022/04/04 15:09:15 Waiting for src bucket item count to get to: 200000 curr count: 50951
2022/04/04 15:09:20 Waiting for src bucket item count to get to: 200000 curr count: 50951
2022/04/04 15:09:25 Waiting for src bucket item count to get to: 200000 curr count: 67795
2022/04/04 15:09:30 Waiting for src bucket item count to get to: 200000 curr count: 67795
2022/04/04 15:09:35 Waiting for src bucket item count to get to: 200000 curr count: 83591
2022/04/04 15:09:40 Waiting for src bucket item count to get to: 200000 curr count: 83591
2022/04/04 15:09:45 Waiting for src bucket item count to get to: 200000 curr count: 99869
2022/04/04 15:09:50 Waiting for src bucket item count to get to: 200000 curr count: 99869
2022/04/04 15:09:55 Waiting for src bucket item count to get to: 200000 curr count: 116501
2022/04/04 15:10:00 Waiting for src bucket item count to get to: 200000 curr count: 116501
2022/04/04 15:10:05 Waiting for src bucket item count to get to: 200000 curr count: 132973
2022/04/04 15:10:10 Waiting for src bucket item count to get to: 200000 curr count: 132973
2022/04/04 15:10:15 Waiting for src bucket item count to get to: 200000 curr count: 149779
2022/04/04 15:10:20 Waiting for src bucket item count to get to: 200000 curr count: 149779
2022/04/04 15:10:25 Waiting for src bucket item count to get to: 200000 curr count: 149779
2022/04/04 15:10:30 Waiting for src bucket item count to get to: 200000 curr count: 166621
2022/04/04 15:10:35 Waiting for src bucket item count to get to: 200000 curr count: 166621
2022/04/04 15:10:40 Waiting for src bucket item count to get to: 200000 curr count: 182299
2022/04/04 15:10:45 Waiting for src bucket item count to get to: 200000 curr count: 182299
2022/04/04 15:10:50 Waiting for src bucket item count to get to: 200000 curr count: 198849
2022/04/04 15:10:55 Waiting for src bucket item count to get to: 200000 curr count: 198849
2022/04/04 15:11:00 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 15:11:00 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 15:11:00 Starting bucket ops to source bucket
2022/04/04 15:14:48 Waiting for dst bucket item count to get to: 0 curr count: 21117
2022/04/04 15:14:53 Waiting for dst bucket item count to get to: 0 curr count: 2790
2022/04/04 15:14:58 Waiting for dst bucket item count to get to: 0 curr count: 2790
2022/04/04 15:14:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:14:58 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 15:15:03 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/04/04 15:15:08 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/04/04 15:15:13 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/04/04 15:15:18 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/04/04 15:15:18 App: TestEventingRebInWithOps got un-deployed
2022/04/04 15:15:18 No eventing-con process running
2022/04/04 15:15:18 Function: TestEventingRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps deleting in background"
}
2022/04/04 15:15:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:15:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:15:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:15:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:15:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:15:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithOps (462.63s)
=== RUN   TestEventingRebOutWithOps
2022/04/04 15:15:37 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 15:15:38 Removing node(s): [] from the cluster
2022/04/04 15:15:43 Rebalance progress: 100
2022/04/04 15:15:48 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/04/04 15:15:48 App: TestEventingRebOutWithOps got un-deployed
2022/04/04 15:15:48 No eventing-con process running
2022/04/04 15:15:48 Function: TestEventingRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithOps not found"
}
2022/04/04 15:15:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:15:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:15:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:15:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:16:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:16:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:16:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:16:06 Deploying app: TestEventingRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2022/04/04 15:16:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps stored in temp store"
}
2022/04/04 15:16:12 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/04/04 15:16:18 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/04/04 15:16:23 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/04/04 15:16:28 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/04/04 15:16:28 App: TestEventingRebOutWithOps got deployed
2022/04/04 15:16:28 Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:16:28 Starting bucket ops to source bucket
2022/04/04 15:16:33 Rebalance progress: 12.5
2022/04/04 15:16:38 Rebalance progress: 12.5
2022/04/04 15:16:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:16:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:16:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:16:43 Waiting for src bucket item count to get to: 200000 curr count: 22626
2022/04/04 15:16:48 Waiting for src bucket item count to get to: 200000 curr count: 22626
2022/04/04 15:16:53 Waiting for src bucket item count to get to: 200000 curr count: 39032
2022/04/04 15:16:58 Waiting for src bucket item count to get to: 200000 curr count: 39032
2022/04/04 15:17:03 Waiting for src bucket item count to get to: 200000 curr count: 55797
2022/04/04 15:17:08 Waiting for src bucket item count to get to: 200000 curr count: 55797
2022/04/04 15:17:13 Waiting for src bucket item count to get to: 200000 curr count: 72580
2022/04/04 15:17:18 Waiting for src bucket item count to get to: 200000 curr count: 72580
2022/04/04 15:17:23 Waiting for src bucket item count to get to: 200000 curr count: 72580
2022/04/04 15:17:28 Waiting for src bucket item count to get to: 200000 curr count: 88153
2022/04/04 15:17:33 Waiting for src bucket item count to get to: 200000 curr count: 88153
2022/04/04 15:17:38 Waiting for src bucket item count to get to: 200000 curr count: 104580
2022/04/04 15:17:43 Waiting for src bucket item count to get to: 200000 curr count: 104580
2022/04/04 15:17:48 Waiting for src bucket item count to get to: 200000 curr count: 121146
2022/04/04 15:17:53 Waiting for src bucket item count to get to: 200000 curr count: 121146
2022/04/04 15:17:58 Waiting for src bucket item count to get to: 200000 curr count: 138016
2022/04/04 15:18:03 Waiting for src bucket item count to get to: 200000 curr count: 138016
2022/04/04 15:18:08 Waiting for src bucket item count to get to: 200000 curr count: 154660
2022/04/04 15:18:13 Waiting for src bucket item count to get to: 200000 curr count: 154660
2022/04/04 15:18:18 Waiting for src bucket item count to get to: 200000 curr count: 171443
2022/04/04 15:18:23 Waiting for src bucket item count to get to: 200000 curr count: 171443
2022/04/04 15:18:28 Waiting for src bucket item count to get to: 200000 curr count: 187080
2022/04/04 15:18:33 Waiting for src bucket item count to get to: 200000 curr count: 187080
2022/04/04 15:18:38 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 15:18:38 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 15:18:38 Starting bucket ops to source bucket
2022/04/04 15:22:25 Waiting for dst bucket item count to get to: 0 curr count: 15540
2022/04/04 15:22:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:22:25 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 15:22:31 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/04/04 15:22:36 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/04/04 15:22:41 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/04/04 15:22:46 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/04/04 15:22:46 App: TestEventingRebOutWithOps got un-deployed
2022/04/04 15:22:46 No eventing-con process running
2022/04/04 15:22:46 Function: TestEventingRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps deleting in background"
}
2022/04/04 15:22:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:22:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:22:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:22:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:22:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:22:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithOps (447.10s)
=== RUN   TestEventingSwapRebWithOps
2022/04/04 15:23:09 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/04/04 15:23:09 App: TestEventingSwapRebWithOps got un-deployed
2022/04/04 15:23:09 No eventing-con process running
2022/04/04 15:23:09 Function: TestEventingSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithOps not found"
}
2022/04/04 15:23:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:23:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:23:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:23:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:23:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:23:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:23:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:23:28 Deploying app: TestEventingSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2022/04/04 15:23:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps stored in temp store"
}
2022/04/04 15:23:34 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/04/04 15:23:39 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/04/04 15:23:44 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/04/04 15:23:49 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/04/04 15:23:49 App: TestEventingSwapRebWithOps got deployed
2022/04/04 15:23:49 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 15:23:49 Starting bucket ops to source bucket
2022/04/04 15:23:49 Removing node(s): [] from the cluster
2022/04/04 15:23:54 Rebalance progress: 12.5
2022/04/04 15:23:59 Rebalance progress: 12.5
2022/04/04 15:24:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:24:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:24:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:24:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 15:24:05 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:24:10 Rebalance progress: 12.5
2022/04/04 15:24:15 Rebalance progress: 12.5
2022/04/04 15:24:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:24:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:24:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:24:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 15:24:25 Rebalance progress: 12.5
2022/04/04 15:24:30 Rebalance progress: 12.5
2022/04/04 15:24:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:24:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:24:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:24:35 Waiting for src bucket item count to get to: 200000 curr count: 67449
2022/04/04 15:24:40 Waiting for src bucket item count to get to: 200000 curr count: 67449
2022/04/04 15:24:45 Waiting for src bucket item count to get to: 200000 curr count: 82604
2022/04/04 15:24:50 Waiting for src bucket item count to get to: 200000 curr count: 82604
2022/04/04 15:24:55 Waiting for src bucket item count to get to: 200000 curr count: 98911
2022/04/04 15:25:00 Waiting for src bucket item count to get to: 200000 curr count: 98911
2022/04/04 15:25:05 Waiting for src bucket item count to get to: 200000 curr count: 115651
2022/04/04 15:25:10 Waiting for src bucket item count to get to: 200000 curr count: 115651
2022/04/04 15:25:15 Waiting for src bucket item count to get to: 200000 curr count: 132423
2022/04/04 15:25:20 Waiting for src bucket item count to get to: 200000 curr count: 132423
2022/04/04 15:25:25 Waiting for src bucket item count to get to: 200000 curr count: 149301
2022/04/04 15:25:30 Waiting for src bucket item count to get to: 200000 curr count: 149301
2022/04/04 15:25:35 Waiting for src bucket item count to get to: 200000 curr count: 166028
2022/04/04 15:25:40 Waiting for src bucket item count to get to: 200000 curr count: 166028
2022/04/04 15:25:45 Waiting for src bucket item count to get to: 200000 curr count: 166028
2022/04/04 15:25:50 Waiting for src bucket item count to get to: 200000 curr count: 181674
2022/04/04 15:25:55 Waiting for src bucket item count to get to: 200000 curr count: 181674
2022/04/04 15:26:00 Waiting for src bucket item count to get to: 200000 curr count: 198198
2022/04/04 15:26:05 Waiting for src bucket item count to get to: 200000 curr count: 198198
2022/04/04 15:26:10 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 15:26:10 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 15:26:10 Starting bucket ops to source bucket
2022/04/04 15:29:59 Waiting for dst bucket item count to get to: 0 curr count: 21774
2022/04/04 15:30:04 Waiting for dst bucket item count to get to: 0 curr count: 3577
2022/04/04 15:30:09 Waiting for dst bucket item count to get to: 0 curr count: 3577
2022/04/04 15:30:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:30:09 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 15:30:14 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/04/04 15:30:19 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/04/04 15:30:24 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/04/04 15:30:29 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/04/04 15:30:29 App: TestEventingSwapRebWithOps got un-deployed
2022/04/04 15:30:29 No eventing-con process running
2022/04/04 15:30:29 Function: TestEventingSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps deleting in background"
}
2022/04/04 15:30:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:30:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:30:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:30:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:30:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:30:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithOps (463.30s)
=== RUN   TestKVRebInWithOps
2022/04/04 15:30:53 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/04/04 15:30:53 App: TestKVRebInWithOps got un-deployed
2022/04/04 15:30:53 No eventing-con process running
2022/04/04 15:30:53 Function: TestKVRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithOps not found"
}
2022/04/04 15:30:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:30:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:30:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:31:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:31:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:31:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:31:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:31:11 Deploying app: TestKVRebInWithOps. Item count src bucket: 0 dst bucket: 0
2022/04/04 15:31:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps stored in temp store"
}
2022/04/04 15:31:17 Waiting for app: TestKVRebInWithOps to get deployed
2022/04/04 15:31:22 Waiting for app: TestKVRebInWithOps to get deployed
2022/04/04 15:31:27 Waiting for app: TestKVRebInWithOps to get deployed
2022/04/04 15:31:32 Waiting for app: TestKVRebInWithOps to get deployed
2022/04/04 15:31:32 App: TestKVRebInWithOps got deployed
2022/04/04 15:31:32 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 15:31:32 Starting bucket ops to source bucket
2022/04/04 15:31:33 Removing node(s): [] from the cluster
2022/04/04 15:31:38 Rebalance progress: 12.5
2022/04/04 15:31:43 Rebalance progress: 12.5
2022/04/04 15:31:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:31:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:31:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:31:48 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:31:53 Rebalance progress: 12.5
2022/04/04 15:31:58 Rebalance progress: 12.5
2022/04/04 15:32:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:32:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:32:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:32:03 Waiting for src bucket item count to get to: 200000 curr count: 46526
2022/04/04 15:32:08 Waiting for src bucket item count to get to: 200000 curr count: 46526
2022/04/04 15:32:13 Waiting for src bucket item count to get to: 200000 curr count: 62851
2022/04/04 15:32:18 Waiting for src bucket item count to get to: 200000 curr count: 62851
2022/04/04 15:32:23 Waiting for src bucket item count to get to: 200000 curr count: 78047
2022/04/04 15:32:28 Waiting for src bucket item count to get to: 200000 curr count: 78047
2022/04/04 15:32:33 Waiting for src bucket item count to get to: 200000 curr count: 94303
2022/04/04 15:32:38 Waiting for src bucket item count to get to: 200000 curr count: 94303
2022/04/04 15:32:43 Waiting for src bucket item count to get to: 200000 curr count: 111191
2022/04/04 15:32:48 Waiting for src bucket item count to get to: 200000 curr count: 111191
2022/04/04 15:32:53 Waiting for src bucket item count to get to: 200000 curr count: 128036
2022/04/04 15:32:58 Waiting for src bucket item count to get to: 200000 curr count: 128036
2022/04/04 15:33:03 Waiting for src bucket item count to get to: 200000 curr count: 144563
2022/04/04 15:33:08 Waiting for src bucket item count to get to: 200000 curr count: 144563
2022/04/04 15:33:13 Waiting for src bucket item count to get to: 200000 curr count: 161260
2022/04/04 15:33:18 Waiting for src bucket item count to get to: 200000 curr count: 161260
2022/04/04 15:33:23 Waiting for src bucket item count to get to: 200000 curr count: 161260
2022/04/04 15:33:28 Waiting for src bucket item count to get to: 200000 curr count: 177089
2022/04/04 15:33:33 Waiting for src bucket item count to get to: 200000 curr count: 177089
2022/04/04 15:33:38 Waiting for src bucket item count to get to: 200000 curr count: 193387
2022/04/04 15:33:43 Waiting for src bucket item count to get to: 200000 curr count: 193387
2022/04/04 15:33:48 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 15:33:48 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 15:33:48 Starting bucket ops to source bucket
2022/04/04 15:37:37 Waiting for dst bucket item count to get to: 0 curr count: 18647
2022/04/04 15:37:42 Waiting for dst bucket item count to get to: 0 curr count: 432
2022/04/04 15:37:47 Waiting for dst bucket item count to get to: 0 curr count: 432
2022/04/04 15:37:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:37:47 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 15:37:52 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/04/04 15:37:57 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/04/04 15:38:02 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/04/04 15:38:07 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/04/04 15:38:07 App: TestKVRebInWithOps got un-deployed
2022/04/04 15:38:07 No eventing-con process running
2022/04/04 15:38:07 Function: TestKVRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps deleting in background"
}
2022/04/04 15:38:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:38:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:38:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:38:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:38:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:38:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithOps (458.26s)
=== RUN   TestKVRebOutWithOps
2022/04/04 15:38:26 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 15:38:26 Removing node(s): [] from the cluster
2022/04/04 15:38:31 Rebalance progress: 100
2022/04/04 15:38:36 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/04/04 15:38:36 App: TestKVRebOutWithOps got un-deployed
2022/04/04 15:38:36 No eventing-con process running
2022/04/04 15:38:36 Function: TestKVRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithOps not found"
}
2022/04/04 15:38:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:38:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:38:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:38:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:38:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:38:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:38:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:38:55 Deploying app: TestKVRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2022/04/04 15:38:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps stored in temp store"
}
2022/04/04 15:39:01 Waiting for app: TestKVRebOutWithOps to get deployed
2022/04/04 15:39:06 Waiting for app: TestKVRebOutWithOps to get deployed
2022/04/04 15:39:11 Waiting for app: TestKVRebOutWithOps to get deployed
2022/04/04 15:39:16 Waiting for app: TestKVRebOutWithOps to get deployed
2022/04/04 15:39:16 App: TestKVRebOutWithOps got deployed
2022/04/04 15:39:16 Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:39:16 Starting bucket ops to source bucket
2022/04/04 15:39:21 Rebalance progress: 12.5
2022/04/04 15:39:26 Rebalance progress: 12.5
2022/04/04 15:39:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:39:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:39:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:39:31 Waiting for src bucket item count to get to: 200000 curr count: 8005
2022/04/04 15:39:36 Waiting for src bucket item count to get to: 200000 curr count: 24140
2022/04/04 15:39:41 Waiting for src bucket item count to get to: 200000 curr count: 24140
2022/04/04 15:39:46 Waiting for src bucket item count to get to: 200000 curr count: 40605
2022/04/04 15:39:51 Waiting for src bucket item count to get to: 200000 curr count: 40605
2022/04/04 15:39:56 Waiting for src bucket item count to get to: 200000 curr count: 57130
2022/04/04 15:40:01 Waiting for src bucket item count to get to: 200000 curr count: 57130
2022/04/04 15:40:06 Waiting for src bucket item count to get to: 200000 curr count: 57130
2022/04/04 15:40:11 Waiting for src bucket item count to get to: 200000 curr count: 73483
2022/04/04 15:40:16 Waiting for src bucket item count to get to: 200000 curr count: 73483
2022/04/04 15:40:21 Waiting for src bucket item count to get to: 200000 curr count: 89034
2022/04/04 15:40:26 Waiting for src bucket item count to get to: 200000 curr count: 89034
2022/04/04 15:40:31 Waiting for src bucket item count to get to: 200000 curr count: 105319
2022/04/04 15:40:36 Waiting for src bucket item count to get to: 200000 curr count: 105319
2022/04/04 15:40:41 Waiting for src bucket item count to get to: 200000 curr count: 121583
2022/04/04 15:40:46 Waiting for src bucket item count to get to: 200000 curr count: 138215
2022/04/04 15:40:51 Waiting for src bucket item count to get to: 200000 curr count: 138215
2022/04/04 15:40:56 Waiting for src bucket item count to get to: 200000 curr count: 154996
2022/04/04 15:41:01 Waiting for src bucket item count to get to: 200000 curr count: 154996
2022/04/04 15:41:06 Waiting for src bucket item count to get to: 200000 curr count: 171513
2022/04/04 15:41:11 Waiting for src bucket item count to get to: 200000 curr count: 171513
2022/04/04 15:41:16 Waiting for src bucket item count to get to: 200000 curr count: 187269
2022/04/04 15:41:21 Waiting for src bucket item count to get to: 200000 curr count: 187269
2022/04/04 15:41:26 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 15:41:26 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 15:41:26 Starting bucket ops to source bucket
2022/04/04 15:45:15 Waiting for dst bucket item count to get to: 0 curr count: 14329
2022/04/04 15:45:20 Waiting for dst bucket item count to get to: 0 curr count: 14329
2022/04/04 15:45:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:45:20 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 15:45:25 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/04/04 15:45:30 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/04/04 15:45:35 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/04/04 15:45:40 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/04/04 15:45:40 App: TestKVRebOutWithOps got un-deployed
2022/04/04 15:45:40 No eventing-con process running
2022/04/04 15:45:40 Function: TestKVRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps deleting in background"
}
2022/04/04 15:45:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:45:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:45:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:45:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:45:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:45:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithOps (452.85s)
=== RUN   TestKVSwapRebWithOps
2022/04/04 15:46:04 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/04/04 15:46:04 App: TestKVSwapRebWithOps got un-deployed
2022/04/04 15:46:04 No eventing-con process running
2022/04/04 15:46:04 Function: TestKVSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithOps not found"
}
2022/04/04 15:46:05 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:46:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:46:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:46:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:46:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:46:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:46:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:46:22 Deploying app: TestKVSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2022/04/04 15:46:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps stored in temp store"
}
2022/04/04 15:46:28 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/04/04 15:46:33 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/04/04 15:46:38 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/04/04 15:46:43 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/04/04 15:46:43 App: TestKVSwapRebWithOps got deployed
2022/04/04 15:46:43 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 15:46:43 Starting bucket ops to source bucket
2022/04/04 15:46:44 Removing node(s): [] from the cluster
2022/04/04 15:46:49 Rebalance progress: 12.5
2022/04/04 15:46:54 Rebalance progress: 12.5
2022/04/04 15:46:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:46:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:46:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:47:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 15:47:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:47:05 Rebalance progress: 12.5
2022/04/04 15:47:10 Rebalance progress: 12.5
2022/04/04 15:47:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:47:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:47:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:47:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 15:47:20 Rebalance progress: 12.5
2022/04/04 15:47:25 Rebalance progress: 12.5
2022/04/04 15:47:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:47:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:47:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:47:30 Waiting for src bucket item count to get to: 200000 curr count: 59597
2022/04/04 15:47:35 Waiting for src bucket item count to get to: 200000 curr count: 74887
2022/04/04 15:47:40 Waiting for src bucket item count to get to: 200000 curr count: 74887
2022/04/04 15:47:45 Waiting for src bucket item count to get to: 200000 curr count: 91184
2022/04/04 15:47:50 Waiting for src bucket item count to get to: 200000 curr count: 91184
2022/04/04 15:47:55 Waiting for src bucket item count to get to: 200000 curr count: 107857
2022/04/04 15:48:00 Waiting for src bucket item count to get to: 200000 curr count: 107857
2022/04/04 15:48:05 Waiting for src bucket item count to get to: 200000 curr count: 124605
2022/04/04 15:48:10 Waiting for src bucket item count to get to: 200000 curr count: 124605
2022/04/04 15:48:15 Waiting for src bucket item count to get to: 200000 curr count: 141220
2022/04/04 15:48:20 Waiting for src bucket item count to get to: 200000 curr count: 141220
2022/04/04 15:48:25 Waiting for src bucket item count to get to: 200000 curr count: 157870
2022/04/04 15:48:30 Waiting for src bucket item count to get to: 200000 curr count: 157870
2022/04/04 15:48:35 Waiting for src bucket item count to get to: 200000 curr count: 173507
2022/04/04 15:48:40 Waiting for src bucket item count to get to: 200000 curr count: 173507
2022/04/04 15:48:45 Waiting for src bucket item count to get to: 200000 curr count: 189792
2022/04/04 15:48:50 Waiting for src bucket item count to get to: 200000 curr count: 189792
2022/04/04 15:48:55 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/04/04 15:48:55 Post SET ops. Expected item count: 200000 got 200000
2022/04/04 15:48:55 Starting bucket ops to source bucket
2022/04/04 15:52:43 Waiting for dst bucket item count to get to: 0 curr count: 12515
2022/04/04 15:52:48 Waiting for dst bucket item count to get to: 0 curr count: 12515
2022/04/04 15:52:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:52:48 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 15:52:54 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/04/04 15:52:59 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/04/04 15:53:04 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/04/04 15:53:09 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/04/04 15:53:09 App: TestKVSwapRebWithOps got un-deployed
2022/04/04 15:53:09 No eventing-con process running
2022/04/04 15:53:09 Function: TestKVSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps deleting in background"
}
2022/04/04 15:53:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:53:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:53:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:53:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:53:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:53:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithOps (448.78s)
=== RUN   TestEventingRebInWithTimers
2022/04/04 15:53:32 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/04/04 15:53:32 App: TestEventingRebInWithTimers got un-deployed
2022/04/04 15:53:32 No eventing-con process running
2022/04/04 15:53:32 Function: TestEventingRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithTimers not found"
}
2022/04/04 15:53:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:53:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:53:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:53:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:53:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:53:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:53:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:53:51 Deploying app: TestEventingRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2022/04/04 15:53:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers stored in temp store"
}
2022/04/04 15:53:57 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/04/04 15:54:02 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/04/04 15:54:07 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/04/04 15:54:12 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/04/04 15:54:12 App: TestEventingRebInWithTimers got deployed
2022/04/04 15:54:12 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 15:54:12 Starting bucket ops to source bucket
2022/04/04 15:54:13 Removing node(s): [] from the cluster
2022/04/04 15:54:18 Rebalance progress: 12.5
2022/04/04 15:54:23 Rebalance progress: 12.5
2022/04/04 15:54:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:54:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:54:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:54:28 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:54:33 Rebalance progress: 12.5
2022/04/04 15:54:38 Rebalance progress: 12.5
2022/04/04 15:54:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:54:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:54:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:54:43 Waiting for src bucket item count to get to: 50000 curr count: 36881
2022/04/04 15:54:48 Waiting for src bucket item count to get to: 50000 curr count: 36881
2022/04/04 15:54:53 Waiting for src bucket item count to get to: 50000 curr count: 48720
2022/04/04 15:54:58 Waiting for src bucket item count to get to: 50000 curr count: 48720
2022/04/04 15:55:08 Waiting for dst bucket item count to get to: 50000 curr count: 39302
2022/04/04 15:55:13 Waiting for dst bucket item count to get to: 50000 curr count: 39302
2022/04/04 15:55:13 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 15:55:13 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 15:55:13 Starting bucket ops to source bucket
2022/04/04 15:56:23 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 15:56:28 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 15:56:33 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 15:56:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 15:56:43 Waiting for dst bucket item count to get to: 0 curr count: 43575
2022/04/04 15:56:48 Waiting for dst bucket item count to get to: 0 curr count: 43575
2022/04/04 15:56:53 Waiting for dst bucket item count to get to: 0 curr count: 23747
2022/04/04 15:56:58 Waiting for dst bucket item count to get to: 0 curr count: 23747
2022/04/04 15:57:03 Waiting for dst bucket item count to get to: 0 curr count: 11137
2022/04/04 15:57:08 Waiting for dst bucket item count to get to: 0 curr count: 11137
2022/04/04 15:57:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:57:08 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 15:57:13 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/04/04 15:57:18 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/04/04 15:57:23 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/04/04 15:57:28 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/04/04 15:57:28 App: TestEventingRebInWithTimers got un-deployed
2022/04/04 15:57:28 No eventing-con process running
2022/04/04 15:57:28 Function: TestEventingRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers deleting in background"
}
2022/04/04 15:57:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:57:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:57:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:57:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:57:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:57:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithTimers (259.53s)
=== RUN   TestEventingRebOutWithTimers
2022/04/04 15:57:47 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 15:57:47 Removing node(s): [] from the cluster
2022/04/04 15:57:52 Rebalance progress: 100
2022/04/04 15:57:57 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/04/04 15:57:57 App: TestEventingRebOutWithTimers got un-deployed
2022/04/04 15:57:57 No eventing-con process running
2022/04/04 15:57:57 Function: TestEventingRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithTimers not found"
}
2022/04/04 15:57:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:58:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:58:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 15:58:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:58:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:58:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:58:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 15:58:16 Deploying app: TestEventingRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2022/04/04 15:58:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers stored in temp store"
}
2022/04/04 15:58:22 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/04/04 15:58:27 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/04/04 15:58:32 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/04/04 15:58:37 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/04/04 15:58:37 App: TestEventingRebOutWithTimers got deployed
2022/04/04 15:58:37 Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 15:58:37 Starting bucket ops to source bucket
2022/04/04 15:58:42 Rebalance progress: 12.5
2022/04/04 15:58:47 Rebalance progress: 12.5
2022/04/04 15:58:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:58:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 15:58:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 15:58:52 Waiting for src bucket item count to get to: 50000 curr count: 5837
2022/04/04 15:58:57 Waiting for src bucket item count to get to: 50000 curr count: 19728
2022/04/04 15:59:02 Waiting for src bucket item count to get to: 50000 curr count: 31064
2022/04/04 15:59:07 Waiting for src bucket item count to get to: 50000 curr count: 31064
2022/04/04 15:59:12 Waiting for src bucket item count to get to: 50000 curr count: 43276
2022/04/04 15:59:17 Waiting for src bucket item count to get to: 50000 curr count: 43276
2022/04/04 15:59:27 Waiting for dst bucket item count to get to: 50000 curr count: 38824
2022/04/04 15:59:32 Waiting for dst bucket item count to get to: 50000 curr count: 38824
2022/04/04 15:59:37 Waiting for dst bucket item count to get to: 50000 curr count: 38824
2022/04/04 15:59:42 Waiting for dst bucket item count to get to: 50000 curr count: 47133
2022/04/04 15:59:47 Waiting for dst bucket item count to get to: 50000 curr count: 47133
2022/04/04 15:59:47 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 15:59:47 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 15:59:47 Starting bucket ops to source bucket
2022/04/04 16:00:57 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:01:02 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:01:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:01:12 Waiting for dst bucket item count to get to: 0 curr count: 47395
2022/04/04 16:01:17 Waiting for dst bucket item count to get to: 0 curr count: 47395
2022/04/04 16:01:22 Waiting for dst bucket item count to get to: 0 curr count: 31696
2022/04/04 16:01:27 Waiting for dst bucket item count to get to: 0 curr count: 31696
2022/04/04 16:01:32 Waiting for dst bucket item count to get to: 0 curr count: 12552
2022/04/04 16:01:37 Waiting for dst bucket item count to get to: 0 curr count: 12552
2022/04/04 16:01:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:01:37 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 16:01:42 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/04/04 16:01:47 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/04/04 16:01:52 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/04/04 16:01:57 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/04/04 16:01:57 App: TestEventingRebOutWithTimers got un-deployed
2022/04/04 16:01:57 No eventing-con process running
2022/04/04 16:01:57 Function: TestEventingRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers deleting in background"
}
2022/04/04 16:01:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:02:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:02:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:02:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:02:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:02:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithTimers (268.76s)
=== RUN   TestEventingSwapRebWithTimers
2022/04/04 16:02:21 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/04/04 16:02:21 App: TestEventingSwapRebWithTimers got un-deployed
2022/04/04 16:02:21 No eventing-con process running
2022/04/04 16:02:21 Function: TestEventingSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithTimers not found"
}
2022/04/04 16:02:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:02:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:02:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:02:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:02:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:02:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:02:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:02:39 Deploying app: TestEventingSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:02:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers stored in temp store"
}
2022/04/04 16:02:46 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/04/04 16:02:51 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/04/04 16:02:56 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/04/04 16:03:01 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/04/04 16:03:01 App: TestEventingSwapRebWithTimers got deployed
2022/04/04 16:03:01 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 16:03:01 Starting bucket ops to source bucket
2022/04/04 16:03:01 Removing node(s): [] from the cluster
2022/04/04 16:03:06 Rebalance progress: 12.5
2022/04/04 16:03:11 Rebalance progress: 12.5
2022/04/04 16:03:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:03:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:03:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:03:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 16:03:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:03:22 Rebalance progress: 12.5
2022/04/04 16:03:27 Rebalance progress: 12.5
2022/04/04 16:03:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:03:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:03:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:03:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 16:03:37 Rebalance progress: 12.5
2022/04/04 16:03:42 Rebalance progress: 12.5
2022/04/04 16:03:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:03:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:03:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:03:47 Waiting for src bucket item count to get to: 50000 curr count: 48569
2022/04/04 16:03:52 Waiting for src bucket item count to get to: 50000 curr count: 48569
2022/04/04 16:04:02 Waiting for dst bucket item count to get to: 50000 curr count: 48353
2022/04/04 16:04:07 Waiting for dst bucket item count to get to: 50000 curr count: 48353
2022/04/04 16:04:07 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:04:07 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:04:07 Starting bucket ops to source bucket
2022/04/04 16:05:16 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:05:21 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:05:26 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:05:32 Waiting for dst bucket item count to get to: 0 curr count: 40867
2022/04/04 16:05:37 Waiting for dst bucket item count to get to: 0 curr count: 40867
2022/04/04 16:05:42 Waiting for dst bucket item count to get to: 0 curr count: 25290
2022/04/04 16:05:47 Waiting for dst bucket item count to get to: 0 curr count: 25290
2022/04/04 16:05:52 Waiting for dst bucket item count to get to: 0 curr count: 10667
2022/04/04 16:05:57 Waiting for dst bucket item count to get to: 0 curr count: 10667
2022/04/04 16:05:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:05:57 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 16:06:02 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/04/04 16:06:07 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/04/04 16:06:12 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/04/04 16:06:17 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/04/04 16:06:17 App: TestEventingSwapRebWithTimers got un-deployed
2022/04/04 16:06:17 No eventing-con process running
2022/04/04 16:06:17 Function: TestEventingSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers deleting in background"
}
2022/04/04 16:06:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:06:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:06:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:06:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:06:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:06:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithTimers (259.91s)
=== RUN   TestKVRebInWithTimers
2022/04/04 16:06:41 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/04/04 16:06:41 App: TestKVRebInWithTimers got un-deployed
2022/04/04 16:06:41 No eventing-con process running
2022/04/04 16:06:41 Function: TestKVRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithTimers not found"
}
2022/04/04 16:06:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:06:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:06:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:06:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:06:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:06:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:06:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:06:59 Deploying app: TestKVRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:07:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers stored in temp store"
}
2022/04/04 16:07:05 Waiting for app: TestKVRebInWithTimers to get deployed
2022/04/04 16:07:10 Waiting for app: TestKVRebInWithTimers to get deployed
2022/04/04 16:07:16 Waiting for app: TestKVRebInWithTimers to get deployed
2022/04/04 16:07:21 Waiting for app: TestKVRebInWithTimers to get deployed
2022/04/04 16:07:21 App: TestKVRebInWithTimers got deployed
2022/04/04 16:07:21 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:07:21 Starting bucket ops to source bucket
2022/04/04 16:07:21 Removing node(s): [] from the cluster
2022/04/04 16:07:26 Rebalance progress: 12.5
2022/04/04 16:07:31 Rebalance progress: 12.5
2022/04/04 16:07:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:07:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:07:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:07:37 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:07:42 Rebalance progress: 12.5
2022/04/04 16:07:47 Rebalance progress: 12.5
2022/04/04 16:07:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:07:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:07:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:07:52 Waiting for src bucket item count to get to: 50000 curr count: 26928
2022/04/04 16:07:57 Waiting for src bucket item count to get to: 50000 curr count: 37062
2022/04/04 16:08:02 Waiting for src bucket item count to get to: 50000 curr count: 37062
2022/04/04 16:08:07 Waiting for src bucket item count to get to: 50000 curr count: 49755
2022/04/04 16:08:12 Waiting for src bucket item count to get to: 50000 curr count: 49755
2022/04/04 16:08:22 Waiting for dst bucket item count to get to: 50000 curr count: 48049
2022/04/04 16:08:27 Waiting for dst bucket item count to get to: 50000 curr count: 48049
2022/04/04 16:08:27 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:08:27 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:08:27 Starting bucket ops to source bucket
2022/04/04 16:09:36 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:09:41 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:09:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:09:51 Waiting for dst bucket item count to get to: 0 curr count: 42400
2022/04/04 16:09:56 Waiting for dst bucket item count to get to: 0 curr count: 42400
2022/04/04 16:10:02 Waiting for dst bucket item count to get to: 0 curr count: 27032
2022/04/04 16:10:07 Waiting for dst bucket item count to get to: 0 curr count: 27032
2022/04/04 16:10:12 Waiting for dst bucket item count to get to: 0 curr count: 11779
2022/04/04 16:10:17 Waiting for dst bucket item count to get to: 0 curr count: 11779
2022/04/04 16:10:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:10:17 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 16:10:22 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/04/04 16:10:27 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/04/04 16:10:32 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/04/04 16:10:37 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/04/04 16:10:37 App: TestKVRebInWithTimers got un-deployed
2022/04/04 16:10:37 No eventing-con process running
2022/04/04 16:10:37 Function: TestKVRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers deleting in background"
}
2022/04/04 16:10:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:10:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:10:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:10:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:10:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:10:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithTimers (260.18s)
=== RUN   TestKVRebOutWithTimers
2022/04/04 16:10:56 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:10:56 Removing node(s): [] from the cluster
2022/04/04 16:11:01 Rebalance progress: 100
2022/04/04 16:11:06 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/04/04 16:11:06 App: TestKVRebOutWithTimers got un-deployed
2022/04/04 16:11:06 No eventing-con process running
2022/04/04 16:11:06 Function: TestKVRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithTimers not found"
}
2022/04/04 16:11:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:11:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:11:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:11:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:11:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:11:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:11:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:11:25 Deploying app: TestKVRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:11:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers stored in temp store"
}
2022/04/04 16:11:31 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/04/04 16:11:36 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/04/04 16:11:41 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/04/04 16:11:46 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/04/04 16:11:46 App: TestKVRebOutWithTimers got deployed
2022/04/04 16:11:46 Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:11:46 Starting bucket ops to source bucket
2022/04/04 16:11:51 Rebalance progress: 12.5
2022/04/04 16:11:56 Rebalance progress: 12.5
2022/04/04 16:12:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:12:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:12:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:12:01 Waiting for src bucket item count to get to: 50000 curr count: 7141
2022/04/04 16:12:06 Waiting for src bucket item count to get to: 50000 curr count: 20207
2022/04/04 16:12:11 Waiting for src bucket item count to get to: 50000 curr count: 20207
2022/04/04 16:12:16 Waiting for src bucket item count to get to: 50000 curr count: 31572
2022/04/04 16:12:21 Waiting for src bucket item count to get to: 50000 curr count: 31572
2022/04/04 16:12:26 Waiting for src bucket item count to get to: 50000 curr count: 43421
2022/04/04 16:12:31 Waiting for src bucket item count to get to: 50000 curr count: 43421
2022/04/04 16:12:36 Waiting for src bucket item count to get to: 50000 curr count: 43421
2022/04/04 16:12:46 Waiting for dst bucket item count to get to: 50000 curr count: 41154
2022/04/04 16:12:51 Waiting for dst bucket item count to get to: 50000 curr count: 41154
2022/04/04 16:12:51 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:12:51 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:12:51 Starting bucket ops to source bucket
2022/04/04 16:14:01 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:14:06 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:14:11 Waiting for dst bucket item count to get to: 0 curr count: 47868
2022/04/04 16:14:16 Waiting for dst bucket item count to get to: 0 curr count: 47868
2022/04/04 16:14:22 Waiting for dst bucket item count to get to: 0 curr count: 40565
2022/04/04 16:14:27 Waiting for dst bucket item count to get to: 0 curr count: 40565
2022/04/04 16:14:32 Waiting for dst bucket item count to get to: 0 curr count: 16087
2022/04/04 16:14:37 Waiting for dst bucket item count to get to: 0 curr count: 16087
2022/04/04 16:14:42 Waiting for dst bucket item count to get to: 0 curr count: 1674
2022/04/04 16:14:47 Waiting for dst bucket item count to get to: 0 curr count: 1674
2022/04/04 16:14:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:14:47 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 16:14:52 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/04/04 16:14:57 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/04/04 16:15:02 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/04/04 16:15:07 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/04/04 16:15:07 App: TestKVRebOutWithTimers got un-deployed
2022/04/04 16:15:07 No eventing-con process running
2022/04/04 16:15:07 Function: TestKVRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers deleting in background"
}
2022/04/04 16:15:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:15:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:15:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:15:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:15:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:15:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithTimers (269.77s)
=== RUN   TestKVSwapRebWithTimers
2022/04/04 16:15:31 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/04/04 16:15:31 App: TestKVSwapRebWithTimers got un-deployed
2022/04/04 16:15:31 No eventing-con process running
2022/04/04 16:15:31 Function: TestKVSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithTimers not found"
}
2022/04/04 16:15:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:15:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:15:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:15:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:15:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:15:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:15:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:15:49 Deploying app: TestKVSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:15:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers stored in temp store"
}
2022/04/04 16:15:55 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/04/04 16:16:00 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/04/04 16:16:05 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/04/04 16:16:10 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/04/04 16:16:10 App: TestKVSwapRebWithTimers got deployed
2022/04/04 16:16:10 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:16:10 Starting bucket ops to source bucket
2022/04/04 16:16:11 Removing node(s): [] from the cluster
2022/04/04 16:16:16 Rebalance progress: 12.5
2022/04/04 16:16:21 Rebalance progress: 12.5
2022/04/04 16:16:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:16:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:16:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:16:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 16:16:26 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:16:31 Rebalance progress: 12.5
2022/04/04 16:16:36 Rebalance progress: 12.5
2022/04/04 16:16:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:16:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:16:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:16:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 16:16:47 Rebalance progress: 12.5
2022/04/04 16:16:52 Rebalance progress: 12.5
2022/04/04 16:16:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:16:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:16:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:16:57 Waiting for src bucket item count to get to: 50000 curr count: 48355
2022/04/04 16:17:02 Waiting for src bucket item count to get to: 50000 curr count: 48355
2022/04/04 16:17:12 Waiting for dst bucket item count to get to: 50000 curr count: 48482
2022/04/04 16:17:17 Waiting for dst bucket item count to get to: 50000 curr count: 48482
2022/04/04 16:17:17 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:17:17 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:17:17 Starting bucket ops to source bucket
2022/04/04 16:18:26 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:18:31 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:18:36 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:18:41 Waiting for dst bucket item count to get to: 0 curr count: 36843
2022/04/04 16:18:46 Waiting for dst bucket item count to get to: 0 curr count: 36843
2022/04/04 16:18:51 Waiting for dst bucket item count to get to: 0 curr count: 23683
2022/04/04 16:18:56 Waiting for dst bucket item count to get to: 0 curr count: 23683
2022/04/04 16:19:01 Waiting for dst bucket item count to get to: 0 curr count: 8139
2022/04/04 16:19:06 Waiting for dst bucket item count to get to: 0 curr count: 8139
2022/04/04 16:19:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:19:06 Post DELETE ops. Expected item count: 0 got 0
2022/04/04 16:19:12 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/04/04 16:19:17 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/04/04 16:19:22 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/04/04 16:19:27 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/04/04 16:19:32 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/04/04 16:19:37 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/04/04 16:19:37 App: TestKVSwapRebWithTimers got un-deployed
2022/04/04 16:19:37 No eventing-con process running
2022/04/04 16:19:37 Function: TestKVSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers deleting in background"
}
2022/04/04 16:19:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:19:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:19:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:19:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:19:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:19:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithTimers (270.37s)
=== RUN   TestDuplicateTimerCreationEventingRebIn
2022/04/04 16:20:01 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/04/04 16:20:01 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2022/04/04 16:20:01 No eventing-con process running
2022/04/04 16:20:01 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebIn not found"
}
2022/04/04 16:20:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:20:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:20:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:20:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:20:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:20:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:20:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:20:20 Deploying app: TestDuplicateTimerCreationEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:20:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn stored in temp store"
}
2022/04/04 16:20:26 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/04/04 16:20:31 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/04/04 16:20:36 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/04/04 16:20:41 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/04/04 16:20:41 App: TestDuplicateTimerCreationEventingRebIn got deployed
2022/04/04 16:20:41 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 16:20:41 Starting bucket ops to source bucket
2022/04/04 16:20:41 Removing node(s): [] from the cluster
2022/04/04 16:20:46 Rebalance progress: 12.5
2022/04/04 16:20:51 Rebalance progress: 12.5
2022/04/04 16:20:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:20:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:20:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:20:57 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:21:02 Rebalance progress: 12.5
2022/04/04 16:21:07 Rebalance progress: 12.5
2022/04/04 16:21:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:21:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:21:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:21:12 Waiting for src bucket item count to get to: 50000 curr count: 26905
2022/04/04 16:21:17 Waiting for src bucket item count to get to: 50000 curr count: 38470
2022/04/04 16:21:22 Waiting for src bucket item count to get to: 50000 curr count: 38470
2022/04/04 16:21:27 Waiting for src bucket item count to get to: 50000 curr count: 49714
2022/04/04 16:21:32 Waiting for src bucket item count to get to: 50000 curr count: 49714
2022/04/04 16:21:42 Waiting for dst bucket item count to get to: 50000 curr count: 35990
2022/04/04 16:21:47 Waiting for dst bucket item count to get to: 50000 curr count: 35990
2022/04/04 16:21:52 Waiting for dst bucket item count to get to: 50000 curr count: 43235
2022/04/04 16:21:57 Waiting for dst bucket item count to get to: 50000 curr count: 43235
2022/04/04 16:21:57 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:21:57 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:22:02 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/04/04 16:22:07 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/04/04 16:22:12 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/04/04 16:22:17 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/04/04 16:22:22 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/04/04 16:22:27 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/04/04 16:22:28 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2022/04/04 16:22:28 No eventing-con process running
2022/04/04 16:22:28 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn deleting in background"
}
2022/04/04 16:22:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:22:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:22:39 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:22:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:22:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:22:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:22:51 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:22:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebIn (180.14s)
=== RUN   TestDuplicateTimerCreationEventingRebOut
2022/04/04 16:22:56 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 16:22:56 Removing node(s): [] from the cluster
2022/04/04 16:23:01 Rebalance progress: 100
2022/04/04 16:23:06 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/04/04 16:23:06 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2022/04/04 16:23:06 No eventing-con process running
2022/04/04 16:23:07 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebOut not found"
}
2022/04/04 16:23:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:23:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:23:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:23:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:23:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:23:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:23:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:23:25 Deploying app: TestDuplicateTimerCreationEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:23:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut stored in temp store"
}
2022/04/04 16:23:31 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/04/04 16:23:36 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/04/04 16:23:41 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/04/04 16:23:46 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/04/04 16:23:46 App: TestDuplicateTimerCreationEventingRebOut got deployed
2022/04/04 16:23:46 Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:23:46 Starting bucket ops to source bucket
2022/04/04 16:23:51 Rebalance progress: 12.5
2022/04/04 16:23:56 Rebalance progress: 12.5
2022/04/04 16:24:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:24:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:24:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:24:02 Waiting for src bucket item count to get to: 50000 curr count: 6597
2022/04/04 16:24:07 Waiting for src bucket item count to get to: 50000 curr count: 20959
2022/04/04 16:24:12 Waiting for src bucket item count to get to: 50000 curr count: 20959
2022/04/04 16:24:17 Waiting for src bucket item count to get to: 50000 curr count: 33447
2022/04/04 16:24:22 Waiting for src bucket item count to get to: 50000 curr count: 33447
2022/04/04 16:24:27 Waiting for src bucket item count to get to: 50000 curr count: 44073
2022/04/04 16:24:32 Waiting for src bucket item count to get to: 50000 curr count: 44073
2022/04/04 16:24:37 Waiting for src bucket item count to get to: 50000 curr count: 44073
2022/04/04 16:24:47 Waiting for dst bucket item count to get to: 50000 curr count: 34732
2022/04/04 16:24:52 Waiting for dst bucket item count to get to: 50000 curr count: 41974
2022/04/04 16:24:57 Waiting for dst bucket item count to get to: 50000 curr count: 41974
2022/04/04 16:24:57 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:24:57 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:25:02 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/04/04 16:25:07 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/04/04 16:25:12 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/04/04 16:25:17 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/04/04 16:25:22 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/04/04 16:25:27 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/04/04 16:25:27 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2022/04/04 16:25:27 No eventing-con process running
2022/04/04 16:25:27 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut deleting in background"
}
2022/04/04 16:25:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:25:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:25:39 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:25:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:25:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:25:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:25:51 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:25:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebOut (179.87s)
=== RUN   TestDuplicateTimerCreationEventingSwapReb
2022/04/04 16:26:01 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/04/04 16:26:01 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2022/04/04 16:26:01 No eventing-con process running
2022/04/04 16:26:01 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingSwapReb not found"
}
2022/04/04 16:26:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:26:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:26:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:26:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:26:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:26:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:26:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:26:20 Deploying app: TestDuplicateTimerCreationEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:26:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb stored in temp store"
}
2022/04/04 16:26:26 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/04/04 16:26:31 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/04/04 16:26:36 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/04/04 16:26:41 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/04/04 16:26:41 App: TestDuplicateTimerCreationEventingSwapReb got deployed
2022/04/04 16:26:41 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 16:26:41 Starting bucket ops to source bucket
2022/04/04 16:26:41 Removing node(s): [] from the cluster
2022/04/04 16:26:46 Rebalance progress: 12.5
2022/04/04 16:26:51 Rebalance progress: 12.5
2022/04/04 16:26:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:26:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:26:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:26:57 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 16:26:57 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:27:02 Rebalance progress: 12.5
2022/04/04 16:27:07 Rebalance progress: 12.5
2022/04/04 16:27:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:27:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:27:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:27:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 16:27:17 Rebalance progress: 12.5
2022/04/04 16:27:22 Rebalance progress: 12.5
2022/04/04 16:27:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:27:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:27:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:27:27 Waiting for src bucket item count to get to: 50000 curr count: 47660
2022/04/04 16:27:32 Waiting for src bucket item count to get to: 50000 curr count: 47660
2022/04/04 16:27:42 Waiting for dst bucket item count to get to: 50000 curr count: 40013
2022/04/04 16:27:47 Waiting for dst bucket item count to get to: 50000 curr count: 40013
2022/04/04 16:27:52 Waiting for dst bucket item count to get to: 50000 curr count: 47452
2022/04/04 16:27:57 Waiting for dst bucket item count to get to: 50000 curr count: 47452
2022/04/04 16:27:57 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:27:57 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:28:02 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/04/04 16:28:08 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/04/04 16:28:13 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/04/04 16:28:18 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/04/04 16:28:23 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/04/04 16:28:28 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/04/04 16:28:28 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2022/04/04 16:28:28 No eventing-con process running
2022/04/04 16:28:28 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb deleting in background"
}
2022/04/04 16:28:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:28:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:28:40 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:28:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:28:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:28:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:28:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingSwapReb (175.95s)
=== RUN   TestDuplicateTimerCreationKVRebIn
2022/04/04 16:28:57 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/04/04 16:28:57 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2022/04/04 16:28:57 No eventing-con process running
2022/04/04 16:28:57 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebIn not found"
}
2022/04/04 16:28:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:29:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:29:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:29:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:29:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:29:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:29:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:29:16 Deploying app: TestDuplicateTimerCreationKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:29:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn stored in temp store"
}
2022/04/04 16:29:22 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/04/04 16:29:27 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/04/04 16:29:32 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/04/04 16:29:37 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/04/04 16:29:37 App: TestDuplicateTimerCreationKVRebIn got deployed
2022/04/04 16:29:37 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:29:37 Starting bucket ops to source bucket
2022/04/04 16:29:37 Removing node(s): [] from the cluster
2022/04/04 16:29:42 Rebalance progress: 12.5
2022/04/04 16:29:47 Rebalance progress: 12.5
2022/04/04 16:29:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:29:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:29:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:29:52 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:29:57 Rebalance progress: 12.5
2022/04/04 16:30:02 Rebalance progress: 12.5
2022/04/04 16:30:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:30:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:30:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:30:07 Waiting for src bucket item count to get to: 50000 curr count: 31794
2022/04/04 16:30:12 Waiting for src bucket item count to get to: 50000 curr count: 31794
2022/04/04 16:30:17 Waiting for src bucket item count to get to: 50000 curr count: 42628
2022/04/04 16:30:27 Waiting for dst bucket item count to get to: 50000 curr count: 33055
2022/04/04 16:30:32 Waiting for dst bucket item count to get to: 50000 curr count: 33055
2022/04/04 16:30:37 Waiting for dst bucket item count to get to: 50000 curr count: 39968
2022/04/04 16:30:42 Waiting for dst bucket item count to get to: 50000 curr count: 39968
2022/04/04 16:30:42 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:30:42 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:30:47 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/04/04 16:30:53 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/04/04 16:30:58 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/04/04 16:31:03 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/04/04 16:31:08 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/04/04 16:31:13 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/04/04 16:31:13 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2022/04/04 16:31:13 No eventing-con process running
2022/04/04 16:31:13 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn deleting in background"
}
2022/04/04 16:31:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:31:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:31:25 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:31:30 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:31:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:31:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:31:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:31:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebIn (169.96s)
=== RUN   TestDuplicateTimerCreationKVRebOut
2022/04/04 16:31:42 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:31:42 Removing node(s): [] from the cluster
2022/04/04 16:31:47 Rebalance progress: 100
2022/04/04 16:31:52 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/04/04 16:31:52 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2022/04/04 16:31:52 No eventing-con process running
2022/04/04 16:31:52 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebOut not found"
}
2022/04/04 16:31:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:31:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:31:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:32:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:32:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:32:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:32:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:32:11 Deploying app: TestDuplicateTimerCreationKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:32:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut stored in temp store"
}
2022/04/04 16:32:17 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/04/04 16:32:22 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/04/04 16:32:27 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/04/04 16:32:32 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/04/04 16:32:32 App: TestDuplicateTimerCreationKVRebOut got deployed
2022/04/04 16:32:32 Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:32:32 Starting bucket ops to source bucket
2022/04/04 16:32:37 Rebalance progress: 12.5
2022/04/04 16:32:42 Rebalance progress: 12.5
2022/04/04 16:32:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:32:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:32:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:32:47 Waiting for src bucket item count to get to: 50000 curr count: 12625
2022/04/04 16:32:52 Waiting for src bucket item count to get to: 50000 curr count: 27051
2022/04/04 16:32:57 Waiting for src bucket item count to get to: 50000 curr count: 27051
2022/04/04 16:33:02 Waiting for src bucket item count to get to: 50000 curr count: 38484
2022/04/04 16:33:07 Waiting for src bucket item count to get to: 50000 curr count: 38484
2022/04/04 16:33:12 Waiting for src bucket item count to get to: 50000 curr count: 48373
2022/04/04 16:33:17 Waiting for src bucket item count to get to: 50000 curr count: 48373
2022/04/04 16:33:27 Waiting for dst bucket item count to get to: 50000 curr count: 38304
2022/04/04 16:33:32 Waiting for dst bucket item count to get to: 50000 curr count: 38304
2022/04/04 16:33:37 Waiting for dst bucket item count to get to: 50000 curr count: 38304
2022/04/04 16:33:42 Waiting for dst bucket item count to get to: 50000 curr count: 48173
2022/04/04 16:33:48 Waiting for dst bucket item count to get to: 50000 curr count: 48173
2022/04/04 16:33:48 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:33:48 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:33:53 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/04/04 16:33:58 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/04/04 16:34:03 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/04/04 16:34:08 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/04/04 16:34:13 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/04/04 16:34:18 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/04/04 16:34:18 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2022/04/04 16:34:18 No eventing-con process running
2022/04/04 16:34:19 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut deleting in background"
}
2022/04/04 16:34:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:34:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:34:30 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:34:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:34:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:34:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:34:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebOut (180.21s)
=== RUN   TestDuplicateTimerCreationKVSwapReb
2022/04/04 16:34:47 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/04/04 16:34:47 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2022/04/04 16:34:47 No eventing-con process running
2022/04/04 16:34:47 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVSwapReb not found"
}
2022/04/04 16:34:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:34:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:34:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:34:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:35:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:35:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:35:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:35:06 Deploying app: TestDuplicateTimerCreationKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:35:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb stored in temp store"
}
2022/04/04 16:35:12 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/04/04 16:35:17 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/04/04 16:35:22 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/04/04 16:35:27 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/04/04 16:35:27 App: TestDuplicateTimerCreationKVSwapReb got deployed
2022/04/04 16:35:27 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:35:27 Starting bucket ops to source bucket
2022/04/04 16:35:28 Removing node(s): [] from the cluster
2022/04/04 16:35:33 Rebalance progress: 12.5
2022/04/04 16:35:38 Rebalance progress: 12.5
2022/04/04 16:35:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:35:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:35:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:35:43 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 16:35:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:35:48 Rebalance progress: 12.5
2022/04/04 16:35:53 Rebalance progress: 12.5
2022/04/04 16:35:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:35:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:35:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:35:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 16:36:03 Rebalance progress: 12.5
2022/04/04 16:36:08 Rebalance progress: 12.5
2022/04/04 16:36:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:36:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:36:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:36:18 Waiting for dst bucket item count to get to: 50000 curr count: 32964
2022/04/04 16:36:23 Waiting for dst bucket item count to get to: 50000 curr count: 32964
2022/04/04 16:36:28 Waiting for dst bucket item count to get to: 50000 curr count: 38982
2022/04/04 16:36:33 Waiting for dst bucket item count to get to: 50000 curr count: 38982
2022/04/04 16:36:33 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:36:33 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:36:38 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/04/04 16:36:43 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/04/04 16:36:49 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/04/04 16:36:54 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/04/04 16:36:59 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/04/04 16:36:59 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2022/04/04 16:36:59 No eventing-con process running
2022/04/04 16:36:59 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb deleting in background"
}
2022/04/04 16:37:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:37:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:37:11 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:37:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:37:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:37:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:37:23 Waiting for dst bucket item count to get to: 0 curr count: 22552
2022/04/04 16:37:28 Waiting for dst bucket item count to get to: 0 curr count: 22552
2022/04/04 16:37:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVSwapReb (170.61s)
=== RUN   TestDuplicateTimerFiringEventingRebIn
2022/04/04 16:37:38 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/04/04 16:37:38 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2022/04/04 16:37:38 No eventing-con process running
2022/04/04 16:37:38 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebIn not found"
}
2022/04/04 16:37:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:37:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:37:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:37:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:37:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:37:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:37:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:37:56 Deploying app: TestDuplicateTimerFiringEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:37:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn stored in temp store"
}
2022/04/04 16:38:02 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/04/04 16:38:07 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/04/04 16:38:13 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/04/04 16:38:18 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/04/04 16:38:18 App: TestDuplicateTimerFiringEventingRebIn got deployed
2022/04/04 16:38:18 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 16:38:18 Starting bucket ops to source bucket
2022/04/04 16:38:18 Removing node(s): [] from the cluster
2022/04/04 16:38:23 Rebalance progress: 12.5
2022/04/04 16:38:28 Rebalance progress: 12.5
2022/04/04 16:38:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:38:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:38:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:38:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:38:38 Rebalance progress: 12.5
2022/04/04 16:38:43 Rebalance progress: 12.5
2022/04/04 16:38:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:38:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:38:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:38:48 Waiting for src bucket item count to get to: 50000 curr count: 29482
2022/04/04 16:38:53 Waiting for src bucket item count to get to: 50000 curr count: 41753
2022/04/04 16:38:58 Waiting for src bucket item count to get to: 50000 curr count: 41753
2022/04/04 16:39:08 Waiting for dst bucket item count to get to: 50000 curr count: 36989
2022/04/04 16:39:13 Waiting for dst bucket item count to get to: 50000 curr count: 36989
2022/04/04 16:39:18 Waiting for dst bucket item count to get to: 50000 curr count: 45527
2022/04/04 16:39:23 Waiting for dst bucket item count to get to: 50000 curr count: 45527
2022/04/04 16:39:23 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:39:23 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:39:28 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/04/04 16:39:34 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/04/04 16:39:39 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/04/04 16:39:44 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/04/04 16:39:49 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/04/04 16:39:54 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/04/04 16:39:54 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2022/04/04 16:39:54 No eventing-con process running
2022/04/04 16:39:54 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn deleting in background"
}
2022/04/04 16:39:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:40:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:40:06 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:40:11 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:40:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:40:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:40:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:40:23 Waiting for dst bucket item count to get to: 0 curr count: 28950
2022/04/04 16:40:28 Waiting for dst bucket item count to get to: 0 curr count: 28950
2022/04/04 16:40:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebIn (180.20s)
=== RUN   TestDuplicateTimerFiringEventingRebOut
2022/04/04 16:40:33 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 16:40:33 Removing node(s): [] from the cluster
2022/04/04 16:40:38 Rebalance progress: 100
2022/04/04 16:40:43 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/04/04 16:40:43 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2022/04/04 16:40:43 No eventing-con process running
2022/04/04 16:40:43 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebOut not found"
}
2022/04/04 16:40:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:40:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:40:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:40:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:40:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:40:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:41:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:41:02 Deploying app: TestDuplicateTimerFiringEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:41:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut stored in temp store"
}
2022/04/04 16:41:08 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/04/04 16:41:13 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/04/04 16:41:18 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/04/04 16:41:23 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/04/04 16:41:23 App: TestDuplicateTimerFiringEventingRebOut got deployed
2022/04/04 16:41:23 Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:41:23 Starting bucket ops to source bucket
2022/04/04 16:41:28 Rebalance progress: 12.5
2022/04/04 16:41:33 Rebalance progress: 12.5
2022/04/04 16:41:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:41:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:41:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:41:38 Waiting for src bucket item count to get to: 50000 curr count: 11557
2022/04/04 16:41:43 Waiting for src bucket item count to get to: 50000 curr count: 23786
2022/04/04 16:41:48 Waiting for src bucket item count to get to: 50000 curr count: 23786
2022/04/04 16:41:53 Waiting for src bucket item count to get to: 50000 curr count: 34655
2022/04/04 16:41:58 Waiting for src bucket item count to get to: 50000 curr count: 34655
2022/04/04 16:42:03 Waiting for src bucket item count to get to: 50000 curr count: 45861
2022/04/04 16:42:08 Waiting for src bucket item count to get to: 50000 curr count: 45861
2022/04/04 16:42:13 Waiting for src bucket item count to get to: 50000 curr count: 45861
2022/04/04 16:42:23 Waiting for dst bucket item count to get to: 50000 curr count: 42902
2022/04/04 16:42:28 Waiting for dst bucket item count to get to: 50000 curr count: 42902
2022/04/04 16:42:28 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:42:28 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:42:33 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/04/04 16:42:39 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/04/04 16:42:44 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/04/04 16:42:49 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/04/04 16:42:54 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/04/04 16:42:59 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/04/04 16:42:59 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2022/04/04 16:42:59 No eventing-con process running
2022/04/04 16:43:00 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut deleting in background"
}
2022/04/04 16:43:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:43:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:43:11 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:43:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:43:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:43:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:43:23 Waiting for dst bucket item count to get to: 0 curr count: 38586
2022/04/04 16:43:28 Waiting for dst bucket item count to get to: 0 curr count: 38586
2022/04/04 16:43:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebOut (180.22s)
=== RUN   TestDuplicateTimerFiringEventingSwapReb
2022/04/04 16:43:38 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/04/04 16:43:38 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2022/04/04 16:43:38 No eventing-con process running
2022/04/04 16:43:38 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingSwapReb not found"
}
2022/04/04 16:43:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:43:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:43:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:43:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:43:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:43:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:43:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:43:57 Deploying app: TestDuplicateTimerFiringEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:43:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb stored in temp store"
}
2022/04/04 16:44:03 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/04/04 16:44:08 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/04/04 16:44:13 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/04/04 16:44:18 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/04/04 16:44:18 App: TestDuplicateTimerFiringEventingSwapReb got deployed
2022/04/04 16:44:18 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/04/04 16:44:18 Starting bucket ops to source bucket
2022/04/04 16:44:18 Removing node(s): [] from the cluster
2022/04/04 16:44:23 Rebalance progress: 12.5
2022/04/04 16:44:28 Rebalance progress: 12.5
2022/04/04 16:44:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:44:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:44:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:44:33 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 16:44:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:44:40 Rebalance progress: 12.5
2022/04/04 16:44:45 Rebalance progress: 12.5
2022/04/04 16:44:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:44:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:44:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:44:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 16:44:55 Rebalance progress: 12.5
2022/04/04 16:45:00 Rebalance progress: 12.5
2022/04/04 16:45:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:45:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:45:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:45:05 Waiting for src bucket item count to get to: 50000 curr count: 49637
2022/04/04 16:45:10 Waiting for src bucket item count to get to: 50000 curr count: 49637
2022/04/04 16:45:20 Waiting for dst bucket item count to get to: 50000 curr count: 48044
2022/04/04 16:45:25 Waiting for dst bucket item count to get to: 50000 curr count: 48044
2022/04/04 16:45:25 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:45:25 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:45:30 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/04/04 16:45:36 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/04/04 16:45:41 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/04/04 16:45:46 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/04/04 16:45:51 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/04/04 16:45:51 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2022/04/04 16:45:51 No eventing-con process running
2022/04/04 16:45:51 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb deleting in background"
}
2022/04/04 16:45:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:45:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:46:03 Waiting for dst bucket item count to get to: 0 curr count: 42516
2022/04/04 16:46:08 Waiting for dst bucket item count to get to: 0 curr count: 42516
2022/04/04 16:46:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:46:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:46:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:46:20 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:46:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingSwapReb (171.86s)
=== RUN   TestDuplicateTimerFiringKVRebIn
2022/04/04 16:46:30 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/04/04 16:46:30 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2022/04/04 16:46:30 No eventing-con process running
2022/04/04 16:46:30 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebIn not found"
}
2022/04/04 16:46:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:46:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:46:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:46:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:46:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:46:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:46:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:46:49 Deploying app: TestDuplicateTimerFiringKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:46:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn stored in temp store"
}
2022/04/04 16:46:55 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/04/04 16:47:00 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/04/04 16:47:05 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/04/04 16:47:10 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/04/04 16:47:10 App: TestDuplicateTimerFiringKVRebIn got deployed
2022/04/04 16:47:10 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:47:10 Starting bucket ops to source bucket
2022/04/04 16:47:10 Removing node(s): [] from the cluster
2022/04/04 16:47:15 Rebalance progress: 12.5
2022/04/04 16:47:20 Rebalance progress: 12.5
2022/04/04 16:47:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:47:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:47:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:47:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:47:30 Rebalance progress: 12.5
2022/04/04 16:47:35 Rebalance progress: 12.5
2022/04/04 16:47:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:47:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:47:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:47:40 Waiting for src bucket item count to get to: 50000 curr count: 27577
2022/04/04 16:47:45 Waiting for src bucket item count to get to: 50000 curr count: 37880
2022/04/04 16:47:50 Waiting for src bucket item count to get to: 50000 curr count: 37880
2022/04/04 16:48:00 Waiting for dst bucket item count to get to: 50000 curr count: 29549
2022/04/04 16:48:05 Waiting for dst bucket item count to get to: 50000 curr count: 29549
2022/04/04 16:48:10 Waiting for dst bucket item count to get to: 50000 curr count: 44741
2022/04/04 16:48:15 Waiting for dst bucket item count to get to: 50000 curr count: 44741
2022/04/04 16:48:15 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:48:15 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:48:21 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/04/04 16:48:26 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/04/04 16:48:31 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/04/04 16:48:36 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/04/04 16:48:41 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/04/04 16:48:46 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/04/04 16:48:46 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2022/04/04 16:48:46 No eventing-con process running
2022/04/04 16:48:47 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn deleting in background"
}
2022/04/04 16:48:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:48:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:48:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:48:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:49:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:49:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:49:10 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:49:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebIn (170.09s)
=== RUN   TestDuplicateTimerFiringKVRebOut
2022/04/04 16:49:15 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:49:15 Removing node(s): [] from the cluster
2022/04/04 16:49:20 Rebalance progress: 100
2022/04/04 16:49:25 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/04/04 16:49:25 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2022/04/04 16:49:25 No eventing-con process running
2022/04/04 16:49:25 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebOut not found"
}
2022/04/04 16:49:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:49:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:49:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:49:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:49:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:49:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:49:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:49:44 Deploying app: TestDuplicateTimerFiringKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:49:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut stored in temp store"
}
2022/04/04 16:49:50 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/04/04 16:49:55 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/04/04 16:50:00 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/04/04 16:50:05 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/04/04 16:50:05 App: TestDuplicateTimerFiringKVRebOut got deployed
2022/04/04 16:50:05 Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:50:05 Starting bucket ops to source bucket
2022/04/04 16:50:10 Rebalance progress: 12.5
2022/04/04 16:50:15 Rebalance progress: 12.5
2022/04/04 16:50:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:50:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:50:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:50:20 Waiting for src bucket item count to get to: 50000 curr count: 8151
2022/04/04 16:50:25 Waiting for src bucket item count to get to: 50000 curr count: 22247
2022/04/04 16:50:30 Waiting for src bucket item count to get to: 50000 curr count: 22247
2022/04/04 16:50:35 Waiting for src bucket item count to get to: 50000 curr count: 34296
2022/04/04 16:50:40 Waiting for src bucket item count to get to: 50000 curr count: 34296
2022/04/04 16:50:45 Waiting for src bucket item count to get to: 50000 curr count: 44666
2022/04/04 16:50:50 Waiting for src bucket item count to get to: 50000 curr count: 44666
2022/04/04 16:51:00 Waiting for dst bucket item count to get to: 50000 curr count: 35698
2022/04/04 16:51:05 Waiting for dst bucket item count to get to: 50000 curr count: 35698
2022/04/04 16:51:10 Waiting for dst bucket item count to get to: 50000 curr count: 35698
2022/04/04 16:51:10 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:51:10 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:51:15 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/04/04 16:51:21 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/04/04 16:51:26 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/04/04 16:51:31 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/04/04 16:51:36 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/04/04 16:51:41 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/04/04 16:51:41 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2022/04/04 16:51:41 No eventing-con process running
2022/04/04 16:51:42 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut deleting in background"
}
2022/04/04 16:51:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:51:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:51:53 Waiting for dst bucket item count to get to: 0 curr count: 48453
2022/04/04 16:51:58 Waiting for dst bucket item count to get to: 0 curr count: 48453
2022/04/04 16:51:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:52:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:52:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:52:10 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:52:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebOut (180.01s)
=== RUN   TestDuplicateTimerFiringKVSwapReb
2022/04/04 16:52:20 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/04/04 16:52:20 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2022/04/04 16:52:20 No eventing-con process running
2022/04/04 16:52:20 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVSwapReb not found"
}
2022/04/04 16:52:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:52:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:52:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:52:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:52:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:52:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:52:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:52:39 Deploying app: TestDuplicateTimerFiringKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:52:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb stored in temp store"
}
2022/04/04 16:52:45 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/04/04 16:52:50 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/04/04 16:52:55 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/04/04 16:53:00 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/04/04 16:53:00 App: TestDuplicateTimerFiringKVSwapReb got deployed
2022/04/04 16:53:00 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:53:00 Starting bucket ops to source bucket
2022/04/04 16:53:01 Removing node(s): [] from the cluster
2022/04/04 16:53:06 Rebalance progress: 12.5
2022/04/04 16:53:11 Rebalance progress: 12.5
2022/04/04 16:53:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:53:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:53:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:53:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 16:53:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:53:22 Rebalance progress: 12.5
2022/04/04 16:53:27 Rebalance progress: 12.5
2022/04/04 16:53:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:53:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:53:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:53:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 16:53:37 Rebalance progress: 12.5
2022/04/04 16:53:42 Rebalance progress: 12.5
2022/04/04 16:53:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:53:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:53:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:53:47 Waiting for src bucket item count to get to: 50000 curr count: 49822
2022/04/04 16:53:52 Waiting for src bucket item count to get to: 50000 curr count: 49822
2022/04/04 16:54:02 Waiting for dst bucket item count to get to: 50000 curr count: 43972
2022/04/04 16:54:07 Waiting for dst bucket item count to get to: 50000 curr count: 43972
2022/04/04 16:54:07 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/04/04 16:54:07 Post SET ops. Expected item count: 50000 got 50000
2022/04/04 16:54:12 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/04/04 16:54:17 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/04/04 16:54:22 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/04/04 16:54:28 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/04/04 16:54:33 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/04/04 16:54:38 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/04/04 16:54:38 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2022/04/04 16:54:38 No eventing-con process running
2022/04/04 16:54:38 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb deleting in background"
}
2022/04/04 16:54:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:54:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:54:50 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:54:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:54:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:54:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:55:01 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/04/04 16:55:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVSwapReb (171.26s)
=== RUN   TestKVRebOnUpdateBucketOpOneByOne
2022/04/04 16:55:11 Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 16:55:11 App: bucket_op_on_update got un-deployed
2022/04/04 16:55:11 No eventing-con process running
2022/04/04 16:55:11 Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/04/04 16:55:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:55:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:55:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:55:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:55:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:55:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:55:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:55:30 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:55:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/04/04 16:55:36 Starting bucket ops to source bucket
2022/04/04 16:55:41 Waiting for app: bucket_op_on_update to get deployed
2022/04/04 16:55:46 Waiting for app: bucket_op_on_update to get deployed
2022/04/04 16:55:51 Waiting for app: bucket_op_on_update to get deployed
2022/04/04 16:55:51 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:55:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:55:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:55:51 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:55:52 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 16:55:57 Rebalance progress: 12.5
2022/04/04 16:56:02 Rebalance progress: 12.5
2022/04/04 16:56:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:56:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:56:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:56:07 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 16:56:07 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 16:56:12 Rebalance progress: 12.5
2022/04/04 16:56:17 Rebalance progress: 12.5
2022/04/04 16:56:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:56:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:56:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:56:22 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/04/04 16:56:23 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 16:56:28 Rebalance progress: 12.5
2022/04/04 16:56:33 Rebalance progress: 12.5
2022/04/04 16:56:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:56:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:56:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:56:38 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 16:56:43 Rebalance progress: 12.5
2022/04/04 16:56:48 Rebalance progress: 12.5
2022/04/04 16:56:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:56:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:56:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:56:53 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 16:56:58 Rebalance progress: 12.5
2022/04/04 16:57:03 Rebalance progress: 12.5
2022/04/04 16:57:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:57:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:57:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:57:08 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/04/04 16:57:13 Rebalance progress: 12.5
2022/04/04 16:57:18 Rebalance progress: 12.5
2022/04/04 16:57:23 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:57:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:57:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:57:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 16:57:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 16:57:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 16:57:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 16:57:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 16:57:49 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 16:57:49 eventingSetup.go:46: No eventing-con process running
2022/04/04 16:57:49 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/04/04 16:57:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:57:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:58:01 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10700
2022/04/04 16:58:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:58:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:58:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:58:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5252
2022/04/04 16:58:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5252
2022/04/04 16:58:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpOneByOne (196.39s)
=== RUN   TestKVForceFailover
2022/04/04 16:58:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 16:58:33 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 16:58:33 eventingSetup.go:46: No eventing-con process running
2022/04/04 16:58:33 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/04/04 16:58:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:58:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:58:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:58:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:58:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:58:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 16:58:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 16:58:47 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 16:58:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:58:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 16:58:52 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 16:58:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/04/04 16:58:53 Starting bucket ops to source bucket
2022/04/04 16:58:58 Waiting for app: bucket_op_on_update to get deployed
2022/04/04 16:59:03 Waiting for app: bucket_op_on_update to get deployed
2022/04/04 16:59:08 Waiting for app: bucket_op_on_update to get deployed
2022/04/04 16:59:13 Waiting for app: bucket_op_on_update to get deployed
2022/04/04 16:59:13 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:59:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:59:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:59:13 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2022/04/04 16:59:33 clusterSetup.go:237: Kicking off failover recovery, type: full
2022/04/04 16:59:33 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/04/04 16:59:38 Rebalance progress: 12.5
2022/04/04 16:59:43 Rebalance progress: 12.5
2022/04/04 16:59:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:59:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 16:59:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 16:59:48 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/04/04 16:59:54 Rebalance progress: 12.5
2022/04/04 16:59:59 Rebalance progress: 12.5
2022/04/04 17:00:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:00:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:00:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:00:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:00:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:00:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:00:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:00:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:00:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:00:35 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:00:35 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:00:35 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/04/04 17:00:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:00:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:00:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7063
2022/04/04 17:00:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7063
2022/04/04 17:00:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:00:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:00:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:01:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5617
2022/04/04 17:01:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5617
2022/04/04 17:01:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVForceFailover (170.44s)
=== RUN   TestKVHardFailoverRecovery
2022/04/04 17:01:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:01:18 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:01:18 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:01:18 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/04/04 17:01:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:01:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:01:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:01:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:01:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:01:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:01:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:01:37 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 17:01:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/04/04 17:01:43 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 17:01:48 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:01:53 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:01:58 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:01:58 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:01:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:01:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:01:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 17:01:58 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:02:03 Rebalance progress: 12.5
2022/04/04 17:02:08 Rebalance progress: 12.5
2022/04/04 17:02:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:02:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:02:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:02:13 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2022/04/04 17:03:13 clusterSetup.go:237: Kicking off failover recovery, type: full
2022/04/04 17:03:19 Rebalance progress: 12.5
2022/04/04 17:03:24 Rebalance progress: 12.5
2022/04/04 17:03:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:03:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:03:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:03:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 17:03:34 Rebalance progress: 12.5
2022/04/04 17:03:39 Rebalance progress: 12.5
2022/04/04 17:03:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:03:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:03:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:03:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:03:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:03:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:04:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:04:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:04:10 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:04:10 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:04:10 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/04/04 17:04:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:04:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:04:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:04:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:04:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:04:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12056
2022/04/04 17:04:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVHardFailoverRecovery (200.28s)
=== RUN   TestKVRebOnUpdateBucketOpAllAtOnce
2022/04/04 17:04:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:04:38 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:04:38 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:04:39 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/04/04 17:04:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:04:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:04:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:04:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:04:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:04:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:04:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:04:57 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 17:04:58 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/04/04 17:05:03 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 17:05:08 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:05:13 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:05:18 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:05:18 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:05:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:05:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:05:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 17:05:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 17:05:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/04/04 17:05:19 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:05:24 Rebalance progress: 12.5
2022/04/04 17:05:29 Rebalance progress: 12.5
2022/04/04 17:05:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:05:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:05:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:05:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/04/04 17:05:39 Rebalance progress: 12.5
2022/04/04 17:05:44 Rebalance progress: 12.5
2022/04/04 17:05:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:05:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:05:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:05:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:06:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:06:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:06:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:06:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:06:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:06:20 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:06:20 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:06:20 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/04/04 17:06:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:06:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:06:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:06:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:06:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:06:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4595
2022/04/04 17:06:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpAllAtOnce (130.47s)
=== RUN   TestKVSwapRebOnUpdateBucketOp
2022/04/04 17:06:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:06:49 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:06:49 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:06:49 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/04/04 17:06:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:06:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:06:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:06:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:07:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:07:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:07:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:07:03 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 17:07:04 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/04/04 17:07:09 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 17:07:14 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:07:19 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:07:24 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:07:24 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:07:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:07:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:07:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 17:07:24 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:07:29 Rebalance progress: 12.5
2022/04/04 17:07:34 Rebalance progress: 12.5
2022/04/04 17:07:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:07:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:07:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:07:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 17:07:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 17:07:45 Rebalance progress: 12.5
2022/04/04 17:07:50 Rebalance progress: 12.5
2022/04/04 17:07:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:07:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:07:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:07:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 17:08:00 Rebalance progress: 12.5
2022/04/04 17:08:05 Rebalance progress: 12.5
2022/04/04 17:08:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:08:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:08:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:08:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:08:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:08:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:08:30 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:08:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:08:41 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:08:41 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:08:41 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:08:41 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/04/04 17:08:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:08:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:08:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 801
2022/04/04 17:08:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 801
2022/04/04 17:08:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:08:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:09:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:09:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6081
2022/04/04 17:09:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:09:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:09:14 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:09:14 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:09:14 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/04/04 17:09:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:09:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:09:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:09:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:09:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:09:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebOnUpdateBucketOp (169.02s)
=== RUN   TestKVRebalanceWithMultipleHandlers
2022/04/04 17:09:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:09:38 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:09:38 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:09:38 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/04/04 17:09:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:09:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:09:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:09:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:09:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:09:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:09:57 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:09:57 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/04/04 17:09:57 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:09:57 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2022/04/04 17:09:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:10:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:10:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:10:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:10:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:10:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:10:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:10:10 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 17:10:11 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:10:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:10:11 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/04/04 17:10:12 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2022/04/04 17:10:17 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 17:10:22 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:10:28 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:10:33 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:10:33 clusterSetup.go:354: App: bucket_op_on_update got deployed
2022/04/04 17:10:38 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/04/04 17:10:43 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/04/04 17:10:48 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/04/04 17:10:48 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:10:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:10:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:10:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 17:10:48 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:10:53 Rebalance progress: 12.5
2022/04/04 17:10:58 Rebalance progress: 12.5
2022/04/04 17:11:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:11:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:11:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:11:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 17:11:04 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:11:09 Rebalance progress: 12.5
2022/04/04 17:11:14 Rebalance progress: 12.5
2022/04/04 17:11:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:11:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:11:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:11:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/04/04 17:11:20 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:11:25 Rebalance progress: 12.5
2022/04/04 17:11:30 Rebalance progress: 12.5
2022/04/04 17:11:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:11:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:11:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:11:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 17:11:40 Rebalance progress: 12.5
2022/04/04 17:11:45 Rebalance progress: 12.5
2022/04/04 17:11:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:11:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:11:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:11:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 17:11:55 Rebalance progress: 12.5
2022/04/04 17:12:00 Rebalance progress: 12.5
2022/04/04 17:12:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:12:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:12:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:12:05 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/04/04 17:12:10 Rebalance progress: 12.5
2022/04/04 17:12:15 Rebalance progress: 12.5
2022/04/04 17:12:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:12:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:12:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:12:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:12:30 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:12:36 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:12:41 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:12:46 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:12:46 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:12:46 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:12:46 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/04/04 17:12:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:12:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:13:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12243
2022/04/04 17:13:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:13:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:13:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:13:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12243
2022/04/04 17:13:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:13:17 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:13:22 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:13:27 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:13:32 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:13:37 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:13:42 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:13:42 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/04/04 17:13:42 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:13:42 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2022/04/04 17:13:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:13:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:13:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:13:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:13:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:13:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebalanceWithMultipleHandlers (268.02s)
=== RUN   TestKVSwapRebalanceWithMultipleHandlers
2022/04/04 17:14:06 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:14:06 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:14:06 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:14:06 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/04/04 17:14:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:14:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:14:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:14:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:14:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:14:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:14:25 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:14:25 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/04/04 17:14:25 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:14:25 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2022/04/04 17:14:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:14:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:14:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:14:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:14:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:14:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:14:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:14:38 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 17:14:39 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:14:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:14:39 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/04/04 17:14:40 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2022/04/04 17:14:45 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 17:14:50 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:14:56 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:15:01 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:15:01 clusterSetup.go:354: App: bucket_op_on_update got deployed
2022/04/04 17:15:06 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/04/04 17:15:11 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/04/04 17:15:16 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/04/04 17:15:16 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:15:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:15:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:15:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 17:15:16 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:15:21 Rebalance progress: 12.5
2022/04/04 17:15:26 Rebalance progress: 12.5
2022/04/04 17:15:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:15:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:15:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:15:31 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 17:15:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 17:15:37 Rebalance progress: 12.5
2022/04/04 17:15:42 Rebalance progress: 12.5
2022/04/04 17:15:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:15:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:15:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:15:47 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 17:15:52 Rebalance progress: 12.5
2022/04/04 17:15:57 Rebalance progress: 12.5
2022/04/04 17:16:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:16:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:16:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:16:07 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:16:12 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:16:17 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:16:23 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:16:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:16:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:16:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:16:38 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:16:38 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:16:38 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/04/04 17:16:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:16:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:16:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7646
2022/04/04 17:16:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:16:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:16:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:17:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5474
2022/04/04 17:17:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5474
2022/04/04 17:17:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:17:13 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:17:18 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:17:24 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:17:29 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:17:34 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:17:39 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/04/04 17:17:39 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/04/04 17:17:39 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:17:39 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2022/04/04 17:17:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:17:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:17:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:17:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:17:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:17:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebalanceWithMultipleHandlers (236.60s)
=== RUN   TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne
2022/04/04 17:18:03 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:18:03 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:18:03 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:18:03 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/04/04 17:18:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:18:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:18:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:18:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:18:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:18:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:18:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:18:21 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 17:18:22 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/04/04 17:18:27 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 17:18:32 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:18:37 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:18:42 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:18:42 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:18:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:18:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:18:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 17:18:43 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:19:03 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:19:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:19:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:19:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:19:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:19:13 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:19:18 Rebalance progress: 12.5
2022/04/04 17:19:23 Rebalance progress: 12.5
2022/04/04 17:19:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:19:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:19:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:19:28 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 17:19:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 17:19:34 Rebalance progress: 12.5
2022/04/04 17:19:39 Rebalance progress: 12.5
2022/04/04 17:19:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:19:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:19:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:19:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 17:19:49 Rebalance progress: 12.5
2022/04/04 17:19:54 Rebalance progress: 12.5
2022/04/04 17:19:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:19:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:19:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:20:04 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:20:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:20:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:20:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:20:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:20:30 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:20:30 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:20:30 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:20:30 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/04/04 17:20:32 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:20:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:20:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:20:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:20:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:20:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9156
2022/04/04 17:20:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne (176.17s)
=== RUN   TestKVFailoverOnUpdateBucketOp
2022/04/04 17:20:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:20:59 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:20:59 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:20:59 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/04/04 17:21:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:21:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:21:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:21:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:21:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:21:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:21:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:21:17 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 17:21:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/04/04 17:21:24 bucketOps.go:157: Starting bucket ops to source bucket
2022/04/04 17:21:29 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:21:34 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:21:39 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:21:39 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:21:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:21:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:21:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 17:21:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:21:44 Rebalance progress: 12.5
2022/04/04 17:21:49 Rebalance progress: 12.5
2022/04/04 17:21:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:21:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:21:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:21:54 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:22:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:22:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:22:04 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:22:09 Rebalance progress: 12.5
2022/04/04 17:22:14 Rebalance progress: 12.5
2022/04/04 17:22:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:22:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:22:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:22:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/04/04 17:22:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/04/04 17:22:24 Rebalance progress: 12.5
2022/04/04 17:22:29 Rebalance progress: 12.5
2022/04/04 17:22:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:22:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:22:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:22:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/04/04 17:22:39 Rebalance progress: 12.5
2022/04/04 17:22:44 Rebalance progress: 12.5
2022/04/04 17:22:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:22:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:22:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:22:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:23:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:23:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:23:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:23:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:23:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:23:20 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:23:20 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:23:20 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/04/04 17:23:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:23:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:23:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:23:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:23:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:23:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8572
2022/04/04 17:23:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVFailoverOnUpdateBucketOp (170.32s)
=== RUN   TestBootstrapAfterKVHardFailover
2022/04/04 17:23:44 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/04/04 17:23:44 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/04/04 17:23:50 Rebalance progress: 100
2022/04/04 17:23:50 Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:24:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:24:20 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/04/04 17:24:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/04/04 17:24:26 Removing node(s): [] from the cluster
2022/04/04 17:24:26 Starting bucket ops to source bucket
2022/04/04 17:24:31 Rebalance failed. See logs for detailed reason. You can try again.
2022/04/04 17:24:36 Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:24:41 Waiting for app: bucket_op_on_update to get deployed
2022/04/04 17:24:41 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:24:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:24:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/04/04 17:24:46 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:24:51 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:24:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:25:02 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:25:07 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/04/04 17:25:07 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/04/04 17:25:07 eventingSetup.go:46: No eventing-con process running
2022/04/04 17:25:07 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/04/04 17:25:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:25:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:25:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1506
2022/04/04 17:25:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/04/04 17:25:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/04/04 17:25:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/04/04 17:25:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1506
2022/04/04 17:25:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBootstrapAfterKVHardFailover (111.44s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	12049.651s

Rebalance tests took 3 hours, 20 minutes and 53 seconds.

Testing Succeeded


Version: versions-04.04.2022-13.46.cfg
Build Log: make-04.04.2022-13.46.log
Server Log: logs-04.04.2022-13.46.tar.gz

Finished