[ERROR]: Not considering db name as param while migrating data from milvus to milvus

[asinghetiq]

Issue

I am trying to migrate collection (present in milvus database (NOT DEFAULT)) from one milvus to another but the migration script is not considering database name as parameter in source and target

Example:

dumper:
  worker:
    workMode: milvus2x
    reader:
      bufferSize: 500

meta:
  mode: config
  version: 2.3.0
  collection: src_table_name

source:
  milvus2x:
    endpoint: {milvus2x_domain}:{milvus2x_port}
    username: xxxx
    password: xxxxx

target:
  milvus2x:
    endpoint: {milvus2x_domain}:{milvus2x_port}
    username: xxxx
    password: xxxxx

Help me out to sort out this issue!

For more Info error i am getting:

jodId is start2FXbeifR8jn8GtIFs9YAC [2024/07/10 09:41:46.409 +05:30] [INFO] [config/config.go:234] ["begin to read config"] [configFile=migration.yaml] [2024/07/10 09:41:46.412 +05:30] [INFO] [config/resolve_milvus2x.go:88] ["meta.fields param not exists, will migrate all fields"] [2024/07/10 09:41:46.412 +05:30] [INFO] [dbclient/milvus2x.go:32] ["begin to new milvus2x client"] [endPoint=xxxxxxxx] [2024/07/10 09:41:46.412 +05:30] [INFO] [dbclient/milvus2x.go:44] ["[Milvus2x] find username not empty, will use NewDefaultGrpcClientWithURI() to new client"] [2024/07/10 09:41:46.456 +05:30] [INFO] [dbclient/milvus2x.go:52] ["[Milvus2x] begin to test connect"] [endpoint=xxx-xxxx-xxxxx] [username=root] [2024/07/10 09:41:46.468 +05:30] [INFO] [cmd/start.go:32] ["[Starter] begin to do migration..."] [2024/07/10 09:41:46.469 +05:30] [INFO] [meta/meta_milvus2x_helper.go:31] ["[MetaMilvus2xHelper] begin to get meta, "] [metaMode=config] [2024/07/10 09:41:46.469 +05:30] [INFO] [meta/meta_milvus2x_helper.go:37] ["Milvus2x Meta Info"] [version=2.3.10] [2024/07/10 09:41:46.469 +05:30] [INFO] [meta/meta_milvus2x_helper.go:39] ["[Milvus2x Meta Static] Collection"] [collection=feedbacks] [2024/07/10 09:41:46.469 +05:30] [INFO] [migration/milvus2x_starter.go:16] ["dump Milvus2x split collections for concurrent work"] [CollectionSize=1] [ConcurLimit=1] [2024/07/10 09:41:46.469 +05:30] [INFO] [milvus2x_factory/milvus2x_factory.go:39] ["[Milvus2x Factory] begin to new milvus2x client"] [endpoint=xxxxxxxx] [version=2.3.10] [2024/07/10 09:41:46.469 +05:30] [WARN] [milvus2x/base.go:41] ["milvus2x version not contain, will use default sdk version"] [Version=2.3.10] [2024/07/10 09:41:46.469 +05:30] [INFO] [milvus2x/milvus2_3_ver.go:114] ["[Milvus23x] begin to new milvus client"] [endPoint=xxxxxxxx] [2024/07/10 09:41:46.469 +05:30] [INFO] [milvus2x/milvus2_3_ver.go:124] ["[Milvus23x] find username not empty, will use NewDefaultGrpcClientWithURI() to new client"] [2024/07/10 09:41:46.499 +05:30] [INFO] [milvus2x/milvus2_3_ver.go:132] ["[Milvus23x] begin to test connect"] [endpoint=xxxx-xxxx-xxxxx] [username=root] [2024/07/10 09:41:46.531 +05:30] [ERROR] [cmd/start.go:34] ["[start migration error]"] [error="can't find collection collection not found[database=default][collection=feedbacks]"] [errorVerbose="can't find collection collection not found[database=default][collection=feedbacks]\n(1) attached stack trace\n -- stack trace:\n | github.com/milvus-io/milvus-sdk-go/v2/client.handleRespStatus\n | \t/Users/ankit/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/[email protected]/client/collection.go:39\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*GrpcClient).DescribeCollection\n | \t/Users/ankit/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/[email protected]/client/collection.go:274\n | github.com/zilliztech/milvus-migration/storage/milvus2x.(*Milvus23VerClient).DescCollection\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/storage/milvus2x/milvus2_3_ver.go:105\n | github.com/zilliztech/milvus-migration/core/transform/milvus2x/convert.ToMilvusParam\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/core/transform/milvus2x/convert/milvus2x_convert.go:17\n | github.com/zilliztech/milvus-migration/core/loader.(*CustomMilvus2xLoader).InitCollectionInfoByMilvus2x\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/core/loader/mode_milvus2x.go:23\n | github.com/zilliztech/milvus-migration/core/task.Milvus2xInitTasker.Init\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/core/task/milvus2x_init_task.go:23\n | github.com/zilliztech/milvus-migration/starter/migration.(*Starter).DumpLoadInMilvus2x\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/starter/migration/milvus2x_starter.go:34\n | github.com/zilliztech/milvus-migration/starter/migration.(*Starter).migrationMilvus2x\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/starter/migration/milvus2x_starter.go:22\n | github.com/zilliztech/milvus-migration/starter/migration.(*Starter).doByWorkMode\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/starter/migration/starter.go:58\n | github.com/zilliztech/milvus-migration/starter/migration.(*Starter).Run\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/starter/migration/starter.go:43\n | github.com/zilliztech/milvus-migration/starter.Start\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/starter/starter.go:109\n | github.com/zilliztech/milvus-migration/cmd.init.func6\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/cmd/start.go:32\n | github.com/spf13/cobra.(*Command).execute\n | \t/Users/ankit/go/pkg/mod/github.com/spf13/[email protected]/command.go:987\n | github.com/spf13/cobra.(*Command).ExecuteC\n | \t/Users/ankit/go/pkg/mod/github.com/spf13/[email protected]/command.go:1115\n | github.com/spf13/cobra.(*Command).Execute\n | \t/Users/ankit/go/pkg/mod/github.com/spf13/[email protected]/command.go:1039\n | github.com/zilliztech/milvus-migration/cmd.Execute\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/cmd/root.go:26\n | main.main\n | \t/Users/ankit/Documents/fittr/microservices/milvus-migration/main.go:16\n | runtime.main\n | \t/usr/local/Cellar/go/1.22.5/libexec/src/runtime/proc.go:271\n | runtime.goexit\n | \t/usr/local/Cellar/go/1.22.5/libexec/src/runtime/asm_amd64.s:1695\nWraps: (2) can't find collection collection not found[database=default][collection=feedbacks]\nError types: (1) *withstack.withStack (2) *errutil.leafError"] [stack="github.com/zilliztech/milvus-migration/cmd.init.func6\n\t/Users/ankit/Documents/fittr/microservices/milvus-migration/cmd/start.go:34\ngithub.com/spf13/cobra.(*Command).execute\n\t/Users/ankit/go/pkg/mod/github.com/spf13/[email protected]/command.go:987\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\t/Users/ankit/go/pkg/mod/github.com/spf13/[email protected]/command.go:1115\ngithub.com/spf13/cobra.(*Command).Execute\n\t/Users/ankit/go/pkg/mod/github.com/spf13/[email protected]/command.go:1039\ngithub.com/zilliztech/milvus-migration/cmd.Execute\n\t/Users/ankit/Documents/fittr/microservices/milvus-migration/cmd/root.go:26\nmain.main\n\t/Users/ankit/Documents/fittr/microservices/milvus-migration/main.go:16\nruntime.main\n\t/usr/local/Cellar/go/1.22.5/libexec/src/runtime/proc.go:271"]

Suggestion

No response

Anything else?

No response