[Bug]: I took a backup of a collection in the cluster and then tested the restore, but only created the collection, no data was inserted

[li904775857]

Current Behavior

edition
milvus cluster : 2.2.31
milvus-backup: 0.3.3

Cluster deployment
k8s

describe
The pulsar-bookie-ledgers-milvusdata-pulsar-bookie log was deleted

data
There are 1 million data in the collection to be backed up

logs
[GIN] 2023/10/26 - 19:30:40 | 200 | 9.666623ms | 10.10.10.3 | POST "/api/v1/create"
[2023/10/26 19:30:40.207 +08:00] [INFO] [core/backup_impl_create_backup.go:248] ["collections to backup"] [collections="[chinese_embedding_flag]"]
[2023/10/26 19:30:40.227 +08:00] [INFO] [core/backup_impl_create_backup.go:285] ["try to get index"] [collection_name=chinese_embedding_flag]
[2023/10/26 19:30:40.263 +08:00] [INFO] [core/backup_impl_create_backup.go:305] ["field index"] [collection_name=chinese_embedding_flag] [field_name=only_id] ["index info"="[{}]"]
[2023/10/26 19:30:40.287 +08:00] [INFO] [core/backup_impl_create_backup.go:305] ["field index"] [collection_name=chinese_embedding_flag] [field_name=embedding] ["index info"="[{}]"]
[2023/10/26 19:30:40.311 +08:00] [INFO] [core/backup_impl_create_backup.go:398] ["GetPersistentSegmentInfo before flush from milvus"] [collectionName=chinese_embedding_flag] [segmentNumBeforeFlush=0]
[2023/10/26 19:30:41.136 +08:00] [INFO] [core/backup_impl_create_backup.go:407] ["flush segments"] [collectionName=chinese_embedding_flag] [newSealedSegmentIDs="[445157764551563229]"] [flushedSegmentIDs="[]"] [timeOfSeal=1698319840]
[2023/10/26 19:30:41.141 +08:00] [INFO] [core/backup_impl_create_backup.go:420] ["GetPersistentSegmentInfo after flush from milvus"] [collectionName=chinese_embedding_flag] [segmentNumBeforeFlush=0] [segmentNumAfterFlush=1]
[2023/10/26 19:30:41.141 +08:00] [INFO] [core/backup_impl_create_backup.go:457] ["Finished fill segment"] [collectionName=chinese_embedding_flag]
[2023/10/26 19:30:41.153 +08:00] [WARN] [core/backup_impl_create_backup.go:468] ["this segment has no insert binlog"] [id=445157764551563229]
[2023/10/26 19:30:41.153 +08:00] [INFO] [core/backup_impl_create_backup.go:474] ["readSegmentInfo from storage"] [collectionName=chinese_embedding_flag] [segmentNum=1]
[2023/10/26 19:30:41.153 +08:00] [INFO] [core/backup_impl_create_backup.go:506] ["finish build partition info"] [collectionName=chinese_embedding_flag] [partitionNum=1]
[2023/10/26 19:30:41.153 +08:00] [INFO] [core/backup_impl_create_backup.go:510] ["Begin copy data"] [collectionName=chinese_embedding_flag] [segmentNum=1]
[2023/10/26 19:30:41.153 +08:00] [INFO] [core/backup_impl_create_backup.go:540] ["partition size is smaller than MaxSegmentGroupSize, won't separate segments into groups in backup files"] [collectionId=445157764551563151] [partitionId=445157764551563152] [partitionSize=0] [MaxSegmentGroupSize=2147483648]
[2023/10/26 19:30:41.282 +08:00] [INFO] [core/backup_impl_create_backup.go:579] ["finish executeCreateBackup"] [requestId=17658440-73f3-11ee-b6d7-0050569dbeb3] [backupName=chinese_embedding_flag] [collections="[chinese_embedding_flag]"] [async=true] ["backup meta"="{"id":"17658440-73f3-11ee-b6d7-0050569dbeb3","state_code":2,"start_time":1698319840193,"end_time":1698319841153,"name":"chinese_embedding_flag","backup_timestamp":1698319840193,"size":0,"milvus_version":"v2.2.13"}"]
[2023/10/26 19:31:24.387 +08:00] [INFO] [core/backup_impl_restore_backup.go:25] ["receive RestoreBackupRequest"] [requestId=31be5ad3-73f3-11ee-b6d7-0050569dbeb3] [backupName=chinese_embedding_flag] [collections="[chinese_embedding_flag]"] [CollectionSuffix=_bak] [CollectionRenames=null] [async=true] [bucketName=] [path=] [databaseCollections=]
[2023/10/26 19:31:24.387 +08:00] [INFO] [core/backup_context.go:183] ["receive GetBackupRequest"] [requestId=31be621c-73f3-11ee-b6d7-0050569dbeb3] [backupName=chinese_embedding_flag] [backupId=] [bucketName=] [path=]
[2023/10/26 19:31:24.387 +08:00] [INFO] [core/backup_context.go:248] ["finish GetBackupRequest"] [requestId=31be621c-73f3-11ee-b6d7-0050569dbeb3] [backupName=chinese_embedding_flag] [backupId=] [bucketName=] [path=] [resp="requestId:"31be621c-73f3-11ee-b6d7-0050569dbeb3" msg:"success" data:<id:"17658440-73f3-11ee-b6d7-0050569dbeb3" state_code:BACKUP_SUCCESS start_time:1698319840193 end_time:1698319841153 name:"chinese_embedding_flag" backup_timestamp:1698319840193 collection_backups:<id:"17754539-73f3-11ee-b6d7-0050569dbeb3" start_time:1698319840 collection_id:445157764551563151 db_name:"default" collection_name:"chinese_embedding_flag" schema:<name:"chinese_embedding_flag" description:"bge-large-zh\346\250\241\345\236\213\350\275\254\347\232\204\345\220\221\351\207\217" fields:<fieldID:100 name:"only_id" is_primary_key:true data_type:VarChar type_params:<key:"max_length" value:"100" > > fields:<fieldID:101 name:"embedding" data_type:FloatVector type_params:<key:"dim" value:"1024" > > > shards_num:1 consistency_level:Bounded partition_backups:<partition_id:445157764551563152 partition_name:"_default" collection_id:445157764551563151 segment_backups:<segment_id:445157764551563229 collection_id:445157764551563151 partition_id:445157764551563152 num_of_rows:12202 deltalogs:<> > load_state:"NotLoad" > backup_timestamp:445204356136960 has_index:true index_infos:<field_name:"embedding" index_name:"_default_idx_101" index_type:"HNSW" params:<key:"index_type" value:"HNSW" > params:<key:"metric_type" value:"IP" > params:<key:"params" value:"{\"M\": 64, \"efConstruction\": 256}" > > load_state:"NotLoad" backup_physical_timestamp:1698319840 > milvus_version:"v2.2.13" > "]
[2023/10/26 19:31:24.387 +08:00] [INFO] [core/backup_impl_restore_backup.go:164] ["Collections to restore"] [collection_num=1]
[GIN] 2023/10/26 - 19:31:24 | 200 | 14.395878ms | 10.10.10.3 | POST "/api/v1/restore"
[2023/10/26 19:31:24.399 +08:00] [INFO] [core/backup_impl_restore_backup.go:314] ["executeRestoreBackupTask start"] [backup_name=chinese_embedding_flag] [backupBucketName=a-bucket] [backupPath=backup/chinese_embedding_flag]
[2023/10/26 19:31:24.399 +08:00] [INFO] [core/backup_impl_restore_backup.go:357] ["start restore"] [db_name=default] [collection_name=chinese_embedding_flag_bak] [backupBucketName=a-bucket] [backupPath=backup/chinese_embedding_flag]
[2023/10/26 19:31:24.399 +08:00] [INFO] [core/backup_impl_restore_backup.go:383] ["collection schema"] [fields="[{"ID":100,"Name":"only_id","PrimaryKey":true,"AutoID":false,"Description":"","DataType":21,"TypeParams":{"max_length":"100"},"IndexParams":{},"IsDynamic":false,"IsPartitionKey":false},{"ID":101,"Name":"embedding","PrimaryKey":false,"AutoID":false,"Description":"","DataType":101,"TypeParams":{"dim":"1024"},"IndexParams":{},"IsDynamic":false,"IsPartitionKey":false}]"]
[2023/10/26 19:31:24.459 +08:00] [INFO] [core/backup_impl_restore_backup.go:418] ["create collection"] [database=default] [collectionName=chinese_embedding_flag_bak] [hasPartitionKey=false]
[2023/10/26 19:31:24.462 +08:00] [INFO] [core/backup_impl_restore_backup.go:451] ["create partition"] [collectionName=chinese_embedding_flag_bak] [partitionName=_default]
[2023/10/26 19:31:24.462 +08:00] [INFO] [core/backup_impl_restore_backup.go:625] [getBackupPartitionPaths] [bucketName=a-bucket] [backupPath=backup/chinese_embedding_flag] [partitionID=445157764551563152]
[2023/10/26 19:31:24.483 +08:00] [INFO] [core/backup_impl_restore_backup.go:593] ["bulkinsert task state"] [id=445157764551763825] [state=2] [state="{"ID":445157764551763825,"State":2,"RowCount":0,"IDList":null,"Infos":{"backup":"true","collection":"chinese_embedding_flag_bak","end_ts":"445204356136960","failed_reason":"","files":"backup/chinese_embedding_flag/binlogs/insert_log/445157764551563151/445157764551563152/,","partition":"_default"},"CollectionID":445157764551763821,"SegmentIDs":null,"CreateTs":1698319884}"] [progress=0] [currentTimestamp=1698319884] [lastUpdateTime=1698319884]
[2023/10/26 19:31:29.490 +08:00] [INFO] [core/backup_impl_restore_backup.go:593] ["bulkinsert task state"] [id=445157764551763825] [state=6] [state="{"ID":445157764551763825,"State":6,"RowCount":0,"IDList":null,"Infos":{"backup":"true","collection":"chinese_embedding_flag_bak","end_ts":"445204356136960","failed_reason":"","files":"backup/chinese_embedding_flag/binlogs/insert_log/445157764551563151/445157764551563152/,","partition":"_default","persist_cost":"0.02","progress_percent":"100"},"CollectionID":445157764551763821,"SegmentIDs":null,"CreateTs":1698319884}"] [progress=100] [currentTimestamp=1698319889] [lastUpdateTime=1698319884]
[2023/10/26 19:31:29.490 +08:00] [INFO] [core/backup_impl_restore_backup.go:335] ["finish restore collection"] [db_name=default] [collection_name=chinese_embedding_flag_bak]

Expected Behavior

No response

Steps To Reproduce

No response

Environment

No response

Anything else?

No response

[fuzzyzz]

Faced the same problem. I backup data from a standalone milvus which deployed by docker compose, and restore these data into another standalone milvus instance which deployed by helm in a k8s cluster. Only collections been created, every collection is empty.
By the way, the backup tool even said that the restore process succeed, emm…… I don't know what happened.

[IshanFernandoClouda]

milvus-backup/configs/backup.yaml

Lines 34 to 42 in 69c0905

	bucketName: "a-bucket" # Milvus Bucket name in MinIO/S3, make it the same as your milvus instance
	rootPath: "files" # Milvus storage root path in MinIO/S3, make it the same as your milvus instance
	# only for azure
	backupAccessKeyID: minioadmin # accessKeyID of MinIO/S3
	backupSecretAccessKey: minioadmin # MinIO/S3 encryption string
	backupBucketName: "a-bucket" # Bucket name to store backup data. Backup data will store to backupBucketName/backupRootPath
	backupRootPath: "backup" # Rootpath to store backup data. Backup data will store to backupBucketName/backupRootPath

make sure that the bucket names are correct

[axiangcoding]

Same issue here.
I try to backup some collecltion from one milvus to another mivlus but failed because of missing data and missing indexes.
However, collection was created successfully.

[IshanFernandoClouda]

what is the output of ./milvus-backup check command

[divyajaincs]

Same issue facing with Milvus 2.3.3, not even collection created when i'm taking the restore, but it showing that backup and restore is done successfully.

[divyajaincs]

what is the output of ./milvus-backup check command

getting the proper result of this