Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CN Node failed to parse protobuf file #51952

Open
THyyy opened this issue Oct 16, 2024 · 0 comments
Open

CN Node failed to parse protobuf file #51952

THyyy opened this issue Oct 16, 2024 · 0 comments
Assignees
Labels
type/bug Something isn't working

Comments

@THyyy
Copy link

THyyy commented Oct 16, 2024

Steps to reproduce the behavior (Required)

  1. update StarRocks from 3.3.0 to 3.3.3
  2. updata CN Node machine from 32C 128GB to 48C 192GB
  3. Despite the degraded query performance, the CPU and memory usage remain low, indicating that the issue may not be related to resource exhaustion.

Expected behavior (Required)

Hope the query can be processed normally

Real behavior (Required)

FE Master Node fe.log has many messages about:

2024-10-16 10:05:51.585+08:00 ERROR (lake-publish-task-892|1957) [PublishVersionDaemon.publishPartitionBatch():556] Fail to publish partition 62603087 of txnIds [27558540, 27550450, 27560998, 27565181, 27568113, 27569783, 27573565, 27576682, 27577590, 27577632]:
com.starrocks.rpc.RpcException: Fail to publish version for tablets [62603096, 62603094]: failed to parse protobuf file staros://62603094/meta/0000000003BB3F56_00000000000079AA.meta, host: 172.26.12.48
        at com.starrocks.lake.Utils.publishVersionBatch(Utils.java:153) ~[starrocks-fe.jar:?]
        at com.starrocks.transaction.PublishVersionDaemon.publishPartitionBatch(PublishVersionDaemon.java:546) ~[starrocks-fe.jar:?]
        at com.starrocks.transaction.PublishVersionDaemon.lambda$publishLakeTransactionBatchAsync$12(PublishVersionDaemon.java:665) ~[starrocks-fe.jar:?]
        at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
        at java.lang.Thread.run(Thread.java:834) ~[?:?]

CN Node cn.INFO has many messages about:

W20241016 09:50:45.485547 139647527155264 lake_service.cpp:225] Fail to publish version: Corruption: failed to parse protobuf file staros://63296796/meta/0000000003C5D51C_0000000000006974.meta
be/src/storage/lake/tablet_manager.cpp:235 file.load(metadata.get(), fill_cache)
be/src/storage/lake/tablet_manager.cpp:262 value_or_err_L262. tablet_id=63296796 txn_ids=txn_id: 27568183
commit_time: 1728973119
combined_txn_log: false
txn_type: TXN_NORMAL
force_publish: false
;txn_id: 27568197
commit_time: 1728973137
combined_txn_log: false
txn_type: TXN_NORMAL
force_publish: false
;txn_id: 27568324
commit_time: 1728973317
combined_txn_log: false
txn_type: TXN_NORMAL
force_publish: false
;txn_id: 27568391
commit_time: 1728

StarRocks version (Required)

  • 3.3.3
@THyyy THyyy added the type/bug Something isn't working label Oct 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants