Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CKB node doesn't update #4041

Closed
Keith-CY opened this issue Jun 24, 2023 · 6 comments
Closed

CKB node doesn't update #4041

Keith-CY opened this issue Jun 24, 2023 · 6 comments
Labels
stale To be closed due to a lack of activity t:bug Type: This doesn't seem right.

Comments

@Keith-CY
Copy link
Contributor

Bug Report

Current Behavior

The node was started at 15:22, with block height 10236035, but it synced nothing since then.
Now it's 15:40, and the following logs can be found in run.log(last modified at 15:22).

2023-06-18 08:24:25.720 +00:00 GlobalRt-4 INFO ckb_indexer::service  append 10236035, Byte32(0x273f141ecd456651af7298674e2e60775d91bc0487e79e898d248930aa9f8805)
2023-06-18 08:25:27.175 +00:00 main INFO ckb_bin::subcommand::run  Finishing work, please wait...
2023-06-18 08:25:27.175 +00:00 main INFO ckb_tx_pool::service  Please be patient, tx-pool are saving data into disk ...
2023-06-18 08:25:27.180 +00:00 main INFO ckb_stop_handler  StopHandler(network) send signal
2023-06-18 08:25:27.180 +00:00 main INFO ckb_stop_handler  StopHandler(chain) send signal
2023-06-18 08:25:27.180 +00:00 GlobalRt-0 INFO ckb_network::network  p2p service event: ListenClose { address: "/ip4/0.0.0.0/tcp/8115" }
2023-06-18 08:25:27.180 +00:00 GlobalRt-6 INFO ckb_stop_handler  StopHandler(HeaderMap) send signal
2023-06-18 08:25:27.180 +00:00 main INFO ckb_stop_handler  StopHandler(tx-pool) send signal
2023-06-24 15:22:30.694 +00:00 main INFO sentry  sentry is disabled
2023-06-24 15:22:30.694 +00:00 main INFO ckb_bin::helper  raise_fd_limit newly-increased limit: 245760
2023-06-24 15:22:30.774 +00:00 main INFO ckb_bin::subcommand::run  ckb version: 0.110.0 (0679b11 2023-05-16)
2023-06-24 15:22:30.774 +00:00 main INFO ckb_launcher  Miner is disabled, edit ckb.toml to enable it
2023-06-24 15:22:31.212 +00:00 main INFO ckb_memory_tracker::process  track current process: unsupported
2023-06-24 15:22:31.212 +00:00 main INFO ckb_launcher  chain genesis hash: 0x92b197aa1fba0f63633922c61c92375c9c074a93e85963554f5499fe1450d0e5
2023-06-24 15:22:31.213 +00:00 main INFO ckb_sync::types  header_map.memory_limit 600MB
2023-06-24 15:22:43.654 +00:00 GlobalRt-0 INFO ckb_network::network  Listen on address: /ip4/0.0.0.0/tcp/8115
2023-06-24 15:22:43.655 +00:00 GlobalRt-0 INFO ckb_network::network  p2p service event: ListenStarted { address: "/ip4/0.0.0.0/tcp/8115" }
2023-06-24 15:22:43.980 +00:00 main INFO ckb_rpc::server  Listen HTTP RPCServer on address 127.0.0.1:8114
2023-06-24 15:22:44.033 +00:00 main INFO ckb_tx_pool::service  Loading persisted tx-pool data, total 7 txs
2023-06-24 15:22:44.067 +00:00 main INFO ckb_tx_pool::service  Persisted tx-pool data is loaded

The log stopped at 15:22, but the ckb process is still running.

image

I've checked the log, but still no update.

Expected Behavior

The block number grows and log should keep updating

Environment

  • CKB version: v0.110.0
  • Chain: mainnet
  • Operating system: MacOS 13.2.1 (22D68)
  • Arch: arm64
  • Installation: Built-in Node of Neuron

Additional context/Screenshots

Cannot be fixed by restarting the node

2023-06-24 15:22:30.694 +00:00 main INFO sentry  sentry is disabled
2023-06-24 15:22:30.694 +00:00 main INFO ckb_bin::helper  raise_fd_limit newly-increased limit: 245760
2023-06-24 15:22:30.774 +00:00 main INFO ckb_bin::subcommand::run  ckb version: 0.110.0 (0679b11 2023-05-16)
2023-06-24 15:22:30.774 +00:00 main INFO ckb_launcher  Miner is disabled, edit ckb.toml to enable it
2023-06-24 15:22:31.212 +00:00 main INFO ckb_memory_tracker::process  track current process: unsupported
2023-06-24 15:22:31.212 +00:00 main INFO ckb_launcher  chain genesis hash: 0x92b197aa1fba0f63633922c61c92375c9c074a93e85963554f5499fe1450d0e5
2023-06-24 15:22:31.213 +00:00 main INFO ckb_sync::types  header_map.memory_limit 600MB
2023-06-24 15:22:43.654 +00:00 GlobalRt-0 INFO ckb_network::network  Listen on address: /ip4/0.0.0.0/tcp/8115
2023-06-24 15:22:43.655 +00:00 GlobalRt-0 INFO ckb_network::network  p2p service event: ListenStarted { address: "/ip4/0.0.0.0/tcp/8115" }
2023-06-24 15:22:43.980 +00:00 main INFO ckb_rpc::server  Listen HTTP RPCServer on address 127.0.0.1:8114
2023-06-24 15:22:44.033 +00:00 main INFO ckb_tx_pool::service  Loading persisted tx-pool data, total 7 txs
2023-06-24 15:22:44.067 +00:00 main INFO ckb_tx_pool::service  Persisted tx-pool data is loaded
2023-06-24 15:49:21.245 +00:00 main INFO sentry  sentry is disabled
2023-06-24 15:49:21.245 +00:00 main INFO ckb_bin::helper  raise_fd_limit newly-increased limit: 245760
2023-06-24 15:49:21.328 +00:00 main INFO ckb_bin::subcommand::run  ckb version: 0.110.0 (0679b11 2023-05-16)
2023-06-24 15:49:21.328 +00:00 main INFO ckb_launcher  Miner is disabled, edit ckb.toml to enable it
2023-06-24 15:49:21.412 +00:00 main INFO ckb_memory_tracker::process  track current process: unsupported
2023-06-24 15:49:21.412 +00:00 main INFO ckb_launcher  chain genesis hash: 0x92b197aa1fba0f63633922c61c92375c9c074a93e85963554f5499fe1450d0e5
2023-06-24 15:49:21.412 +00:00 main INFO ckb_sync::types  header_map.memory_limit 600MB
2023-06-24 15:49:22.273 +00:00 main INFO sentry  sentry is disabled
2023-06-24 15:49:22.273 +00:00 main INFO ckb_bin::helper  raise_fd_limit newly-increased limit: 245760
2023-06-24 15:49:22.339 +00:00 main INFO ckb_bin::subcommand::run  ckb version: 0.110.0 (0679b11 2023-05-16)
2023-06-24 15:49:22.339 +00:00 main INFO ckb_launcher  Miner is disabled, edit ckb.toml to enable it
2023-06-24 15:49:22.418 +00:00 main INFO ckb_memory_tracker::process  track current process: unsupported
2023-06-24 15:49:22.418 +00:00 main INFO ckb_launcher  chain genesis hash: 0x92b197aa1fba0f63633922c61c92375c9c074a93e85963554f5499fe1450d0e5
2023-06-24 15:49:22.418 +00:00 main INFO ckb_sync::types  header_map.memory_limit 600MB
2023-06-24 15:49:34.674 +00:00 GlobalRt-1 INFO ckb_network::network  Listen on address: /ip4/0.0.0.0/tcp/8115
2023-06-24 15:49:34.674 +00:00 GlobalRt-1 INFO ckb_network::network  p2p service event: ListenStarted { address: "/ip4/0.0.0.0/tcp/8115" }
2023-06-24 15:49:34.729 +00:00 main INFO ckb_rpc::server  Listen HTTP RPCServer on address 127.0.0.1:8114
2023-06-24 15:49:34.757 +00:00 main INFO ckb_tx_pool::service  Loading persisted tx-pool data, total 7 txs
2023-06-24 15:49:34.787 +00:00 main INFO ckb_tx_pool::service  Persisted tx-pool data is loaded
@Keith-CY Keith-CY added the t:bug Type: This doesn't seem right. label Jun 24, 2023
@eval-exec
Copy link
Collaborator

Cannot be fixed by restarting the node

Could you please change logger.filter to "debug" in ckb.toml, and restart node again?

@Keith-CY
Copy link
Contributor Author

Cannot be fixed by restarting the node

Could you please change logger.filter to "debug" in ckb.toml, and restart node again?

The built-in CKB node starts synchronization after restarting with logger.filter = debug, lol

@eval-exec
Copy link
Collaborator

eval-exec commented Jul 18, 2023 •
edited
Loading

Hello @Keith-CY ,

I think we can use RPC methods sync_state and get_peers to get more debug info when there is a synchronization issue.

For example:

curl -X POST https://127.0.0.1:8114 \
-H 'Content-Type: application/json' \
-d '{ "id": 42, "jsonrpc": "2.0", "method": "sync_state", "params": [ ] }'
curl -X POST https://127.0.0.1:8114 \
-H 'Content-Type: application/json' \
-d '{ "id": 42, "jsonrpc": "2.0", "method": "get_peers", "params": [ ] }'

@Keith-CY
Copy link
Contributor Author

Hello @Keith-CY ,

I think we can use RPC methods sync_state and get_peers to get more debug info when there is a synchronization issue.

For example:

curl -X POST https://127.0.0.1:8114 \
-H 'Content-Type: application/json' \
-d '{ "id": 42, "jsonrpc": "2.0", "method": "sync_state", "params": [ ] }'
curl -X POST https://127.0.0.1:8114 \
-H 'Content-Type: application/json' \
-d '{ "id": 42, "jsonrpc": "2.0", "method": "get_peers", "params": [ ] }'

Got it, and I will have a try when it runs into the same case

@devchenyan devchenyan mentioned this issue Jun 4, 2024
Closed
@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 2, 2024

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

@github-actions github-actions bot added the stale To be closed due to a lack of activity label Aug 2, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 7, 2024

This issue was closed because it has been stalled for 5 days with no activity.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Aug 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
stale To be closed due to a lack of activity t:bug Type: This doesn't seem right.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Keith-CY @eval-exec