-
Notifications
You must be signed in to change notification settings - Fork 113
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Using Kafka as WAL backend, Really Not lost data when node crash? #131
Comments
A1: Your code has to store the kafka-offset in your rocksdb database. It is outside the rocksdb-cloud code because rockdb-cloud is not aware of kafka at all |
Thanks for your attention. When WAL contains |
Q1: how to acquire the offset of Kafka when nodes restart
When using Kafka as the WAL backend, but the machine of the Writer crash such as
node00
, then I set up a new node remotely such asnode01
, then thenode01
will fetch all SSTs from s3. But how doesnode01
acquire the really offset of Kafka?Q2: function of Local cache in
CloudLogControllerImpl
How does the function of the cache directory on the local machine in
CloudLogControllerImpl::GetCacheDir
class?The text was updated successfully, but these errors were encountered: