Uh oh!
There was an error while loading. Please reload this page.
Asynchronous snapshot upload - #574
Conversation
Uh oh!
There was an error while loading. Please reload this page.
psarna
commented
Aug 11, 2023
I'm on vacation next two weeks, so just to keep priorities straight - either this PR, or #547, need to be applied, so that we're 100% sure we don't have autocheckpoint enabled on connections, and only control the checkpoints ourselves. More importantly, in the fiber that performs the checkpoint, we need to make sure that it's performed from a connection that has our custom WAL methods registered, so that we call the sqld/sqld/src/replication/primary/logger.rs Line 171 in bb27f19 |
a20241f to
5ae39a2Compareafc814a to
eac46d2CompareUh oh!
There was an error while loading. Please reload this page.
eac46d2 to
495d77cCompareHorusiath
commented
Aug 29, 2023
495d77c to
c9126e1CompareUh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Build on top of #547
This PR introduces async DB file snapshotting. Basically when checkpoint happens, we trigger asynchronous DB file backup. If the next checkpoint happens, it first waits until previous snapshot upload completes before continuing.