Skip to content

test(storage-engine): add integration tests for WAL, compaction, CDC, and gossip/sharding#3

Open
poyrazK wants to merge 3 commits into
mainfrom
release/integration-tests
Open

test(storage-engine): add integration tests for WAL, compaction, CDC, and gossip/sharding#3
poyrazK wants to merge 3 commits into
mainfrom
release/integration-tests

Conversation

@poyrazK

@poyrazK poyrazK commented Jun 10, 2026

Copy link
Copy Markdown
Owner

Summary

Add 4 new integration test files with 18 total tests covering component interactions:

New Test Files

  1. **** (5 tests)

    • Committed writes surviving full compaction and restart
    • Uncommitted writes replaying from WAL on restart
    • Delete/tombestone survival through compaction cycles
    • Multi-key data surviving compaction and recovery
    • Overwritten keys recovering correct latest value
  2. **** (4 tests)

    • Concurrent reads during compaction
    • Concurrent writes during compaction
    • Data correctness after multiple compaction cycles
    • Tombestone isolation during compaction
  3. **** (4 tests)

    • Multiple puts emitting multiple CDC events
    • Delete operations emitting DELETE event type
    • Update operations producing PUT events
    • CDC events having incrementing sequence numbers
  4. **** (5 tests)

    • Node join triggering ring updates
    • Concurrent writes during node rebalance
    • Node failure detection and data availability
    • Multi-node gossip discovery
    • Data availability during ownership changes

Modified Files

    • Added imports for all new test files

All 18 new tests pass alongside the existing 120+ tests.

poyrazK added 3 commits June 10, 2026 18:56
Add wal_compaction_recovery_tests.zig with 5 tests covering:
- Committed writes surviving full compaction and restart
- Uncommitted writes replaying from WAL on restart
- Delete/tombestone survival through compaction cycles
- Multi-key data surviving compaction and recovery
- Overwritten keys recovering correct latest value

Add compaction_transaction_tests.zig with 4 tests covering:
- Concurrent reads during compaction
- Concurrent writes during compaction
- Data correctness after multiple compaction cycles
- Tombestone isolation during compaction

Add cdc_transaction_tests.zig with 4 tests covering:
- Multiple puts emitting multiple CDC events
- Delete operations emitting DELETE event type
- Update operations producing PUT events
- CDC events having incrementing sequence numbers
Add gossip_sharding_rebalance_tests.zig with 5 tests covering:
- Node join triggering ring updates
- Concurrent writes during node rebalance
- Node failure detection and data availability
- Multi-node gossip discovery
- Data availability during ownership changes

Also update run_tests.zig to import all new test files.
…tion

- Add trailing newline to cdc_transaction_tests.zig
- Add trailing newline to compaction_transaction_tests.zig
- Add trailing newline to gossip_sharding_rebalance_tests.zig
- Add trailing newline to wal_compaction_recovery_tests.zig
- Remove unused getEngineCallbacks() function from compaction_transaction_tests.zig
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant