Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MySQL support for bulk inserts, deletes by reading multiple event rows #103

Merged
merged 3 commits into from
Aug 8, 2024

Conversation

KDMW-IO
Copy link
Contributor

@KDMW-IO KDMW-IO commented May 20, 2024

MySQL support for bulk inserts, deletes by reading multiple event

Description

Refactor binlog event processing to support bulk operations.

Instead of assuming the ifrst index of event.rows contains the full pyload of the binlog event, we iterate through the full event, picking up additional inserts, deletes.

Testing

Tested against an a hosted MySQL instance. Flows from our backend that were leading to meilisearch being out of sync are now working as expected.

Related Issue

#93

Instead of assuming the ifrst index of event.rows contains the full pyload of the binlog event, we iterate through the full event,  picking up additional inserts, deletes ..
@KDMW-IO KDMW-IO marked this pull request as draft May 20, 2024 14:09
@KDMW-IO KDMW-IO marked this pull request as ready for review May 20, 2024 14:10
@KDMW-IO KDMW-IO changed the title MySQL support for bulk inserts, deletes by reading multiple event MySQL support for bulk inserts, deletes by reading multiple event rows May 21, 2024
@KDMW-IO

This comment was marked as resolved.

@long2ice long2ice merged commit ab1a5ed into long2ice:dev Aug 8, 2024
@long2ice
Copy link
Owner

long2ice commented Aug 8, 2024

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants