Skip to content

Custom consumer state check-pointing#29

Open
kevinballard wants to merge 4 commits intoNerdWalletOSS:masterfrom
kevinballard:master
Open

Custom consumer state check-pointing#29
kevinballard wants to merge 4 commits intoNerdWalletOSS:masterfrom
kevinballard:master

Conversation

@kevinballard
Copy link

  • Add the ability to save a custom consumer state along with the log offset, allowing for stateful consumers to stop and resume gracefully
  • Maintains the original API when using KinesisConsumer directly as an iterator
  • Also emit shard_id with the "rich" generator
  • Allow an optional consumer name so that state for multiple consumers of the same stream can exist in the same DynamoDB table
  • Update README examples to Python 3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant