-
Notifications
You must be signed in to change notification settings - Fork 684
feat(materialize): add new backend for Materialize streaming database #11703
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
feat(materialize): add new backend for Materialize streaming database #11703
Conversation
35b0a11 to
349400c
Compare
|
@jasonhernandez Thanks for the PR! I will try to give it a review this weekend or later this evening. It looks like the materialize test suite is timing out at 60 minutes. Any idea what's going on there? |
cpcloud
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks very good! This is one of the most thorough initial backend PRs I've ever seen, great work.
A few comments, mostly around exception handling and too-broad-try clauses.
d7a9d8a to
ef1e1d8
Compare
This commit adds comprehensive support for Materialize, including: - Core backend implementation with cluster and connection management - Support for materialized views, indexes, sources, sinks, and secrets - Idiomatic Materialize SQL patterns (mz_now(), SUBSCRIBE, etc.) - Test coverage for Materialize-specific features - Integration with existing Ibis test suite
39004fc to
46a9f19
Compare
I was hoping you might have known of something obvious that might cause that timeout. I'm going to investigate it further. |
46a9f19 to
7e62c90
Compare
7e62c90 to
bf29fa1
Compare
Description of changes
Adds a Materialize backend for Ibis
This PR introduces a new backend for Materialize, a live data layer with native support for generalized incremental view maintenance. Materialize strives to maintain PostgreSQL wire compatibility, but it offers a number of unique capabilities that require expanding beyond the existing Postgres backend for Materialize users. In particular, Materialize provides:
The Materialize team is excited to collaborate with the Ibis community and is committed to maintaining and improving this backend going forward.