Repository navigation
Conversation
…ngestion Add a Data Integration page describing how Doris queries Iceberg tables replicated by OLake Go, and link to it from the Iceberg Catalog and Doris + Iceberg best-practice docs where readers look for how to populate Iceberg tables.
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Versions
Languages
Docs Checklist
What
Adds a Data Integration page for OLake Go, an open-source EL tool that replicates operational databases into Apache Iceberg tables (with CDC), which Doris then queries through an Iceberg Catalog.
Why
The Data Integration section currently lists tools that write straight into Doris (CloudCanal, DataX, SeaTunnel, etc.). For users building a lakehouse on Iceberg, a common question is how to keep Iceberg tables fed from a transactional database so Doris can query them. This page covers that path and notes the Doris version requirements for the delete formats involved (positional/equality deletes on 3.x and 4.0, deletion vectors on 4.1.0+), which match what the Iceberg Catalog doc already states.
Changes
docs/connection-integration/data-integration/olake.md– new integration pagedocs/connection-integration/data-integration/intro.mdx– card under "Data Migration, Synchronization, and Bulk Loading"sidebars.ts– sidebar entry (alphabetical)docs/lakehouse/catalogs/iceberg-catalog.mdx– short tip after "Applicable Scenarios" pointing to the integration guidedocs/lakehouse/best-practices/doris-iceberg.md– short tip after the data insertion sectionAll external links were checked and resolve. Happy to drop the two lakehouse tips if you'd rather keep that section to native Doris features only.