Skip to content

feature(datashare python): vector search - #128

Merged
ClemDoum merged 14 commits into
mainfrom
feature(datashare-python)/vector-search
Nov 16, 2026
Merged

ClemDoum merged 14 commits into
mainfrom
feature(datashare-python)/vector-search

Conversation

@ClemDoum

@ClemDoum ClemDoum commented Nov 10, 2026 •

Copy link
Copy Markdown
Contributor

Description

Addresses #121

Create a similar document search using ES MTL + ES KNN using vector search based on document chunks:

extract_worker search similar-docs

Changes

datashare-python

Changed

  • bumped icij-python[elasticsearch] to icij-python[elasticsearch-8] to benefit from ES version 8

extract-core

Added

  • add the extract_worker search similar-docs CLI
  • added the ESRetriever and with the async def retrieve_similar(self, search: SimilarDocSearch, top_k: int = 100) -> list[Document] API
  • implemented a ESRetriever
  • added the python -m extract_core config get-default docling CLI entry point

.github

Changed

  • factorized linting and fortting test to be consistent with ruff execution from the uv virtualenv

@ClemDoum
ClemDoum force-pushed the feature(datashare-python)/vector-search branch from 6169bad to d6dfe7b Compare November 10, 2026 17:44
@ClemDoum ClemDoum changed the title Feature(datashare python)/vector search feature(datashare python): vector search Nov 10, 2026
@ClemDoum
ClemDoum force-pushed the feature(datashare-python)/vector-search branch 2 times, most recently from ba8c19e to 7ecbc64 Compare November 12, 2026 10:30
@ClemDoum
ClemDoum force-pushed the feature(datashare-python)/vector-search branch from 7ecbc64 to a89a5c4 Compare November 12, 2026 10:43
@ClemDoum
ClemDoum force-pushed the feature(datashare-python)/vector-search branch 5 times, most recently from 2c4506d to 87b7538 Compare November 13, 2026 17:54
@ClemDoum
ClemDoum force-pushed the feature(datashare-python)/vector-search branch from 87b7538 to 945d0cd Compare November 16, 2026 08:23
@ClemDoum
ClemDoum marked this pull request as ready for review November 16, 2026 08:42
@ClemDoum
ClemDoum merged commit 52bbc5b into main Nov 16, 2026
15 checks passed
@ClemDoum
ClemDoum deleted the feature(datashare-python)/vector-search branch November 16, 2026 08:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant