Determined vault search and link graph
State: open/building · Kind: module · Audience: system
Summary
Section titled “Summary”- Rust library that indexes a vault for hybrid search (SQLite FTS5 plus Ollama embeddings) and builds the wikilink graph from one shared incremental walk.
- It enforces a machine-local access plane so out-of-scope notes never appear in results, counts or ranking.
Statement
Section titled “Statement”Search and graph both read every visible note and parse its frontmatter. This crate does that once in a shared walk, then feeds a derived FTS5/embedding index and an in-memory link graph. Search results are fused from keyword and vector rankers. Access control is a security control, not a filter. Scope membership is joined inside the SQL, and note-declared visibility narrows candidates after fusion. The access config lives outside the vault and the checkout so note authors cannot widen exposure.
What it provides
Section titled “What it provides”- One incremental vault walk with frontmatter parse and tag extraction (walk).
- FTS5 plus embedding index with chunking, upsert and removal (indexer, chunk, db, embeddings).
- Hybrid search with rank fusion and a scoped query path (query, fuse, access).
- Wikilink graph build, history and saved views (graph).
- IndexBackend (the SearchPort and GraphPort implementation) and NotesIndex for the notes experience.
Underlying implementation
Section titled “Underlying implementation”- solutions/determined/crates/determined-index/src/
Locations
Section titled “Locations”solutions/determined/crates/determined-index/solutions/determined/crates/determined-index/src/lib.rssolutions/determined/crates/determined-index/src/walk.rs#walksolutions/determined/crates/determined-index/src/indexer.rs#index_documentssolutions/determined/crates/determined-index/src/query.rs#searchsolutions/determined/crates/determined-index/src/access.rssolutions/determined/crates/determined-index/src/graph/build.rs#build_graphsolutions/determined/crates/determined-index/src/port.rs#IndexBackend