Flux
Couleur d'accent
Git for Data Applied: Comparing Git-like Tools That Separate Metadata from Data

Git for Data Applied: Comparing Git-like Tools That Separate Metadata from Data

Continuing from Part 1, where we learned what git for data is, how the architecture and use cases work, how you can achieve git-like functionality with different approaches, and how the key is to avoid moving data as much as possible to keep state that can be referenced and rolled back to, but at the same time saving cost by not duplicating all data every time you create a new branch.

SSP Data Engineering Blog
Building an Obsidian RAG with DuckDB and MotherDuck

Building an Obsidian RAG with DuckDB and MotherDuck

I always wanted a personal knowledge assistant based on my notes. One that uses Obsidian’s backlinks and connections to surface ideas I’ve forgotten or never thought to link together. So I built one. A RAG system that runs locally with DuckDB as a vector database, then syncs to MotherDuck for a serverless web app running entirely in the browser via WASM. Think of it like J.A.R.V.I.S1 for your markdown files: search about a topic, and it shows connected notes up to two hops away, semantically…

SSP Data Engineering Blog
Esc