Data Engineering Is the Cache Invalidation Problem Ft. Josh Wills

In this episode, we dive into how much models actually matter: more like a preference, like whether you use an iPhone or Android, than their capabilities. We talk about bare-metal disks when running Kubernetes, then move to agents and how data engineering becomes like being an emergency pilot in a plane, and how we automate away the boring work with no more database migrations or unit tests. We go into spiritual territory, where he feels in his gut whether a pipeline will work. Then we finish…