Database School

Want to learn more SQLite? Check out my SQLite course: https://highperformancesqlite.com In this episode, I sit down with Mike Buckbee to dive into the nitty-gritty of web application firewalls and his journey from using Redis to SQLite in Wafris. We talk about database architecture, operational challenges, and the fascinating ways SQLite improves performance and usability in cybersecurity tools. Get production ready SQLite with Turso: https://tur.so/af. Follow Mike: Twitter: https://twitter.com/mbuckbee LinkedIn: https://www.linkedin.com/in/michaelbuckbee Wafris website: https://wafris.org Rearchitecting Redis to SQLite article: https://wafris.org/blog/rearchitecting-for-sqlite Follow Aaron: Twitter: https://twitter.com/aarondfrancis LinkedIn: https://www.linkedin.com/in/aarondfrancis Website: https://aaronfrancis.com - find articles, podcasts, courses, and more. Chapters: 00:00 - Introduction and Guest Overview 01:06 - What is Wafris? 02:43 - Naming and Origins of Wafris 04:00 - Mike's Cybersecurity Background 07:17 - Challenges with Web Application Firewalls 10:01 - Wafris Architecture Overview 16:15 - Why Switch to SQLite? 18:01 - Handling IP Address Ranges 24:00 - Wild Redis Data Structures Explained 28:51 - Transitioning to SQLite 32:02 - Operational Advantages of SQLite 37:04 - How Wafris Leverages Threat Lists 40:13 - Performance Gains with SQLite 46:51 - Splitting Reads and Writes in the New Architecture 52:29 - Closing Thoughts and Where to Learn More

Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com. In this interview, I talk with Jesse Hanley, founder of Bento, about running a lean email service from Japan. We chat about the challenges of scaling infrastructure, managing databases, and maintaining a calm business while serving a global customer base. Links Mentioned: Bento: https://bentonow.com Database school on YouTube: https://www.youtube.com/playlist?list=PLI72dgeNJtzqElnNB6sQoAn2R-F3Vqm15 Database school audio only: https://databaseschool.transistor.fm Follow Jesse: Twitter: https://twitter.com/jessethanley Bento on Twitter: https://twitter.com/Bento Follow Aaron: Twitter: https://twitter.com/aarondfrancis LinkedIn: https://www.linkedin.com/in/aarondfrancis Website: https://aaronfrancis.com - find articles, podcasts, courses, and more. Chapters: 00:00 - Introduction to Jesse Hanley 01:02 - Running Bento from Japan 01:48 - The Lean Team Structure at Bento 03:00 - Managing Support via Discord 05:01 - Benefits of Using Discord for Customer Support 06:45 - The Role of Community in Customer Feedback 09:01 - How Bento Gained Traction 13:00 - Bootstrapping Bento and Profitable Growth 16:00 - Running Your Own Mail Servers 19:03 - The Economics and Redundancy of Email Delivery 21:00 - Bento's Heroku Setup and Scaling Challenges 26:00 - Handling and Querying Massive Data in Bento 29:52 - Leveraging Elasticsearch for Data Queries 35:40 - Moving Toward Multi-Database Solutions 37:45 - Exploring Crunchy Data and Citus for Database Scaling 42:00 - Optimizing Bento for Performance and Scalability 54:02 - Jesse’s Advice on Building a Calm and Profitable Business 57:00 - How Bento Uses WebSockets and Background Jobs 1:00:00 - Optimizing Bento with Action Cable 1:02:25 - Avoiding N+1 Queries with WebSockets 1:04:50 - Scaling Redis and Postgres at Bento 1:09:00 - Jesse’s Approach to Managing Growth and Multiple Services 1:11:00 - Final Thoughts on Scaling and Optimizing Databases 1:13:10 - Advice for Aspiring Builders: Stay Patient and True to Your Vision 1:16:00 - Bento’s Unique Approach to Email Marketing and Transactional Emails 1:19:50 - Closing Thoughts and Where to Find Jesse Hanley Online

Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com. Production ready Postgres for teams that ship fast: https://xata.io In this interview, I talk with Monica Sarbu and Tudor Golubenco from Xata about their journey from Elastic to founding Xata. We deep dive on building a Postgres hosting platform, handling schema changes, and how they've made their free tier economical. Links Mentioned: Xata.io: https://xata.io/ The economics of a Postgres free tier: https://xata.io/blog/postgres-free-tier Follow Monica & Tudor: Monica on Twitter: https://twitter.com/monicasarbu Monica on LinkedIn: https://www.linkedin.com/in/monicasarbu Tudor on Twitter: https://twitter.com/tudor_g Tudor on LinkedIn: https://www.linkedin.com/in/tudorgolubenco/ Follow Aaron: Twitter: https://twitter.com/aarondfrancis LinkedIn: https://www.linkedin.com/in/aarondfrancis Website: https://aaronfrancis.com - find articles, podcasts, courses, and more. Chapters: 00:00 - Introduction 00:26 - What is Xata? Overview and Mission 01:32 - Open Source Projects: PG Roll and PG Stream 02:33 - Synchronizing Data: Postgres to Elastic Search 03:12 - Monica and Tudor's Background & Journey to Elastic 04:00 - Founding of Packetbeat: The Start of Open Source Monitoring 06:08 - Transition from Elastic to Starting Xata 07:00 - Launching a Nonprofit and Insights on Database Challenges 08:29 - The Idea Behind Xata: Simplifying Application Development 10:00 - Tudor Joins Xata: The Decision to Start Again 10:47 - The Technical Vision for Xata's Platform 12:06 - Founding Xata During the Pandemic 13:11 - Funding Journey: From Seed to Series A 15:07 - Building a Platform, Not Just a Hosted Database 17:20 - Introducing Postgres to Xata's Stack 20:19 - Navigating Postgres as a DBA 22:44 - Open Source Strategy & Community Building 27:48 - PG Stream Use Cases & Postgres Replication 32:08 - PG Roll for Zero Downtime Schema Changes 36:05 - Implementing Safe and Fast Schema Changes 39:49 - Blob Storage and Cloudflare Integration 45:11 - Xata's Unique Features: Serving Builders and Larger Teams 49:20 - Free Tier Economics and Why It Matters 56:04 - Working as a Husband-Wife Team

Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com. In this interview, I dive deep with Craig Kerstiens from Crunchy Data into the world of Postgres, covering its rise to prominence, scaling at Heroku, and the power of Postgres extensions. Craig also shares insights on database sharding, the future of Postgres, and why developers love working with it. Follow Craig: Twitter: https://twitter.com/craigkerstiens Crunchy Data Blog: https://www.crunchydata.com/blog Follow Aaron: Twitter: https://twitter.com/aarondfrancis LinkedIn: https://www.linkedin.com/in/aarondfrancis Website: https://aaronfrancis.com - find articles, podcasts, courses, and more. Chapters: 00:00 - Introduction: Welcome to Database School 00:20 - Guest Introduction: Craig Kerstiens and Crunchy Data 01:40 - Craig's Journey from Heroku to Crunchy Data 02:55 - Scaling Postgres at Heroku 04:50 - Mastering Postgres Course Announcement 05:30 - The Importance of Postgres at Heroku 07:50 - The Value of Live SQL with Data Clips 09:25 - Data Clips for Business Intelligence and Real-Time Analytics 11:05 - Heroku’s Unique Company Culture and How Data Clips Came to Be 12:30 - Postgres Extensions and Marketplace 14:00 - Citus: Scaling Postgres for Multi-Tenant Applications 15:40 - The Challenges of Sharding in Databases 18:00 - Managing Large Databases and Sharding Keys with Citus 24:00 - The Evolution of Postgres and Its Growing Popularity 31:00 - Postgres for Developers and the Importance of Extensions 35:00 - Extensions as Proving Grounds for Core Postgres Features 37:50 - Building an Extension Marketplace for Postgres 41:00 - Postgres as a Data Platform and Developer Flexibility 46:00 - Why Developers Love Postgres: Stability, Extensions, and Ownership 51:00 - DuckDB: A Fascinating New Database Approach 53:30 - Crunchy Data: What They Offer and Why It Matters 58:30 - Expanding Postgres with DuckDB for Data Warehousing 01:00:00 - Wrapping Up: Where to Find Craig and Crunchy Data

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com Get production ready SQLite with Turso: https://tur.so/af.In this interview, I talk to Stephen Margheim about his work with SQLite and Ruby on Rails. Links: Database school on YouTube: https://www.youtube.com/playlist?list=PLI72dgeNJtzqElnNB6sQoAn2R-F3Vqm15 Database school audio only: https://databaseschool.transistor.fmAaron on Twitter: https://twitter.com/aarondfrancis Stephen on Twitter: https://twitter.com/fractaledmind Stephen's blog: https://fractaledmind.github.io/ Stephen's book: https://fractaledmind.gumroad.com/l/sqlite-on-rails Aaron's conference talk: https://www.youtube.com/watch?v=2YaEtaXYVtI

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af. In this interview, I talk to Kent C. Dodds about SQLite, LiteFS and the React ecosystem. Kent: https://twitter.com/kentcdodds EpicWeb: https://www.epicweb.dev The Epic Stack: https://www.epicweb.dev/epic-stack Fly.io: https://fly.io LiteFS: https://fly.io/docs/litefs Litestream: https://litestream.io

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com Get production ready SQLite with Turso: https://tur.so/af.In this interview I talk to Glauber Costa, CEO of Turso.

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af.In this interview I talk to Carl Sverre about his new project: SQLSync. It's an offline-first, collaborative wrapper around SQLite. We cover event sourcing, conflict resolution, VFSes, and more! Carl: https://twitter.com/carlsverre PartyKit: https://www.partykit.io SQLSync: https://sqlsync.dev Carl's new company: https://orbitinghail.dev ------- 00:00 Intro and Background 01:56 What is SQLSync 02:30 Amplify 05:08 SQLSync Use Case 07:35 Multiplayer Explained 09:41 Durable Objects 12:00 Compare to PartyKit 13:08 Local First 22:46 SQLSync Terminology 24:28 SQLSync Replication Flow 27:33 Virtual File System 33:51 Transactions in WASM 39:41 Sync to Coordinator 43:22 Conflict Resolution as Business Logic 52:03 Sync to Clients 1:01:12 Goals for SQLSync 1:04:14 Scaling Limitations 1:07:30 Graft Storage Engine 1:14:47 Graft as a SQLite Extension 1:17:08 What's Next -----

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af.Ben and Aaron discuss replication and backups in SQLite, Litestream and LiteFS, and future mad scientist projects Ben is working on. • Ben Johnson on Twitter: https://x.com/benbjohnson • Litestream: https://litestream.io/ • LiteFS: https://fly.io/docs/litefs/

Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af. DHH and Aaron discuss modern SQLite, the one-person framework, conceptual compression, stoicism, and ONCE.com's newest product: Workbook.