Two loops: one repo, one portfolio - Second Brain system architecture diagram

Building a Second Brain: From Concept Based on Karpathy's Tweet to a Compound Engineering Loop

Since I read Andrej Karpathy’s viral tweet back in April, I’ve wanted to tackle building a ‘second brain’ where an LLM handles the organization, thinking, and maintenance. For as long as I can remember, I’ve had the consistent urge to streamline all that I consume across articles, newsletters, posts, Tweets, YouTube videos, and everything in between. I even created a separate Household Manager harness to manage everything across our family and household. While my Rube Goldberg machine of cobbled-together processes and tools worked alright, the room for improvement grew starker as I learned about implementations that “rode the latest AI model” capabilities. The gap was sharpest around continual improvement that compounds over time: a system that gets smarter with everything you feed it, instead of starting over from zero each session. ...

September 9, 2026 · 5 min · Kevin Boller

Second Brain: AI Compiler & Compound Engineering System

Inspired by Andrej Karpathy’s “second brain” concept, this is a git-backed system where an LLM handles the organization, thinking, and maintenance of everything I consume and everything I build. Capture: Readwise Reader is the inbox and ingestion layer for articles, highlights, forwarded emails, and uploaded PDFs, plus Google Drive for working docs. Live external tools (DataCamp, Sigma, Snowflake, Gmail, Calendar) are queried on demand via MCP rather than statically stored, so structured, dynamic data sits alongside all ingested document knowledge. ...

September 9, 2026 · 2 min · Kevin Boller