OnDB

digesting the current “filesystem vs database” debate for agent memory: currently I'm seeing 2 camps in how we build agent memory. on the one side, we have the “file interfaces are all you need” camp. on the other side, we have the “filesystems are just bad databases” camp. "file interfaces are all you need" camp leaders like anthropic, letta, langchain & llamaindex are leaning towards file interfaces because “files are surprisingly effective as agent memory”. • anthropic’s memory tool treats memory as a set of files (the storage implementation is left up to the developer) • langsmith's agent builder also represents memory in as a set of files (the data is stored in a DB and files are exposed to the agent as a filesystem) • letta that simple filesystem tools like grep and ls outperformed specialized memory or retrieval tools in their benchmarks • llamaindex argues that for many use cases a well-organized filesystem with semantic search might be all you need agents are good at using filesystems because models are optimized for coding tasks (including. CLI operations) post-training. that’s why we’re seeing a “virtual filesystem” pattern where the agent interface and the storage implementation are decoupled. "filesystems are just bad databases" camp but then you have voices like dax from opencode who rightly points out that “a filesystem is just the worst kind of database”. swyx and colleagues in the database space warn about accidentally reinventing dbs by solving the agent memory problem. Avoid writing worse versions of: • search indexes, • transaction logs, • locking mechanisms, trade-offs it’s important to match the complexity of your system to the complexity of your problem. simplicity vs scale > files are simple and CLI tools can even outperform specialized retrieval tools. > but these CLI tools don’t scale well & can become a bottleneck. querying and aggregations > grep can be effective and a hard baseline to beat. > and if you want to improve retrieval performance with hybrid or semantic search? > luckily, there are CLI tools available for semantic search. > the question remains: how well they scale & how effective agents are at using them when they are not as common in the training data. > also at some point you might want some aggregations as well. plain text vs complex data > file interfaces and native CLI tools are great for plain-text files. > what happens when memory becomes multimodal? concurrency > if you have a single agent accessing one memory file sequentially, no need to think about this. > if you have a multi-agent system, you want a DB before implementing buggy lock mechanisms. we’re just scratching the surface: security concerns, permission management, schema validation, etc. are more arguments for dbs over filesystems. i think this is an interesting conversation & i'm curious to see where it goes.