Comment by ZinnZirconium

SQLite is the backend where data goes to be sorted and analyzed and searched in a reasonable amount of time. I tried keeping everything in flat files and generating results with grep but for millions of records it was clear flat files and grep would be far too slow.