Comment by krackers

If you were to just throw the file into a database, wouldn't the database's index essentially lead to the same result (b-tree, compacted using bulk-loading procedure).