adriankibet

Hey, thanks Joseph, appreciate it. So in that particular sense it’s very scalable/efficient, the LLM doesn’t really need to scale its parsing at all because of the preprocessing we do beforehand. When you upload your doc we store it as paragraphs and keep the actual doc in cold cloud storage. Just below the question bar a question in the archive view, there’s a selection slider for the number of paragraphs you want used as context to answer the question, this can be adjusted upwards if you think more context would help but 40 paragraphs is the number we settled on after testing because lower than that and you start getting inaccuracies. Once you ask a question Digest checks which 40 or more paragraphs are likely to answer the question then sends those as the context for the LLM to answer with so regardless of the size of the archive the speed of the search is fairly consistent because its always ~40 paragraphs (with some adjustments for paragraph size). Thanks for the question and I hope that helps.

Censorship only makes Martyrs out of idiots. At some point you've got to trust that the majority of people in your community are smart enough to ignore bigotry. I find it hard to believe that reading a racist comment could sway a reasonable human towards racism. People need to see the injustice in the world before they can fight it. If a better community is what people want then the community should choose to fight that battle. I heard Alexis say in a talk once that 'if you treat people like adults, guess what, they treat you like an adult too'. I may be offended or infuriated by the comments I see somewhere but I still want to see them, lest I convince myself that ugliness doesn't exist.