Comment

Comment by YeGoblynQueenne

>> When I subscribed, these features were provided by traditional ML, perhaps some BERT-like encoder architecture at most, however now I cannot keep that previous functionality if I don't wish to grant LLMs access to my data.

Sorry for the sidetrack, but why is it so common to consider BERT something else than an LLM? It is one of the earliest LLMs so it's nowhere near the size of more recent ones, but even wikipedia classifies it as an LLM:

  Bidirectional encoder representations from transformers (BERT)
  Original author Google AI
  Release October 31, 2018[1]
  Type 

    Large language model
    Transformer
    Foundation model

  License Apache 2.0
  Website arxiv.org/abs/1810.04805 
  Repository github.com/google-research/bert
https://en.wikipedia.org/wiki/BERT_(language_model)

And in any case it's an autoregressively-trained Transformer, albeit encoder-only. If it's not an LLM, then what is it?

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton