senseiV

if the ai is the product, and the product isnt trustable, isnt that a product issue??

Does a TPU have XLA-graph for GPUs Cuda-graphs? Not sure on TPU theory

Ive noticed the same on extremely small models aswell, magnitude is a positional encoding or a couple tokens, so its easy to grok?

well world model in the context of the tulip fields, so models could be finetuned+sheared to drop size and remain effective

claude.ai

Theres a startup doing that named galileo_ai

Part of an FRC team building a Vision system from scratch, quite fun and nearly complete, just need to recalibrate some angle formulas

I just saw a markdown mode show up today, but only partially, like bold and italics in markdown

not sure if this is just chatgpt, but analogous evolution is interesting to see

yes the size is different, but training a diffusion model and a language model are really different, like how RL models can be small but take a long time to train aswell

Looking into the nordic pile maybe? There are some datasets

NLP is not the industry, and a lot of research still goes into other things, like RL

I've worked with several transformers competitors, and it def wont stay centralized on them

GPT 2 and 3 used the p50K right? Then GPT-4 used cl100K

> simulating entire AI-based societies.

Didnt they already have scaled down simulations of this?