dlcarrier
Joined 2 years ago
Joined 2 years ago
Yeah, it's trivially easy to rip the alignment out of the model, but that's only because it's tacked on as an afterthought. If they implemented their censoring as part of training, instead of inferencing, it would be extremely difficult to eliminate.
Alignment isn't only used for censoring, and it doesn't have to be transparent. Considering how heavy of a hand most governments put into companies developing frontier models, it's reasonable to assume they will start restricting capabilities, e.g. there may be a domestic version of Llama and an ITAR-compliant Llama, and China will likely do the same with Qwen, Deepseek, and the like.
hybrid instruct-and-reasoning MoE: The model includes a subsystem that can run portions of the model at a time and assign itself tasks, greatly improving the capabilities over running the model in the original fancy-autocomplete method early LLMs used, and letting the model run on simpler hardware.
with multimodal input: The model can parse images, video, and audio, as well as text, so the user can upload files of those types and run a prompt that analyzes them.
Having the users differentiate a scooter from a motorcycle could work too, because every captcha with scooters in it seems to ask the user to select motorcycles.