One of the few LLM announcements I still get excited about. dLLMs have so much potential. See, for instance, how gemma diffusion can be repurposed as a decision model with output tokens and diffusion steps set to 1.
The guardrails are ridiculous though:
PROMPT:
> Draw an ascii diagram illustrating how to leave a two storey building in the event of fire
ERROR RESPONSE:
> I'm sorry, but I can't help with this because it involves potentially dangerous or harmful content. I'm happy to help with something else.
The guardrails are ridiculous though:
PROMPT:
> Draw an ascii diagram illustrating how to leave a two storey building in the event of fire
ERROR RESPONSE:
> I'm sorry, but I can't help with this because it involves potentially dangerous or harmful content. I'm happy to help with something else.
Come on