We have models right now such as Qwopus, which are Qwen with open weights and using distilled Claude responses in it's training data. Since AI can't be copywritten, distillation is the way forward to getting rid of these proprietary models.
Qwopus is a family of open-weight, reasoning-enhanced large language models developed by community fine-tuner Jackrong, designed to run efficiently on consumer hardware. The models are built on Alibaba’s Qwen3.5 or Qwen3.6 base architectures and are fine-tuned using Trace Inversion to distill the step-by-step reasoning chains of Anthropic’s Claude Opus (versions 4.6 and 4.7).[1]
Qwopus is a family of open-weight, reasoning-enhanced large language models developed by community fine-tuner Jackrong, designed to run efficiently on consumer hardware. The models are built on Alibaba’s Qwen3.5 or Qwen3.6 base architectures and are fine-tuned using Trace Inversion to distill the step-by-step reasoning chains of Anthropic’s Claude Opus (versions 4.6 and 4.7).[1]
[1] Just a brief Brave Search summary of what Qwopus is https://search.brave.com/search?q=what+is+qwopus%3F&source=w...