this looks like a start, however, you really need to focus on what OpenAI already did with Jalapeno. [0]. If you could make a true open source inference chip, GPU not CPU based, it would make a real difference and reduce the costs of buying these chip from your design.
[0] https://openai.com/index/jalapeno-first-results/