Comment by technerder

Is there anyway to use Google's Coral TPU PCIe Accelerator[1]'s to increase the inference performance of GPT models like this and Llama?

[1] https://coral.ai/products/pcie-accelerator/