Comment by SkyBelow

I wonder if this should be considered some super-quantized version of the fly brain. Sub 1 bit level. Think like taking a 400GB model and reducing it to 400MB level of quantization. In a standard NN, this isn't really possible as it changes the shape of the weight rather than just the information for weight, so it isn't called quantization anymore. But with actual neurons, the amount of data needed to represent the actual brain enough to capture what is the fly really doing is so massive that reducing it down to the model might keep the shape but has quantized the model to a degree far beyond anything we see with LLMs. Maybe if we imagine an LLM trained where each weight is ~1KB (with sufficient training to actually make sure of those bits) is then quantized down to a 1 bit per weight model, but I'm guessing the IRL Fly to FlyWire is still orders of magnitude more quantization. So does it even count as quantization is a bit hard to argue.