When working with tabular data, there are very few situations where absolute model performance is the only criteria that's important. In practice, the following are equally as important:
- Explainability / debug-ability of models
- Effort to train, deploy, and manage NN models in production
- Capturing, collating, and organizing new & better datasets
- Local developer experience and human-model-iteration time
Building all of your software in C or Assembly will be faster and higher performant. But at what cost and with what tradeoffs? Building a website has a different set of tradeoffs than building a program for the Mars rover.
- Explainability / debug-ability of models
- Effort to train, deploy, and manage NN models in production
- Capturing, collating, and organizing new & better datasets
- Local developer experience and human-model-iteration time
Building all of your software in C or Assembly will be faster and higher performant. But at what cost and with what tradeoffs? Building a website has a different set of tradeoffs than building a program for the Mars rover.