onasta
Joined 4 years ago
Karma
64
Submissions
10
Member since
Aug 4
Recent submissions
Comment · 1 month ago
Comment · 1 year ago
There have been a ton of improvements! Much better performance overall, way larger data size limit (1K-->10K rows, 100-->500 features), regression support, native categorical data and missing values handling, much better support for uninformative or outlier features etc.
Comment · 1 year ago
TabPFN is better on numerical data since v1 (see figure 6 in the CARTE paper). CARTE's main strength in on text features, which are now also supported for TabPFN v2 API version (https://github.com/PriorLabs/tabpfn-client). We compared this to CARTE and found our model to be generally quite better, and much faster. CARTE multi-table approach is also very interesting, and we want to tackle this setting in the future.
Comment · 4 years ago
Super interesting! Do you know the kind of data that it's usually used for? And in the remaining 80% to 60%, do NNs acccount for a large portion of the best models?
Bonus question: are the stats you're mentioning publically available?
It improves a lot on standard tabular prediction problems (rank 1 by far [TabArena](https://github.com/autogluon/tabarena) and much faster than the competing models, 98% win rate against a well tuned XGBoost). But most importantly it really improves on the messy real-world data we've seen across industries. Be it non-i.i.d. data with temporal or grouped splits, tables with strings, text and images, high-cardinality categorical features, or wide tables with many features, we're also state of the art. Inside our harness, it's also the best model to predict on relational data, outperforming specific graph-based models.
Would love to hear how it performs on your own data!