MedFeat: Model-Aware and Explainability-Driven Feature Engineering with LLMs for Tabular Prediction

Excerpt

arXiv:2603.02221v3 Announce Type: replace Abstract: In clinical tabular prediction, classical machine learning models with feature engineering often outperform neural methods. LLMs are increasingly used to automate this process, acting as domain experts that propose diverse feature transformations to boost downstream performance. However, the feature generation process of existing LLM-based methods is agnostic to the downstream learner: the LLM receives no signal about which features currently d