AutoML.org retweeted
The data science revolution is getting closer. TabPFN v2 is published in Nature: nature.com/articles/s41586-0… On tabular classification with up to 10k data points & 500 features, in 2.8s TabPFN on average outperforms all other methods, even when tuning them for up to 4 hours🧵1/19
AutoML.org retweeted
We are elated to introduce our most recent work on time-series foundation models - Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Models.
Authors: @o_swelam, Sathya Kamesh, @julien_siems, David Salinas, @FrankRHutter
Link: arxiv.org/abs/2410.09385
AutoML.org retweeted
Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues
Forget my earlier post, this is the cool one! :)
Analysis of STATE TRACKING capabilities of "linear RNNs" (GLA, MAMBA, mLSTM).
P: arxiv.org/abs/2411.12537
Excited to share our work on this simple yet powerful method for linear RNNs like Mamba or DeltaNet to track states without increasing computational complexity. From @PontilGroup and @FrankRHutter's group
LLMs can now track states, finally matching this cat!
And we prove it.
But how? 🧵👇
1/ Paper: arxiv.org/abs/2411.12537
with @julien_siems @jkhfranke @ZelaArber @FrankRHutter @MPontil
When it comes to fairness in AI, "fair" can mean different things to different people. We saw this challenge as an opportunity to innovate!
🌟 Introducing ManyFairHPO: a human-in-the-loop optimization framework!
ManyFairHPO helps practitioners navigate fairness metric trade-offs, assess conflicts, and make context-aware model selections amidst nuanced fairness dilemmas.
Join us for an engaging discussion on October 22nd at the AAAI/ACM AI Ethics and Society Conference in San Jose!
This work was done jointly by @JakeMRobertson under the supervision of the wonderful @NoorAwad and @FrankRHutter.
Link to paper: arxiv.org/abs/2410.13286
Blog post: automl.org/manyfairhpo-a-hum…
#AI #FairnessInAI #MachineLearning #EthicsInAI #ACM #ManyFairHPO
AutoML.org retweeted
Transformers perform remarkable generalizations in the in-context learning setting.
E.g. when trained only on step functions, the model generalizes to smooth predictions when given a smooth input.
(1/n, a paper thread)
AutoML.org retweeted
What a great pleasure it was to host the @automl_conf here in Paris this week.
Big shoutout to all co-organizers and in particular to the amazing @ElenaRaponi_ @anjajankovic Simon Provost and to the online chairs Gabi Kadlecová and @AndreBiedenkapp
See you in NYC next year 😃
AutoML.org retweeted
We have another opening for a PhD in AutoML @LMU_Muenchen. Apply now at job-portal.lmu.de/jobposting…
#PhD #MachineLearning #Statistics #DataScience #AutoML
AutoML.org retweeted
In less than a month, the AutoML Conference 2024 will be in Paris. I don't think that we can quite compete with the #Olympics, but we will give our best ;-)
🌟 Excited to share our latest work on counterfactual fairness in #MachineLearning at the ICML Workshop on Next Gen. AI Safety in Vienna 🌟
We introduce FairPFN, a transformer trained on synthetic data to remove gender, age, and racial bias in -sensitive real-world ML problems.
Our experiments show some promising results, paving the way transformers in causal and counterfactual fairness with exciting applications to law, healthcare, and finance, as well as extensions to fairness pre-processing, path-specific effects, and multi-objective optimization.
Let's make ML fairer for everyone! 🤖⚖️
Link to paper: arxiv.org/abs/2407.05732v1
@JakeMRobertson @noahholl @__NoorAwad__ @FrankRHutter
#AI #Fairness #CausalInference #Transformers #MLResearch
AutoML.org retweeted
In #Vienna for #ICML2024 to present our latest work!
With @_herilalaina_, @StAdriaensen, @karibbov, @Edberg_Wardman, and @FrankRHutter, we introduce,
ifBO: In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization.
AutoML.org retweeted
Joint work with @LindauerMarius, Florian Karl, Julia Moosbauer, @ATornede, @amuellerml, @FrankRHutter and @BBischl
AutoML.org retweeted
📝In the meantime you can also read a short summary blog post at automl.org/position-a-call-t… or watch a video summary at youtube.com/watch?v=17lH-fhj… 🎥 2/3
AutoML.org retweeted
Wondering how humans should be involved in designing #AutoML solutions 🤔? Check out our #ICML2024 paper: "Position: A Call to Action for a Human-Centered AutoML Paradigm"! 📄✨ proceedings.mlr.press/v235/l…
Drop by at our poster on Thu, Jul 25 at 11:30 AM in Hall C 4-9 #2003 📅
1/3


















