Ben Abbatematteo (@babbatem) header
Ben Abbatematteo (@babbatem) profile picture

Research Scientist @ Meta Reality Labs Previously: Postdoc @texas_robotics, PhD @BrownBigAI. Building physically capable, intelligent robots.

Seattle, WA
Joined March 2024
Join us for our ICRA 2025 Workshop "Beyond Pick and Place — Unifying Learning-Based and Model-Based Approaches for Contact-Rich Manipulation" on Friday May 23rd! sites.google.com/view/icra-2…
1
2
1
12
1,410
co-organized with @RobobertoMM @junjungoal @oliver_kroemer @beomjoonkim @IngmarPosner Harshit Khurana, Aude Billard, and Gentiane Venture
2
160
Ben Abbatematteo retweeted
Ever wondered which data from large datasets (like OXE) actually helps when training/tuning a policy for specific tasks? We present DataMIL, a framework for measuring how each training sample influences policy performance, hence enabling effective data selection 🧵
3
31
7
151
28,196
🤔What tasks do we want robots to handle? Are these preferences based on saved time or feelings we associate with the tasks? Introducing Why Automate This?—a study exploring automation preferences across social groups, using feelings & time-spent as key factors. 👇 (1/5)
1
11
1
35
2,864
Ben Abbatematteo retweeted
I'll be presenting Learning to Look 👀 in-person at #CoRL2024 tomorrow! Come chat with me at the poster session on Wednesday (11am-12.30pm CET).
Intelligent agents such as humans explore their surroundings to gather information and complete tasks. In our #CoRL2024 work -- Learning to Look 👀, we teach robots to find relevant information in their environment. 🤖✨ 🌐: robin-lab.cs.utexas.edu/lear… 🧵👇
4
1
14
1,689
Ben Abbatematteo retweeted
Intelligent agents such as humans explore their surroundings to gather information and complete tasks. In our #CoRL2024 work -- Learning to Look 👀, we teach robots to find relevant information in their environment. 🤖✨ 🌐: robin-lab.cs.utexas.edu/lear… 🧵👇
1
18
5
81
10,034
Ben Abbatematteo retweeted
Are you worried your robot arm will break during manipulation or learning tasks in human unstructured environments? Meet BaRiFlex: a versatile, collision-robust, and affordable robotic gripper designed for resilient robot learning! 🤖✨👇 (1/6) 🌐 robin-lab.cs.utexas.edu/bari…
1
8
2
21
4,974
Ben Abbatematteo retweeted
🤖 Want your robot to grab you a drink from the kitchen downstairs? 🚀 Introducing BUMBLE: a framework to solve building-wide mobile manipulation tasks by harnessing the power of Vision-Language Models (VLMs). 👇 (1/5) 🌐 robin-lab.cs.utexas.edu/BUMB…
7
37
11
171
38,009
Ben Abbatematteo retweeted
🚀 Despite efforts to scale up Behavior Cloning for Robots, large-scale BC has yet to live up to its promise. How can we break through the performance plateau? Introducing 🔥FLaRe: fine-tuning large-scale robot policies with Reinforcement Learning. robot-flare.github.io/ 🧵
1
37
10
122
33,830
Very proud to have helped lead this effort surveying the successes of deep RL in robotics.
10 years after DQN, what are deep RL’s impacts on robotics? Which robotic problems have seen the most thrilling real-world successes thanks to DRL? Where do we still need to push the boundaries, and how? Our latest survey explores these questions! Read on for more details. 👇
2
23
1,531
Ben Abbatematteo retweeted
How do robots understand natural language? #IJCAI2024 survey paper on robotic language grounding We situated papers into a spectrum w/ two poles, grounding language to symbols and high-dimensional embeddings. We discussed tradeoffs, open problems & exciting future directions!
1
13
3
37
6,158
Ben Abbatematteo retweeted
RL in POMDPs is hard because you need memory. Remembering *everything* is expensive, and RNNs can only get you so far applied naively. New paper: 🎉 we introduce a theory-backed loss function that greatly improves RNN performance! 🧵 1/n
5
55
2
319
45,594
Awesome work by @ArpitBahety. Come chat at ICRA workshops!
This quoted post is unavailable.
2
78
Ben Abbatematteo retweeted
Need a way to collect data on your mobile manipulator? We present TeleMoMa, a teleoperation system that, 1. Enables multiple input modalities, making use of readily available and accessible hardware 2. Can be plugged in with any mobile manipulator to start data collection 🧵👇
3
29
10
93
25,825
Ben Abbatematteo retweeted
Congratulations to Ben Abbatematteo, who successfully defended his PhD thesis ("Exploiting Structure for Efficient Robotic Manipulation") yesterday. Congrats Ben - the lab won't be the same without you! @StefanieTellex @BrownCSDept
1
23
745
Ben Abbatematteo retweeted
Initiation sets allow hierarchical RL agents to learn and plan without increasing the branching factor of decision making. But, current approaches to learning init sets do not acknowledge three major challenges: non-stationarity, pessimism and termporal generalization. Come by my #NeurIPS2023 poster to learn about issues that plague HRL agents and to find out about how we can mitigate them. Tues 5:15 pm # 1300.
11
38
3,809