Tuesday
Dec
1
2026
12:00 PM - 1:30 PM EST
Location
The Clubhouse at TechSquare

Embracing Language as Grounded Communication

In this talk, I’ll highlight some of the ways my lab enables agents and robots to better understand and respond to human communication by considering the grounded context in which that communication occurs, including neurosymbolic multimodal reasoning, natural language dialogue and interaction for lifelong learning, and utilizing NLP technologies on non-text communication.

Abstract: Language is not text data, it is a human medium for communication. The larger part of the natural language processing (NLP) community has doubled down on treating digital text as a sufficient approximation of language, scaling datasets and corresponding models to fit that text. I have argued that experience in the world grounds language, tying it to objects, actions, and concepts. In fact, I believe that language carries meaning only when considered alongside that world, and that the zeitgeist in NLP research currently misses the mark on truly interesting questions at the intersection of human language and machine computation. In this talk, I’ll highlight some of the ways my lab enables agents and robots to better understand and respond to human communication by considering the grounded context in which that communication occurs, including neurosymbolic multimodal reasoning, natural language dialogue and interaction for lifelong learning, and utilizing NLP technologies on non-text communication.

Bio: I am an Associate Professor at the Georgia Institute of Technology where I lead the Grounding Language in Actions, Multimodal Observations, and Robots (GLAMOR) Lab. Our research enables agents and robots to better understand and respond to human language by considering the grounded context in which that language occurs by considering three threads: 1) We jointly learning models with language, world perception, and physical action to enable end-to-end agent behavior and improve continual learning; 2) We investigate ways to take advantage of the extra-textual visual world and embodied context in which language is uttered to improve reasoning in language-and-vision and language-guided robotics tasks; and 3) We work to improve speech and sign recognition by leveraging contextual and structural information, as well as to apply language technologies to accessibility and health applications.

---

IPaT: GVU Lunch Lecture Series

The IPaT: GVU Lunch Lecture Series is free and features guest speakers presenting on topics related to people-centered technologies and their impact on society. Lunch is provided at 12:00 p.m. (while supplies last) and the talks begin at 12:30 p.m. Join us weekly or watch video replays. Lectures are held in the Tech Square Clubhouse behind the Centergy One building in Technology Square.
https://peopletech.gatech.edu/news/lunch-lecture-series