Program Interfaces Grounded, Transparent, and Reasoning AI
Speaker:
Mr. LUO Hongyin
Postdoctoral associate
MIT Computer Science and Artificial Intelligence Laboratory
| Zoom: | https://cuhk.zoom.us/j/96031770790?pwd=RmI0Z25Qa1RFRzJKWUtOOG52YXlQdz09 Meeting ID: 960 3177 0790 // Passcode: 202400 |
Abstract:
Recent language models have achieved strong generalization ability over a vast range of tasks, but also raised concerns about hallucinations, harmful stereotypes, and lack of reliability in reasoning tasks. Our research emphasizes that the core solution to these problems is improving grounding and reasoning abilities of language models. More specifically, we build trustworthy AI systems that (1) follow an explicit grounding-planning-reasoning pipeline for transparency and reliability, and (2) combine autoregressive generation and first-principal reasoning engines. Integrating large language models with knowledge graphs, entailment models, and program interpreter under a program scaffolding instead of natural language, we have made significantly improved the accuracy, transparency, and efficiency of large language models on a wide range of numeric, symbolic, and natural language tasks.
Biography:
Hongyin LUO is a postdoctoral associate at MIT Computer Science and Artificial Intelligence Laboratory (CSAIL). He received a bachelor’s degree from Tsinghua University in 2016 and obtained a Ph.D. degree in computer science in 2022 at MIT EECS. His research focuses on improving the efficiency, transparency, and reasoning ability of language models. His latest research has combined natural language with different formal reasoning engines, including entailment models and program interpreters. He has built self-trained language understanding models outperforming GPT3-175B with 1/500 computation, retrieval-augmented language models that handle noises from search engines, and natural language embedded programs that achieves accurate reasoning without task-specific examples.
Enquiries:
Mr. WONG O-Bong (obong@cse.cuhk.edu.hk)
Ms. FUNG Wing Chi Mary (maryfung@cse.cuhk.edu.hk)