BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//wp-events-plugin.com//7.2.3.1//EN
TZID:Asia/Kolkata
X-WR-TIMEZONE:Asia/Kolkata
BEGIN:VEVENT
UID:52@cds.iisc.ac.in
DTSTART;TZID=Asia/Kolkata:20240527T140000
DTEND;TZID=Asia/Kolkata:20240527T150000
DTSTAMP:20240523T070641Z
URL:https://cds.iisc.ac.in/events/seminar-cds-102-27th-may-genaudit-fixing
 -factual-errors-in-language-model-outputs-with-evidence/
SUMMARY:{Seminar} @ CDS: #102: 27th May: "GenAudit: Fixing Factual Errors i
 n Language Model Outputs with Evidence."
DESCRIPTION:Department of Computational and Data Sciences\nDepartment Semin
 ar\n\n\n\nSpeaker : Kundan Krishna\, PhD candidate in the Language Technol
 ogies Institute at CMU\nTitle : "GenAudit: Fixing Factual Errors in Langua
 ge Model Outputs with Evidence."\nDate &amp\; Time : May 27\, 2024\, 02:00
  PM\nVenue : # 102\, CDS Seminar Hall\n\n\n\nABSTRACT\nLLMs can generate f
 actually incorrect statements even when provided access to reference docum
 ents. Such errors can be dangerous in high-stakes applications (e.g.\, doc
 ument-grounded QA for healthcare or finance). In this talk\, I would prese
 nt GenAudit --- a tool intended to assist fact-checking LLM responses for 
 document-grounded tasks. GenAudit suggests edits to the LLM response by re
 vising or removing claims that are not supported by the reference document
 \, and also presents evidence from the reference for facts that do appear 
 to have support. To power GenAudit\, we trained models on a scpecially cre
 ated dataset with high-quality human annotations. Comprehensive evaluation
  by human raters shows that GenAudit can detect errors in 8 different LLM 
 outputs when summarizing documents from diverse domains\, outperforming GP
 T-4 while also being much cheaper. GenAudit is available for public use at
  https://genaudit.org\n\nBIOGRAPHY\nKundan Krishna is a PhD candidate in t
 he Language Technologies Institute at CMU\, advised by Professor Zachary L
 ipton and Professor Jeffrey Bigham. His research focuses on mitigating saf
 ety issues in deployment of language models by improving their factual acc
 uracy and reducing reliance on web-scale scraped data for their pretrainin
 g. He has also worked extensively on various aspects of text summarization
 \, including improving robustness to noise\, producing structured summarie
 s\, generating topic-focused summaries etc. Prior to CMU\, he graduated wi
 th a Bachelor's degree from IIT Kanpur\, and worked as a research engineer
  at Adobe Research\n\nHost Faculty: Dr. Danish Pruthi\n\n\n\nALL ARE WELCO
 ME
CATEGORIES:Events
END:VEVENT
BEGIN:VTIMEZONE
TZID:Asia/Kolkata
X-LIC-LOCATION:Asia/Kolkata
BEGIN:STANDARD
DTSTART:20230528T140000
TZOFFSETFROM:+0530
TZOFFSETTO:+0530
TZNAME:IST
END:STANDARD
END:VTIMEZONE
END:VCALENDAR