BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//wp-events-plugin.com//7.2.3.1//EN
TZID:Asia/Kolkata
X-WR-TIMEZONE:Asia/Kolkata
BEGIN:VEVENT
UID:119@cds.iisc.ac.in
DTSTART;TZID=Asia/Kolkata:20250404T140000
DTEND;TZID=Asia/Kolkata:20250404T150000
DTSTAMP:20250327T104848Z
URL:https://cds.iisc.ac.in/events/cloud-seminar-it-bench-benchmarking-llm-
 powered-agents-for-intelligent-it-operations-in-real-world-scenarios-divya
 -pathak-ibm-india-research-lab-april-04-200pm-cds-102/
SUMMARY:[CLOUD SEMINAR] IT-Bench: Benchmarking LLM-Powered Agents for Intel
 ligent IT Operations in Real-World Scenarios\, Divya Pathak\, IBM India Re
 search Lab\, April 04\, 2:00PM\, CDS 102
DESCRIPTION:\n\nCLOUD COMPUTING SEMINAR SERIES\n\n\n\nSpeaker : Divya Patha
 k\, IBM India Research Lab.\nTitle : IT-Bench: Benchmarking LLM-Powered Ag
 ents for Intelligent IT Operations in Real-World Scenarios\nDate &amp\; Ti
 me : April 04\, 2025 (Friday)\, 02:00 PM\nVenue : # 102\, CDS Seminar Hall
 \n\n\n\nAbstract: AI-driven automation is revolutionizing IT operations\, 
 with LLM-based agents managing incident diagnosis\, localisation\, and rem
 ediation. But how effective are these agents in real-world scenarios? In t
 his talk\, we introduce IT-Bench\, an open-source benchmarking framework d
 esigned to evaluate LLM-powered agents for intelligent IT operations. Unli
 ke traditional benchmarks that rely on static datasets\, IT-Bench involves
  live system interactions\, testing AI agents in dynamic IT environments w
 ith real failure scenarios. Built on cloud-native principles\, IT-Bench se
 amlessly scales across Kubernetes-based infrastructures\, allowing for rig
 orous\, production-grade assessments across hundreds of real-world IT situ
 ations. The session will cover how real-world incident scenarios are creat
 ed\, test applications are deployed\, and IT agents are benchmarked.\n\nBi
 o: Divya Pathak is a Research Engineer at IBM Research\, India\, where she
  has contributed to observability\, chaos engineering\, and AIOps to devel
 op resilient\, adaptive\, and self-healing systems. Her current research f
 ocuses on enhancing observability for multi-agent workflows. Before joinin
 g IBM Research\, she completed her M.Tech (Research) in Computer Science a
 nd Engineering from IIT Hyderabad.\n\nPranjal Gupta is a Research Software
  Engineer at IBM Research India\, specializing in artificial intelligence 
 (AI) and machine learning (ML) for IT operations (AIOps). His research foc
 uses on automating and optimizing IT workflows to enhance efficiency and m
 inimize manual intervention.\n\nHost Faculty: Prof. Yogesh Simmhan\n\nAbou
 t: The IBM-IISc Hybrid Cloud Lab (IIHCL) hosted at IISc is curating the Cl
 oud Computing Seminar series with guest speakers from Industry and Academi
 a speaking about the latest technologies and research on Cloud and edge co
 mputing\, distributed computing systems\, and AI/ML/Big Data platforms.\n\
 n\n\nALL ARE WELCOME
CATEGORIES:Events,Talks
END:VEVENT
BEGIN:VTIMEZONE
TZID:Asia/Kolkata
X-LIC-LOCATION:Asia/Kolkata
BEGIN:STANDARD
DTSTART:20240404T140000
TZOFFSETFROM:+0530
TZOFFSETTO:+0530
TZNAME:IST
END:STANDARD
END:VTIMEZONE
END:VCALENDAR