Loading Events

« All Events

  • This event has passed.

CDS Research Seminar: “Knowledge Representation and Reasoning With Deep Neural Networks”

13 Oct @ 3:00 PM -- 4:00 PM

COMPUTATIONAL AND DATA SCIENCES (CDS)

CDS Research Seminar

Title: Knowledge Representation and Reasoning With Deep Neural Networks

Speaker: Arvind Neelakantan [UMass Amherst]

When: 3pm, Oct 13 (Fri)

Where: CDS 102

Abstract: Knowledge representation and reasoning is one of the central

challenges of artificial intelligence, and has important implications in

many fields including natural language understanding and robotics.

Representing knowledge with symbols, and reasoning via search and logic has

been the dominant paradigm for many decades. In this work, we use deep

neural networks to learn to both represent symbols and perform reasoning

end-to-end from data. By learning powerful non-linear models, our approach

generalizes to massive amounts of knowledge and works well with messy

real-world data using minimal human effort. First, we show that recurrent

neural networks with an attention mechanism achieve state-of-the-art

reasoning on a large structured knowledge graph. Next, we develop Neural

Programmer, a neural network augmented with discrete operations that can be

learned to induce latent programs with backpropagation. We apply Neural

Programmer to induce short programs on a natural language question

answering dataset that requires reasoning on semi-structured Wikipedia

tables. We present what is to our awareness the first weakly supervised,

end-to-end neural network model to induce such programs on a real-world

dataset. Unlike previous learning approaches to program induction, the

model does not require domain-specific grammars, rules, or annotations.

Bio: Arvind Neelakantan [1] recently earned his PhD from Umass Amherst with

Andrew McCallum. His primary research interests are in natural language

understanding and deep learning. He’s a recipient of the 2016 Google PhD

Fellowship in Machine Learning and the outstanding paper award at the

Workshop on Automated Knowledge Base Construction at NIPS, 2014.

[1] https://people.cs.umass.edu/~arvind/

Details

Date:
13 Oct
Time:
3:00 PM -- 4:00 PM
Event Categories:
,

Venue

Room No: 102 (Seminar Hall of CDS)