Difference between revisions of "NL Grounding Reading Group"
From PublicWiki
(→Potential Papers) |
(→Schedule: Autumn 2012) |
||
(31 intermediate revisions by 5 users not shown) | |||
Line 31: | Line 31: | ||
|- | |- | ||
| Oct 17 | | Oct 17 | ||
− | | | + | | Integrating Representation Learning and Skill Learning in a Human-Like Intelligent Agent (Nan Li, CSE 403) |
| | | | ||
| | | | ||
Line 38: | Line 38: | ||
|- | |- | ||
| Oct 24 | | Oct 24 | ||
− | | | + | | Affiliates Event |
| | | | ||
| | | | ||
Line 45: | Line 45: | ||
|- | |- | ||
| Oct 31 | | Oct 31 | ||
+ | | [http://www1.cs.columbia.edu/~coyne/images/wordseye_siggraph.pdf WordsEye: An Automatic Text-to-Scene Conversion System] | ||
+ | | Bob Coyne and Daniel Bauer and Owen Rambow. | ||
| | | | ||
− | | | + | | [[User:GabeOS|Gabe]] |
− | |||
− | | | ||
| | | | ||
|- | |- | ||
| Nov 7 | | Nov 7 | ||
− | | | + | | [http://www.seas.upenn.edu/~taskar/pubs/eccv08.pdf Movie/Script: Alignment and Parsing of Video and Text Transcription] |
− | | | + | | T. Cour, C. Jordan, E. Miltsakaki, B. Taskar. |
− | | | + | | ECCV 2008 |
− | | | + | | Luke |
| | | | ||
|- | |- | ||
| Nov 14 | | Nov 14 | ||
− | | | + | | [http://www.cs.uic.edu/pub/Ziebart/Publications/pointing-target-prediction.pdf Probabilistic Pointing Target Prediction via Inverse Optimal Control] |
− | | | + | | Brian D. Ziebart, Anind K. Dey, and J. Andrew Bagnell |
− | | | + | | IUI 2012 |
− | | | + | | Peter |
| | | | ||
|- | |- | ||
Line 69: | Line 69: | ||
| | | | ||
| | | | ||
− | | | + | | Tanner |
| | | | ||
|- | |- | ||
| Nov 28 | | Nov 28 | ||
+ | | [http://www.eecs.berkeley.edu/Pubs/TechRpts/2012/EECS-2012-202.pdf Visually-Grounded BayesianWord Learning] | ||
+ | |Yangqing Jia, Joshua Abbott, Joseph Austerweil, Thomas Griffiths and Trevor Darrell. | ||
| | | | ||
− | | | + | | Yuyin |
− | |||
− | |||
| | | | ||
|- | |- | ||
| Dec 5 | | Dec 5 | ||
− | | | + | |Translating Structured English to Robot Controllers |
− | | | + | |Hadas Kress-Gazit, Georgios E. Fainekos and George J. Pappas |
− | | | + | | |
− | | | + | | Arun |
| | | | ||
|- | |- | ||
| Dec 12 | | Dec 12 | ||
− | | | + | | No meeting. |
| | | | ||
| | | | ||
Line 98: | Line 98: | ||
====Language Games/Language Evolution==== | ====Language Games/Language Evolution==== | ||
− | * [http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5980476&tag=1 Lingodroids: Studies in spatial cognition and language]. Ruth Schulz, Arren Glover, Michael J. Milford, Gordon Wyeth, Janet | + | * [http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5980476&tag=1 Lingodroids: Studies in spatial cognition and language]. Ruth Schulz, Arren Glover, Michael J. Milford, Gordon Wyeth, Janet Wiles. |
− | Wiles. | ||
* [http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6225130&tag=1 Lingodroids: Learning terms for time]. Heath, S., Schulz, R. ; Ball, D. ; Wiles, J. | * [http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6225130&tag=1 Lingodroids: Learning terms for time]. Heath, S., Schulz, R. ; Ball, D. ; Wiles, J. | ||
* [http://www.csl.sony.fr/downloads/papers/2012/steels-12c.pdf Grounding Language through Evolutionary Language Games] Luc Steels. | * [http://www.csl.sony.fr/downloads/papers/2012/steels-12c.pdf Grounding Language through Evolutionary Language Games] Luc Steels. | ||
Line 105: | Line 104: | ||
* [http://dl.acm.org/ft_gateway.cfm?id=544830&ftid=72682&dwn=1&CFID=171625995&CFTOKEN=85346367 Mutual Online Concept Learning for Multiple Agents]. Jun Wang, Les Gasser. | * [http://dl.acm.org/ft_gateway.cfm?id=544830&ftid=72682&dwn=1&CFID=171625995&CFTOKEN=85346367 Mutual Online Concept Learning for Multiple Agents]. Jun Wang, Les Gasser. | ||
− | ====Grounded | + | ==== Grounded Robotics ==== |
* [http://www.umiacs.umd.edu/~cteo/public-shared/ICRA2012_ActionObjects_preprint.pdf Towards a Watson That Sees: Language-Guided Action Recognition for Robots]. Ching L. Teo, Yezhou Yang, Hal Daume III, Cornelia Ferm ´ uller and Yiannis Aloimonos. | * [http://www.umiacs.umd.edu/~cteo/public-shared/ICRA2012_ActionObjects_preprint.pdf Towards a Watson That Sees: Language-Guided Action Recognition for Robots]. Ching L. Teo, Yezhou Yang, Hal Daume III, Cornelia Ferm ´ uller and Yiannis Aloimonos. | ||
* [http://people.csail.mit.edu/stefie10/publications/tellex11.pdf Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation]. Stefanie Tellex*, Thomas Kollar*, Steven Dickerson*, Matthew R. Walter, Ashis Gopal Banerjee, Seth Teller, Nicholas Roy. | * [http://people.csail.mit.edu/stefie10/publications/tellex11.pdf Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation]. Stefanie Tellex*, Thomas Kollar*, Steven Dickerson*, Matthew R. Walter, Ashis Gopal Banerjee, Seth Teller, Nicholas Roy. | ||
+ | * [http://homes.cs.washington.edu/~cynthia/Pubs/MatuszekISER2012.pdf Learning to Parse Natural Language Commands to a Robot Control System]. Cynthia Matuszek, Evan Herbst, Luke Zettlemoyer, Dieter Fox. | ||
+ | * [http://homes.cs.washington.edu/~cynthia/Pubs/MatuszekICML2012.pdf A Joint Model of Language and Perception for Grounded Attribute Learning]. Cynthia Matuszek*, Nicholas FitzGerald*, Liefeng Bo, Luke Zettlemoyer, Dieter Fox. | ||
+ | * [http://hrilab.cs.tufts.edu/publications/cantrelletal12hri.pdf Tell me when and why to do it!: run-time planner model updates via natural language instruction]. Rehj Cantrell, Kartik Talamadupula, Paul Schermerhorn, J. Benton, Subbarao Kambhampati, Matthias Scheutz | ||
− | + | ====Grounding in Graphics / Vision==== | |
− | ====Grounding in Graphics==== | ||
*[http://www1.cs.columbia.edu/~coyne/papers/relms-2011.pdf VigNet: Grounding Language in Graphics using Frame Semantics]. Bob Coyne and Daniel Bauer and Owen Rambow. | *[http://www1.cs.columbia.edu/~coyne/papers/relms-2011.pdf VigNet: Grounding Language in Graphics using Frame Semantics]. Bob Coyne and Daniel Bauer and Owen Rambow. | ||
*[http://www1.cs.columbia.edu/~coyne/images/wordseye_siggraph.pdf WordsEye: An Automatic Text-to-Scene Conversion System]. Bob Coyne, Richard Sproat. | *[http://www1.cs.columbia.edu/~coyne/images/wordseye_siggraph.pdf WordsEye: An Automatic Text-to-Scene Conversion System]. Bob Coyne, Richard Sproat. | ||
+ | *[http://www.d2.mpi-inf.mpg.de/sites/default/files/rohrbach12cvpr.pdf A Database for Fine Grained Activity Detection of Cooking Activities]. Marcus Rohrbach, Sikandar Amin, Mykhaylo Andriluka, Bernt Schiele. CVPR 2012. | ||
+ | *[http://www.eecs.berkeley.edu/Pubs/TechRpts/2012/EECS-2012-202.pdf Visually-Grounded Bayesian Word Learning]. Yangqing Jia, Joshua Abbott, Joseph Austerweil, Thomas Griffiths and Trevor Darrell. Tech report. |
Latest revision as of 00:19, 12 December 2012
This is the wiki page for topics to be discussed in the NL grounding reading group.
When: Wednesdays, 3:30pm
Where: CSE 203
We also have a mailing list (https://mailman.cs.washington.edu/mailman/listinfo/grounding).
Contact: cynthia@cs
Contents
Schedule: Autumn 2012
Date | Paper | Authors | Venue | Leader | Info |
---|---|---|---|---|---|
Oct 3 | Learning to Connect Language and Perception | Raymond J. Mooney | AAAI 2008 | Cynthia | |
Oct 10 | Approaching the Symbol Grounding Problem with Probabilistic Graphical Models | S. Tellex, T. Kollar, S. Dickerson, M. R. Walter, A. G. Banerjee, S. Teller, N. Roy | AI Magazine. 32(4) | Nicholas | |
Oct 17 | Integrating Representation Learning and Skill Learning in a Human-Like Intelligent Agent (Nan Li, CSE 403) | ||||
Oct 24 | Affiliates Event | ||||
Oct 31 | WordsEye: An Automatic Text-to-Scene Conversion System | Bob Coyne and Daniel Bauer and Owen Rambow. | Gabe | ||
Nov 7 | Movie/Script: Alignment and Parsing of Video and Text Transcription | T. Cour, C. Jordan, E. Miltsakaki, B. Taskar. | ECCV 2008 | Luke | |
Nov 14 | Probabilistic Pointing Target Prediction via Inverse Optimal Control | Brian D. Ziebart, Anind K. Dey, and J. Andrew Bagnell | IUI 2012 | Peter | |
Nov 21 | Tanner | ||||
Nov 28 | Visually-Grounded BayesianWord Learning | Yangqing Jia, Joshua Abbott, Joseph Austerweil, Thomas Griffiths and Trevor Darrell. | Yuyin | ||
Dec 5 | Translating Structured English to Robot Controllers | Hadas Kress-Gazit, Georgios E. Fainekos and George J. Pappas | Arun | ||
Dec 12 | No meeting. |
Potential Papers
Consider these as mere suggestions! Please check papers before assigning them.
Language Games/Language Evolution
- Lingodroids: Studies in spatial cognition and language. Ruth Schulz, Arren Glover, Michael J. Milford, Gordon Wyeth, Janet Wiles.
- Lingodroids: Learning terms for time. Heath, S., Schulz, R. ; Ball, D. ; Wiles, J.
- Grounding Language through Evolutionary Language Games Luc Steels.
- The Physical Symbol Grounding Problem Paul Vogt.
- Mutual Online Concept Learning for Multiple Agents. Jun Wang, Les Gasser.
Grounded Robotics
- Towards a Watson That Sees: Language-Guided Action Recognition for Robots. Ching L. Teo, Yezhou Yang, Hal Daume III, Cornelia Ferm ´ uller and Yiannis Aloimonos.
- Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation. Stefanie Tellex*, Thomas Kollar*, Steven Dickerson*, Matthew R. Walter, Ashis Gopal Banerjee, Seth Teller, Nicholas Roy.
- Learning to Parse Natural Language Commands to a Robot Control System. Cynthia Matuszek, Evan Herbst, Luke Zettlemoyer, Dieter Fox.
- A Joint Model of Language and Perception for Grounded Attribute Learning. Cynthia Matuszek*, Nicholas FitzGerald*, Liefeng Bo, Luke Zettlemoyer, Dieter Fox.
- Tell me when and why to do it!: run-time planner model updates via natural language instruction. Rehj Cantrell, Kartik Talamadupula, Paul Schermerhorn, J. Benton, Subbarao Kambhampati, Matthias Scheutz
Grounding in Graphics / Vision
- VigNet: Grounding Language in Graphics using Frame Semantics. Bob Coyne and Daniel Bauer and Owen Rambow.
- WordsEye: An Automatic Text-to-Scene Conversion System. Bob Coyne, Richard Sproat.
- A Database for Fine Grained Activity Detection of Cooking Activities. Marcus Rohrbach, Sikandar Amin, Mykhaylo Andriluka, Bernt Schiele. CVPR 2012.
- Visually-Grounded Bayesian Word Learning. Yangqing Jia, Joshua Abbott, Joseph Austerweil, Thomas Griffiths and Trevor Darrell. Tech report.