Frank Keller

ORCID

Publication Activity (10 Years)

Years Active: 1995-2024
Publications (10 Years): 81

Top Venues

University of Potsdam (PHD)

Education History

University of Potsdam

PHD

Publications

Rohit Saxena, Frank Keller
Select and Summarize: Scene Saliency for Movie Script Summarization. CoRR (2024)
Rohit Saxena, Frank Keller
MovieSum: An Abstractive Summarization Dataset for Movie Screenplays. ACL (Findings) (2024)
Pinelopi Papalampidi, Frank Keller, Mirella Lapata
Finding the Right Moment: Human-Assisted Trailer Creation via Task Composition. IEEE Trans. Pattern Anal. Mach. Intell. 46 (1) (2024)
Davide Moltisanti, Hakan Bilen, Laura Sevilla-Lara, Frank Keller
Coarse or Fine? Recognising Action End States without Labels. CoRR (2024)
Ander Salaberria, Gorka Azkune, Oier Lopez de Lacalle, Aitor Soroa, Eneko Agirre, Frank Keller
Improving Explicit Spatial Relationships in Text-to-Image Generation through an Automatically Derived Dataset. CoRR (2024)
Davide Moltisanti, Frank Keller, Hakan Bilen, Laura Sevilla-Lara
Learning Action Changes by Measuring Verb-Adverb Textual Relationships. CVPR (2023)
Arushi Goel, Basura Fernando, Frank Keller, Hakan Bilen
Semi-supervised multimodal coreference resolution in image narrations. EMNLP (2023)
Danyang Liu, Mirella Lapata, Frank Keller
Visual Storytelling with Question-Answer Plans. EMNLP (Findings) (2023)
Gautier Dagan, Frank Keller, Alex Lascarides
Learning the Effects of Physical Actions in a Multi-modal Environment. EACL (Findings) (2023)
Gautier Dagan, Frank Keller, Alex Lascarides
Learning the Effects of Physical Actions in a Multi-modal Environment. CoRR (2023)
Georgia-Ann Carter, Paul Hoffman, Frank Keller
Leveraging context for perceptual prediction using word embeddings. CogSci (2023)
Arushi Goel, Basura Fernando, Frank Keller, Hakan Bilen
Semi-supervised multimodal coreference resolution in image narrations. CoRR (2023)
Gautier Dagan, Frank Keller, Alex Lascarides
Dynamic Planning with a LLM. CoRR (2023)
Davide Moltisanti, Frank Keller, Hakan Bilen, Laura Sevilla-Lara
Learning Action Changes by Measuring Verb-Adverb Textual Relationships. CoRR (2023)
Hanxu Hu, Frank Keller
Meta-Learning For Vision-and-Language Cross-lingual Transfer. CoRR (2023)
Anil Batra, Davide Moltisanti, Laura Sevilla-Lara, Marcus Rohrbach, Frank Keller
Efficient Pre-training for Localized Instruction Generation of Videos. CoRR (2023)
Arushi Goel, Basura Fernando, Frank Keller, Hakan Bilen
Who are you referring to? Coreference resolution in image narrations. ICCV (2023)
Danyang Liu, Mirella Lapata, Frank Keller
Visual Storytelling with Question-Answer Plans. CoRR (2023)
Danyang Liu, Frank Keller
Detecting and Grounding Important Characters in Visual Stories. CoRR (2023)
Danyang Liu, Frank Keller
Detecting and Grounding Important Characters in Visual Stories. AAAI (2023)
Shreyank N. Gowda, Marcus Rohrbach, Frank Keller, Laura Sevilla-Lara
Learn2Augment: Learning to Composite Videos for Data Augmentation in Action Recognition. CoRR (2022)
Anil Batra, Shreyank N. Gowda, Frank Keller, Laura Sevilla-Lara
A Closer Look at Temporal Ordering in the Segmentation of Instructional Videos. BMVC (2022)
Songpeng Yan, Michael Hahn, Frank Keller
Modeling Fixation Behavior in Reading with Character-level Neural Attention. CogSci (2022)
Anil Batra, Shreyank N. Gowda, Laura Sevilla-Lara, Frank Keller
A Closer Look at Temporal Ordering in the Segmentation of Instructional Videos. CoRR (2022)
Shreyank N. Gowda, Laura Sevilla-Lara, Frank Keller, Marcus Rohrbach
CLASTER: Clustering with Reinforcement Learning for Zero-Shot Action Recognition. ECCV (20) (2022)
Arushi Goel, Basura Fernando, Frank Keller, Hakan Bilen
Not All Relations are Equal: Mining Informative Labels for Scene Graph Generation. CVPR (2022)
Arushi Goel, Basura Fernando, Frank Keller, Hakan Bilen
Who are you referring to? Weakly supervised coreference resolution with multimodal grounding. CoRR (2022)
Shreyank N. Gowda, Marcus Rohrbach, Frank Keller, Laura Sevilla-Lara
Learn2Augment: Learning to Composite Videos for Data Augmentation in Action Recognition. ECCV (31) (2022)
David Wilmot, Frank Keller
Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories. CoRR (2021)
Pinelopi Papalampidi, Frank Keller, Mirella Lapata
Film Trailer Generation via Task Decomposition. CoRR (2021)
David Wilmot, Frank Keller
A Temporal Variational Model for Story Generation. CoRR (2021)
David Wilmot, Frank Keller
Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories. EMNLP (1) (2021)
Radina Dobreva, Frank Keller
Investigating Negation in Pre-trained Vision-and-language Models. BlackboxNLP@EMNLP (2021)
Shreyank N. Gowda, Laura Sevilla-Lara, Kiyoon Kim, Frank Keller, Marcus Rohrbach
A New Split for Evaluating True Zero-Shot Action Recognition. GCPR (2021)
Shreyank N. Gowda, Laura Sevilla-Lara, Kiyoon Kim, Frank Keller, Marcus Rohrbach
A New Split for Evaluating True Zero-Shot Action Recognition. CoRR (2021)
Shreyank N. Gowda, Laura Sevilla-Lara, Frank Keller, Marcus Rohrbach
CLASTER: Clustering with Reinforcement Learning for Zero-Shot Action Recognition. CoRR (2021)
Arushi Goel, Basura Fernando, Frank Keller, Hakan Bilen
Not All Relations are Equal: Mining Informative Labels for Scene Graph Generation. CoRR (2021)
Pinelopi Papalampidi, Frank Keller, Mirella Lapata
Movie Summarization via Sparse Graph Construction. AAAI (2021)
David Wilmot, Frank Keller
Suspense in Short Stories is Predicted By Uncertainty Reduction over Neural Story Representation. ACL (2020)
Pinelopi Papalampidi, Frank Keller, Lea Frermann, Mirella Lapata
Screenplay Summarization Using Latent Narrative Structure. CoRR (2020)
David Wilmot, Frank Keller
Modelling Suspense in Short Stories as Uncertainty Reduction over Neural Representation. CoRR (2020)
Pinelopi Papalampidi, Frank Keller, Lea Frermann, Mirella Lapata
Screenplay Summarization Using Latent Narrative Structure. ACL (2020)
Bowen Li, Taeuk Kim, Reinald Kim Amplayo, Frank Keller
Heads-up! Unsupervised Constituency Parsing via Self-Attention Heads. AACL/IJCNLP (2020)
Bowen Li, Taeuk Kim, Reinald Kim Amplayo, Frank Keller
Heads-up! Unsupervised Constituency Parsing via Self-Attention Heads. CoRR (2020)
Pinelopi Papalampidi, Frank Keller, Mirella Lapata
Movie Summarization via Sparse Graph Construction. CoRR (2020)
Michael Hahn, Frank Keller, Yonatan Bisk, Yonatan Belinkov
Character-based Surprisal as a Model of Human Reading in the Presence of Errors. CoRR (2019)
Pinelopi Papalampidi, Frank Keller, Mirella Lapata
Movie Plot Analysis via Turning Point Identification. EMNLP/IJCNLP (1) (2019)
Bowen Li, Lili Mou, Frank Keller
An Imitation Learning Approach to Unsupervised Parsing. CoRR (2019)
Bowen Li, Jianpeng Cheng, Yang Liu, Frank Keller
Dependency Grammar Induction with a Neural Variational Transition-Based Parser. AAAI (2019)
Pinelopi Papalampidi, Frank Keller, Mirella Lapata
Movie Plot Analysis via Turning Point Identification. CoRR (2019)
Spandana Gella, Desmond Elliott, Frank Keller
Cross-lingual Visual Verb Sense Disambiguation. CoRR (2019)
Michael Hahn, Frank Keller, Yonatan Bisk, Yonatan Belinkov
Character-based Surprisal as a Model of Reading Difficulty in the Presence of Errors. CogSci (2019)
Matt Rounds, Chris Lucas, Frank Keller
Inattentional Blindness in Visual Search. CogSci (2019)
Bowen Li, Lili Mou, Frank Keller
An Imitation Learning Approach to Unsupervised Parsing. ACL (1) (2019)
Spandana Gella, Frank Keller, Mirella Lapata
Disambiguating Visual Verbs. IEEE Trans. Pattern Anal. Mach. Intell. 41 (2) (2019)
Spandana Gella, Desmond Elliott, Frank Keller
Cross-lingual Visual Verb Sense Disambiguation. NAACL-HLT (1) (2019)
Spandana Gella, Frank Keller
An Evaluation of Image-Based Verb Prediction Models against Human Eye-Tracking Data. NAACL-HLT (2) (2018)
Bowen Li, Jianpeng Cheng, Yang Liu, Frank Keller
Dependency Grammar Induction with a Neural Variational Transition-based Parser. CoRR (2018)
Moreno I. Coco, Rick Dale, Frank Keller
Performance in a Collaborative Search Task: The Role of Feedback and Alignment. Top. Cogn. Sci. 10 (1) (2018)
Michael Hahn, Frank Keller
Modeling Task Effects in Human Reading with Neural Attention. CoRR (2018)
Dim P. Papadopoulos, Jasper R. R. Uijlings, Frank Keller, Vittorio Ferrari
Training object class detectors with click supervision. CoRR (2017)
Spandana Gella, Frank Keller
An Analysis of Action Recognition Datasets for Language and Vision Tasks. CoRR (2017)
Dim P. Papadopoulos, Jasper R. R. Uijlings, Frank Keller, Vittorio Ferrari
Extreme Clicking for Efficient Object Annotation. ICCV (2017)
Spandana Gella, Rico Sennrich, Frank Keller, Mirella Lapata
Image Pivoting for Learning Multilingual Multimodal Representations. EMNLP (2017)
Dim P. Papadopoulos, Jasper R. R. Uijlings, Frank Keller, Vittorio Ferrari
Extreme clicking for efficient object annotation. CoRR (2017)
Spandana Gella, Rico Sennrich, Frank Keller, Mirella Lapata
Image Pivoting for Learning Multilingual Multimodal Representations. CoRR (2017)
Raffaella Bernardi, Ruket Çakici, Desmond Elliott, Aykut Erdem, Erkut Erdem, Nazli Ikizler-Cinbis, Frank Keller, Adrian Muscat, Barbara Plank
Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures (Extended Abstract). IJCAI (2017)
Dim P. Papadopoulos, Jasper R. R. Uijlings, Frank Keller, Vittorio Ferrari
Training Object Class Detectors with Click Supervision. CVPR (2017)
Spandana Gella, Frank Keller
An Analysis of Action Recognition Datasets for Language and Vision Tasks. ACL (2) (2017)
Maria Barrett, Frank Keller, Anders Søgaard
Cross-lingual Transfer of Correlations between Parts of Speech and Gaze Features. COLING (2016)
Maria Barrett, Joachim Bingel, Frank Keller, Anders Søgaard
Weakly Supervised Part-of-speech Tagging Using Eye-tracking Data. ACL (2) (2016)
Michael Hahn, Frank Keller
Modeling Human Reading with Neural Attention. EMNLP (2016)
Dim P. Papadopoulos, Jasper R. R. Uijlings, Frank Keller, Vittorio Ferrari
We don't need no bounding-boxes: Training object class detectors using only human verification. CoRR (2016)
Michael Hahn, Frank Keller
Modeling Human Reading with Neural Attention. CoRR (2016)
Spandana Gella, Mirella Lapata, Frank Keller
Unsupervised Visual Sense Disambiguation for Verbs using Multimodal Embeddings. CoRR (2016)
Spandana Gella, Mirella Lapata, Frank Keller
Unsupervised Visual Sense Disambiguation for Verbs using Multimodal Embeddings. HLT-NAACL (2016)
Frank Keller
Jointly Representing Images and Text: Dependency Graphs, Word Senses, and Multimodal Embeddings. iV&L-MM@MM (2016)
Raffaella Bernardi, Ruket Çakici, Desmond Elliott, Aykut Erdem, Erkut Erdem, Nazli Ikizler-Cinbis, Frank Keller, Adrian Muscat, Barbara Plank
Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures. CoRR (2016)
Raffaella Bernardi, Ruket Çakici, Desmond Elliott, Aykut Erdem, Erkut Erdem, Nazli Ikizler-Cinbis, Frank Keller, Adrian Muscat, Barbara Plank
Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures. J. Artif. Intell. Res. 55 (2016)
Moreno I. Coco, Frank Keller, George L. Malcolm
Anticipation in Real-World Scenes: The Role of Visual Context and Visual Memory. Cogn. Sci. 40 (8) (2016)
Dim P. Papadopoulos, Jasper R. R. Uijlings, Frank Keller, Vittorio Ferrari
We Don't Need No Bounding-Boxes: Training Object Class Detectors Using Only Human Verification. CVPR (2016)
Ioannis Konstas, Frank Keller
Semantic Role Labeling Improves Incremental Parsing. ACL (1) (2015)
Diego Frassinelli, Frank Keller
Cumulative Contextual Facilitation in Word Activation and Processing: Evidence from Distributional Modelling. CogSci (2015)
Moreno I. Coco, Frank Keller
Integrating mechanisms of visual guidance in naturalistic language production. Cogn. Process. 16 (2) (2015)
Desmond Elliott, Frank Keller
Comparing Automatic Evaluation Measures for Image Description. ACL (2) (2014)
Desmond Elliott, Victor Lavrenko, Frank Keller
Query-by-Example Image Retrieval using Visual Dependency Representations. COLING (2014)
Dim P. Papadopoulos, Alasdair D. F. Clarke, Frank Keller, Vittorio Ferrari
Training Object Class Detectors from Eye Tracking Data. ECCV (5) (2014)
Ioannis Konstas, Frank Keller, Vera Demberg, Mirella Lapata
Incremental Semantic Role Labeling with Tree Adjoining Grammar. EMNLP (2014)
Stella Frank, Frank Keller, Sharon Goldwater
Exploring the Utility of Joint Morphological and Syntactic Learning from Child-directed Speech. EMNLP (2013)
Desmond Elliott, Frank Keller
Image Description using Visual Dependency Representations. EMNLP (2013)
Michal Dziemianko, Alasdair D. F. Clarke, Frank Keller
Object-based Saliency as a Predictor of Attention in Visual Tasks. CogSci (2013)
Stella Frank, Sharon Goldwater, Frank Keller
Adding Sentence Types to a Model of Syntactic Category Acquisition. Top. Cogn. Sci. 5 (3) (2013)
Diego Frassinelli, Frank Keller, Christoph Scheepers
The Effect of Incremental Context on Conceptual Processing: Evidence from Visual World and Reading Experiments. CogSci (2013)
Vera Demberg, Frank Keller, Alexander Koller
Incremental, Predictive Parsing with Psycholinguistically Motivated Tree-Adjoining Grammar. Comput. Linguistics 39 (4) (2013)
Amit Dubey, Frank Keller, Patrick Sturt
Probabilistic Modeling of Discourse-Aware Sentence Processing. Top. Cogn. Sci. 5 (3) (2013)
Federico Sangati, Frank Keller
Incremental Tree Substitution Grammar for Parsing and Sentence Prediction. Trans. Assoc. Comput. Linguistics 1 (2013)
Ben Allison, Frank Keller, Moreno I. Coco
A Bayesian Model of the Effect of Object Context on Visual Attention. CogSci (2012)
Diego Frassinelli, Frank Keller
The Plausibility of Semantic Properties Generated by a Distributional Model: Evidence from a Visual World Experiment. CogSci (2012)
Moreno I. Coco, Frank Keller
Scan Patterns Predict Sentence Production in the Cross-Modal Processing of Visual Scenes. Cogn. Sci. 36 (7) (2012)
Amit Dubey, Frank Keller, Patrick Sturt
A Model of Discourse Predictions in Human Sentence Processing. EMNLP (2011)

Frank Keller.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Frank Keller