Matthijs T. J. Spaan

Publication Activity (10 Years)

Years Active: 2001-2024
Publications (10 Years): 52

Top Venues

CoRR

AAAI

AAMAS

ICAPS

Publications

Yaniv Oren, Moritz A. Zanger, Pascal R. van der Vaart, Matthijs T. J. Spaan, Wendelin Böhmer
Value Improved Actor Critic Algorithms. CoRR (2024)
Philip Lippmann, Matthijs T. J. Spaan, Jie Yang
Exploring LLMs as a Source of Targeted Synthetic Textual Data to Minimize High Confidence Misclassifications. CoRR (2024)
Davide Mambelli, Stephan Bongers, Onno Zoeter, Matthijs T. J. Spaan, Frans A. Oliehoek
When Do Off-Policy and On-Policy Policy Gradient Methods Align? CoRR (2024)
Moritz Akiya Zanger, Wendelin Boehmer, Matthijs T. J. Spaan
Diverse Projection Ensembles for Distributional Reinforcement Learning. ICLR (2024)
Max Weltevrede, Felix Kaubek, Matthijs T. J. Spaan, Wendelin Böhmer
Explore-Go: Leveraging Exploration for Generalisation in Deep Reinforcement Learning. CoRR (2024)
Pascal R. van der Vaart, Neil Yorke-Smith, Matthijs T. J. Spaan
Bayesian Ensembles for Exploration in Deep Q-Learning. AAMAS (2024)
Alberto Castellini, Federico Bianchi, Edoardo Zorzi, Thiago D. Simão, Alessandro Farinelli, Matthijs T. J. Spaan
Scalable Safe Policy Improvement via Monte Carlo Tree Search. ICML (2023)
Qisong Yang, Thiago D. Simão, Nils Jansen, Simon H. Tindemans, Matthijs T. J. Spaan
Reinforcement Learning by Guided Safe Exploration. CoRR (2023)
Moritz A. Zanger, Wendelin Böhmer, Matthijs T. J. Spaan
Diverse Projection Ensembles for Distributional Reinforcement Learning. CoRR (2023)
Qisong Yang, Thiago D. Simão, Nils Jansen, Simon H. Tindemans, Matthijs T. J. Spaan
Reinforcement Learning by Guided Safe Exploration. ECAI (2023)
Qisong Yang, Thiago D. Simão, Simon H. Tindemans, Matthijs T. J. Spaan
Safety-constrained reinforcement learning with a distributional safety critic. Mach. Learn. 112 (3) (2023)
Miguel Suau, Matthijs T. J. Spaan, Frans A. Oliehoek
Bad Habits: Policy Confounding and Out-of-Trajectory Generalization in RL. CoRR (2023)
Qisong Yang, Matthijs T. J. Spaan
CEM: Constrained Entropy Maximization for Task-Agnostic Safe Exploration. AAAI (2023)
Max Weltevrede, Matthijs T. J. Spaan, Wendelin Böhmer
The Role of Diverse Replay for Generalisation in Reinforcement Learning. CoRR (2023)
Miguel Suau, Jinke He, Mustafa Mert Çelikok, Matthijs T. J. Spaan, Frans A. Oliehoek
Distributed Influence-Augmented Local Simulators for Parallel MARL in Large Networked Systems. NeurIPS (2022)
Yaniv Oren, Matthijs T. J. Spaan, Wendelin Böhmer
Planning with Uncertainty: Deep Exploration in Model-Based Reinforcement Learning. CoRR (2022)
Miguel Suau, Jinke He, Matthijs T. J. Spaan, Frans A. Oliehoek
Influence-Augmented Local Simulators: A Scalable Solution for Fast Deep RL in Large Networked Systems. CoRR (2022)
Sebastian Junges, Matthijs T. J. Spaan
Abstraction-Refinement for Hierarchical Probabilistic Models. CAV (1) (2022)
Miguel Suau, Jinke He, Matthijs T. J. Spaan, Frans A. Oliehoek
Speeding up Deep Reinforcement Learning through Influence-Augmented Local Simulators. AAMAS (2022)
Miguel Suau, Jinke He, Matthijs T. J. Spaan, Frans A. Oliehoek
Influence-Augmented Local Simulators: a Scalable Solution for Fast Deep RL in Large Networked Systems. ICML (2022)
Danial Kamran, Thiago D. Simão, Qisong Yang, Canmanie T. Ponnambalam, Johannes Fischer, Matthijs T. J. Spaan, Martin Lauer
A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning. ITSC (2022)
Miguel Suau, Jinke He, Mustafa Mert Çelikok, Matthijs T. J. Spaan, Frans A. Oliehoek
Distributed Influence-Augmented Local Simulators for Parallel MARL in Large Networked Systems. CoRR (2022)
Sebastian Junges, Matthijs T. J. Spaan
Abstraction-Refinement for Hierarchical Probabilistic Models. CoRR (2022)
Canmanie T. Ponnambalam, Frans A. Oliehoek, Matthijs T. J. Spaan
Abstraction-Guided Policy Recovery from Expert Demonstrations. ICAPS (2021)
Thiago D. Simão, Nils Jansen, Matthijs T. J. Spaan
AlwaysSafe: Reinforcement Learning without Safety Constraint Violations during Training. AAMAS (2021)
Qisong Yang, Thiago D. Simão, Simon H. Tindemans, Matthijs T. J. Spaan
WCSAC: Worst-Case Soft Actor Critic for Safety-Constrained Reinforcement Learning. AAAI (2021)
Frits de Nijs, Erwin Walraven, Mathijs Michiel de Weerdt, Matthijs T. J. Spaan
Constrained Multiagent Markov Decision Processes: a Taxonomy of Problems and Algorithms. J. Artif. Intell. Res. 70 (2021)
Steven Carr, Nils Jansen, Sudarshanan Bharadwaj, Matthijs T. J. Spaan, Ufuk Topcu
Safe Policies for Factored Partially Observable Stochastic Games. Robotics: Science and Systems (2021)
Jennifer Renoux, Tiago S. Veiga, Pedro U. Lima, Matthijs T. J. Spaan
A Unified Decision-Theoretic Model for Information Gathering and Communication Planning. RO-MAN (2020)
Yash Satsangi, Shimon Whiteson, Frans A. Oliehoek, Matthijs T. J. Spaan
Exploiting Submodular Value Functions For Scaling Up Active Perception. CoRR (2020)
Johan Los, Frederik Schulte, Margaretha Gansterer, Richard F. Hartl, Matthijs T. J. Spaan, Rudy R. Negenborn
Decentralized Combinatorial Auctions for Dynamic and Large-Scale Collaborative Vehicle Routing. ICCL (2020)
Nils H. Van Der Blij, Dario Chaifouroosh, Claudio A. Cañizares, Thiago Batista Soeiro, Laura M. Ramirez-Elizondo, Matthijs T. J. Spaan, Pavol Bauer
Improved Power Flow Methods for DC Grids. ISIE (2020)
Thiago D. Simão, Matthijs T. J. Spaan
Safe Policy Improvement with Baseline Bootstrapping in Factored Environments. AAAI (2019)
Erwin Walraven, Matthijs T. J. Spaan
Point-Based Value Iteration for Finite-Horizon POMDPs. J. Artif. Intell. Res. 65 (2019)
Thiago D. Simão, Matthijs T. J. Spaan
Structure Learning for Safe Policy Improvement. IJCAI (2019)
Frits de Nijs, Georgios Theocharous, Nikos Vlassis, Mathijs Michiel de Weerdt, Matthijs T. J. Spaan
Capacity-aware Sequential Recommendations. AAMAS (2018)
Erwin Walraven, Matthijs T. J. Spaan
Column Generation Algorithms for Constrained POMDPs. J. Artif. Intell. Res. 62 (2018)
Nils H. Van Der Blij, Laura Ramirez Elizondo, Matthijs T. J. Spaan, Pavol Bauer
Stability and Decentralized Control of Plug-and-Play DC Distribution Grids. IEEE Access 6 (2018)
Johan Los, Matthijs T. J. Spaan, Rudy R. Negenborn
Fleet Management for Pickup and Delivery Problems with Multiple Locations and Preferences. LDIC (2018)
Frits de Nijs, Matthijs T. J. Spaan, Mathijs Michiel de Weerdt
Preallocation and Planning Under Stochastic Resource Constraints. AAAI (2018)
Yi-Chun Chen, Mykel J. Kochenderfer, Matthijs T. J. Spaan
Improving Offline Value-Function Approximations for POMDPs by Reducing Discount Factors. IROS (2018)
Diederik M. Roijers, Erwin Walraven, Matthijs T. J. Spaan
Bootstrapping LPs in Value Iteration for Multi-Objective and Partially Observable MDPs. ICAPS (2018)
Yash Satsangi, Shimon Whiteson, Frans A. Oliehoek, Matthijs T. J. Spaan
Exploiting submodular value functions for scaling up active perception. Auton. Robots 42 (2) (2018)
Erwin Walraven, Matthijs T. J. Spaan
Accelerated Vector Pruning for Optimal POMDP Solvers. AAAI (2017)
Frits de Nijs, Erwin Walraven, Mathijs Michiel de Weerdt, Matthijs T. J. Spaan
Bounding the Probability of Resource Constraint Violations in Multi-Agent MDPs. AAAI (2017)
Frans A. Oliehoek, Matthijs T. J. Spaan, Bas Terwijn, Philipp Robbel, João V. Messias
The MADP Toolbox: An Open Source Library for Planning and Learning in (Multi-)Agent Systems. J. Mach. Learn. Res. 18 (2017)
Erwin Walraven, Matthijs T. J. Spaan
Planning Under Uncertainty for Aggregated Electric Vehicle Charging with Renewable Energy Supply. ECAI (2016)
Nisar Ahmed, Paul Bello, Selmer Bringsjord, Micah Clark, Bradley Hayes, Christopher Miller, Frans A. Oliehoek, Frank Stein, Matthijs T. J. Spaan
The 2015 AAAI Fall Symposium Series Reports. AI Mag. 37 (2) (2016)
Erwin Walraven, Matthijs T. J. Spaan
Planning under Uncertainty for Aggregated Electric Vehicle Charging Using Markov Decision Processes. AAAI Workshop: AI for Smart Grids and Smart Buildings (2016)
Frits de Nijs, Matthijs T. J. Spaan, Mathijs Michiel de Weerdt
Decoupling a Resource Constraint Through Fictitious Play in Multi-Agent Sequential Decision Making. ECAI (2016)
Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, Mathijs Michiel de Weerdt
Solving Transition-Independent Multi-Agent MDPs with Sparse Interactions. AAAI (2016)
Erwin Walraven, Matthijs T. J. Spaan, Bram Bakker
Traffic flow optimization: A reinforcement learning approach. Eng. Appl. Artif. Intell. 52 (2016)
Erwin Walraven, Matthijs T. J. Spaan
Planning under Uncertainty with Weighted State Scenarios. UAI (2015)
Frans A. Oliehoek, Matthijs T. J. Spaan, Philipp Robbel, João V. Messias
The MADP Toolbox: An Open-Source Library for Planning and Learning in (Multi-)Agent Systems. AAAI Fall Symposia (2015)
Frans A. Oliehoek, Matthijs T. J. Spaan, Stefan J. Witwicki
Influence-Optimistic Local Values for Multiagent Planning. AAMAS (2015)
Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, Mathijs de Weerdt
Solving Transition-Independent Multi-agent MDPs with Sparse Interactions (Extended version). CoRR (2015)
Tiago S. Veiga, Matthijs T. J. Spaan, Pedro U. Lima
Improving Value Function Approximation in Factored POMDPs by Exploiting Model Structure. AAMAS (2015)
Frans Adriaan Oliehoek, Matthijs T. J. Spaan, Stefan J. Witwicki
Factored Upper Bounds for Multiagent Planning Problems under Uncertainty with Non-Factored Value Functions. IJCAI (2015)
Matthijs T. J. Spaan, Tiago S. Veiga, Pedro U. Lima
Decision-theoretic planning under uncertainty with information rewards for active cooperative perception. Auton. Agents Multi Agent Syst. 29 (6) (2015)
Frans A. Oliehoek, Matthijs T. J. Spaan, Stefan J. Witwicki
Influence-Optimistic Local Values for Multiagent Planning - Extended Version. CoRR (2015)
Frits de Nijs, Matthijs T. J. Spaan, Mathijs de Weerdt
Best-Response Planning of Thermostatically Controlled Loads under Power Constraints. AAAI (2015)
Erwin Walraven, Matthijs T. J. Spaan
Planning Under Uncertainty with Weighted State Scenarios. AAAI Fall Symposia (2015)
Stefan J. Witwicki, José Carlos Castillo, Jesús Capitán, João V. Messias, João C. G. Reis, Pedro U. Lima, Francisco S. Melo, Matthijs T. J. Spaan
A testbed for autonomous robot surveillance. AAMAS (2014)
Tiago Veiga, Matthijs T. J. Spaan, Pedro U. Lima
Point-Based POMDP Solving with Factored Value Function Approximation. AAAI (2014)
Diederik Marijn Roijers, Joris Scharpff, Matthijs T. J. Spaan, Frans A. Oliehoek, Mathijs de Weerdt, Shimon Whiteson
Bounded Approximations for Linear Multi-Objective Planning Under Uncertainty. ICAPS (2014)
Jesús Capitán, Matthijs T. J. Spaan, Luis Merino, Aníbal Ollero
Decentralized Multi-Robot Cooperation with Auctioned POMDPs. ICAPS (2014)
Frans Adriaan Oliehoek, Matthijs T. J. Spaan, Christopher Amato, Shimon Whiteson
Incremental Clustering and Expansion for Faster Optimal Planning in Dec-POMDPs. CoRR (2014)
Stefan J. Witwicki, Francisco S. Melo, Jesús Capitán, Matthijs T. J. Spaan
A Flexible Approach to Modeling Unpredictable Events in MDPs. ICAPS (2013)
João Vicente Messias, Matthijs T. J. Spaan, Pedro U. Lima
GSMDPs for Multi-Robot Sequential Decision-Making. AAAI (2013)
Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, Mathijs de Weerdt
Coordinating maintenance planning under uncertainty: (demonstration). AAMAS (2013)
Jesús Capitán, Matthijs T. J. Spaan, Luis Merino, Aníbal Ollero
Decentralized multi-robot cooperation with auctioned POMDPs. Int. J. Robotics Res. 32 (6) (2013)
Frans A. Oliehoek, Shimon Whiteson, Matthijs T. J. Spaan
Approximate solutions for factored Dec-POMDPs with many agents. AAMAS (2013)
Frans A. Oliehoek, Matthijs T. J. Spaan, Christopher Amato, Shimon Whiteson
Incremental Clustering and Expansion for Faster Optimal Planning in Dec-POMDPs. J. Artif. Intell. Res. 46 (2013)
Joris Scharpff, Matthijs T. J. Spaan, Leentje Volker, Mathijs de Weerdt
Planning under Uncertainty for Coordinating Infrastructural Maintenance. ICAPS (2013)
João V. Messias, Matthijs T. J. Spaan, Pedro U. Lima
Multiagent POMDPs with asynchronous execution. AAMAS (2013)
Frans A. Oliehoek, Matthijs T. J. Spaan
Tree-based pruning for multiagent POMDPs with delayed communication. AAMAS (2012)
Rajneesh Sharma, Matthijs T. J. Spaan
Bayesian-Game-Based Fuzzy Reinforcement Learning Control for Decentralized POMDPs. IEEE Trans. Comput. Intell. AI Games 4 (4) (2012)
Frans A. Oliehoek, Shimon Whiteson, Matthijs T. J. Spaan
Exploiting Structure in Cooperative Bayesian Games CoRR (2012)
Frans A. Oliehoek, Shimon Whiteson, Matthijs T. J. Spaan
Exploiting Structure in Cooperative Bayesian Games. UAI (2012)
Jesús Capitán, Matthijs T. J. Spaan, Luis Merino, Aníbal Ollero
Decentralized multi-robot cooperation with auctioned POMDPs. ICRA (2012)
Frans Adriaan Oliehoek, Matthijs T. J. Spaan
Tree-Based Solution Methods for Multiagent POMDPs with Delayed Communication. AAAI (2012)
Frans A. Oliehoek, Matthijs T. J. Spaan, Nikos A. Vlassis
Optimal and Approximate Q-value Functions for Decentralized POMDPs CoRR (2011)
Matthijs T. J. Spaan, Frans A. Oliehoek, Christopher Amato
Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. IJCAI (2011)
Matthijs T. J. Spaan, Nikos A. Vlassis
Perseus: Randomized Point-based Value Iteration for POMDPs CoRR (2011)
João V. Messias, Matthijs T. J. Spaan, Pedro U. Lima
Efficient Offline Communication Policies for Factored Multiagent POMDPs. NIPS (2011)
Frans A. Oliehoek, Shimon Whiteson, Matthijs T. J. Spaan
Exploiting Agent and Type Independence in Collaborative Graphical Bayesian Games CoRR (2011)
Rajneesh Sharma, Matthijs T. J. Spaan
Fuzzy reinforcement learning control for decentralized partially observable Markov decision processes. FUZZ-IEEE (2011)
Francisco S. Melo, Matthijs T. J. Spaan, Stefan J. Witwicki
QueryPOMDP: POMDP-Based Communication in Multiagent Systems. EUMAS (2011)
Abdolkarim Pahliani, Matthijs T. J. Spaan, Pedro U. Lima
Fault-tolerant probabilistic sensor fusion for Multi-Agent Systems. IROS (2010)
Alberto Sanfeliu, Juan Andrade-Cetto, Marco Barbosa, Richard Bowden, Jesús Capitán, Andreu Corominas Murtra, Andrew Gilbert, John Illingworth, Luis Merino, Josep M. Mirats Tur, Plinio Moreno, Aníbal Ollero, João Sequeira, Matthijs T. J. Spaan
Decentralized Sensor Fusion for Ubiquitous Networking Robotics in Urban Areas. Sensors 10 (3) (2010)
Matthijs T. J. Spaan, Nelson Gonçalves, João Sequeira
Multirobot coordination by auctioning POMDPs. ICRA (2010)
Frans A. Oliehoek, Matthijs T. J. Spaan, Jilles Steeve Dibangoye, Christopher Amato
Heuristic search for identical payoff Bayesian games. AAMAS (2010)
Matthijs T. J. Spaan, Tiago Veiga, Pedro U. Lima
Active cooperative perception in network robot systems using POMDPs. IROS (2010)
Rajneesh Sharma, Matthijs T. J. Spaan
A Bayesian game based adaptive fuzzy controller for multiagent POMDPs. FUZZ-IEEE (2010)
Marco Barbosa, Alexandre Bernardino, Dario Figueira, José António Gaspar, Nelson Gonçalves, Pedro U. Lima, Plinio Moreno, Abdolkarim Pahliani, José Santos-Victor, Matthijs T. J. Spaan, João Sequeira
ISROBOTNET: A testbed for sensor and robot network systems. IROS (2009)
Matthijs T. J. Spaan, Pedro U. Lima
A Decision-Theoretic Approach to Dynamic Sensor Selection in Camera Networks. ICAPS (2009)
Frank Ehlers, Fredrik Gustafsson, Matthijs T. J. Spaan
Signal Processing Advances in Robots and Autonomy. EURASIP J. Adv. Signal Process. 2009 (2009)
Abdolkarim Pahliani, Matthijs T. J. Spaan, Pedro U. Lima
Decision-theoretic robot guidance for active cooperative perception. IROS (2009)
Frans A. Oliehoek, Shimon Whiteson, Matthijs T. J. Spaan
Lossless clustering of histories in decentralized POMDPs. AAMAS (1) (2009)
Frans A. Oliehoek, Matthijs T. J. Spaan, Nikos A. Vlassis
Optimal and Approximate Q-value Functions for Decentralized POMDPs. J. Artif. Intell. Res. 32 (2008)

Matthijs T. J. Spaan.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Matthijs T. J. Spaan