José Hernández-Orallo

ORCID

Publication Activity (10 Years)

Years Active: 1998-2024
Publications (10 Years): 94

Top Venues

Publications

Usman Anwar, Abulhair Saparov, Javier Rando, Daniel Paleka, Miles Turpin, Peter Hase, Ekdeep Singh Lubana, Erik Jenner, Stephen Casper, Oliver Sourbut, Benjamin L. Edelman, Zhaowei Zhang, Mario Günther, Anton Korinek, José Hernández-Orallo, Lewis Hammond, Eric J. Bigelow, Alexander Pan, Lauro Langosco, Tomasz Korbak, Heidi Zhang, Ruiqi Zhong, Seán Ó hÉigeartaigh, Gabriel Recchia, Giulio Corsi, Alan Chan, Markus Anderljung, Lilian Edwards, Yoshua Bengio, Danqi Chen, Samuel Albanie, Tegan Maharaj, Jakob N. Foerster, Florian Tramèr, He He, Atoosa Kasirzadeh, Yejin Choi, David Krueger
Foundational Challenges in Assuring Alignment and Safety of Large Language Models. CoRR (2024)
Wout Schellaert, Fernando Martínez-Plumed, Karina Vold, John Burden, Pablo A. M. Casares, Bao Sheng Loe, Roi Reichart, Seán Ó hÉigeartaigh, Anna Korhonen, José Hernández-Orallo
Your Prompt Is My Command: On Assessing the Human-Centred Generality of Multimodal Models (Abstract Reprint). AAAI (2024)
Cèsar Ferri, Darío Garigliotti, Brigt Arve Toppe Håvardstun, José Hernández-Orallo, Jan Arne Telle
When Redundancy Matters: Machine Teaching of Representations. CoRR (2024)
David Nieves, María José Ramírez-Quintana, Carlos Monserrat, César Ferri, José Hernández-Orallo
Learning Alternative Ways of Performing a Task. CoRR (2024)
John Burden, Konstantinos Voudouris, Ryan Burnell, Danaja Rutar, Lucy Cheke, José Hernández-Orallo
Inferring Capabilities from Task Performance with Bayesian Triangulation. CoRR (2023)
Manuel Garcia-Piqueras, José Hernández-Orallo
Heuristic search of optimal machine teaching curricula. Mach. Learn. 112 (10) (2023)
Brigt Arve Toppe Håvardstun, Cèsar Ferri, José Hernández-Orallo, Pekka Parviainen, Jan Arne Telle
XAI with Machine Teaching When Humans Are (Not) Informed About the Irrelevant Features. ECML/PKDD (3) (2023)
Wout Schellaert, Fernando Martínez-Plumed, Karina Vold, John Burden, Pablo A. M. Casares, Bao Sheng Loe, Roi Reichart, Seán Ó hÉigeartaigh, Anna Korhonen, José Hernández-Orallo
Your Prompt is My Command: On Assessing the Human-Centred Generality of Multimodal Models. J. Artif. Intell. Res. 77 (2023)
Behzad Mehrbakhsh, Fernando Martínez-Plumed, José Hernández-Orallo
Adversarial Benchmark Evaluation Rectified by Controlling for Difficulty. ECAI (2023)
Konstantinos Voudouris, Ibrahim Alhas, Wout Schellaert, Matthew Crosby, Joel Holmes, John Burden, Niharika Chaubey, Niall Donnelly, Matishalin Patel, Marta Halina, José Hernández-Orallo, Lucy G. Cheke
Animal-AI 3: What's New & Why You Should Care. CoRR (2023)
Fernando Martínez-Plumed, José Hernández-Orallo
Training Data Scientists Through Project-Based Learning. Rev. Iberoam. de Tecnol. del Aprendiz. 18 (3) (2023)
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Parrish, Allen Nie, Aman Hussain, Amanda Askell, Amanda Dsouza, Ambrose Slone, Ameet Rahane, Anantharaman S. Iyer, Anders Andreassen, Andrea Madotto, Andrea Santilli, Andreas Stuhlmüller, Andrew M. Dai, Andrew La, Andrew K. Lampinen, Andy Zou, Angela Jiang, Angelica Chen, Anh Vuong, Animesh Gupta, Anna Gottardi, Antonio Norelli, Anu Venkatesh, Arash Gholamidavoodi, Arfa Tabassum, Arul Menezes, Arun Kirubarajan, Asher Mullokandov, Ashish Sabharwal, Austin Herrick, Avia Efrat, Aykut Erdem, Ayla Karakas, B. Ryan Roberts, Bao Sheng Loe, Barret Zoph, Bartlomiej Bojanowski, Batuhan Özyurt, Behnam Hedayatnia, Behnam Neyshabur, Benjamin Inden, Benno Stein, Berk Ekmekci, Bill Yuchen Lin, Blake Howald, Bryan Orinion, Cameron Diao, Cameron Dour, Catherine Stinson, Cedrick Argueta, Cèsar Ferri Ramírez, Chandan Singh, Charles Rathkopf, Chenlin Meng, Chitta Baral, Chiyu Wu, Chris Callison-Burch, Chris Waites, Christian Voigt, Christopher D. Manning, Christopher Potts, Cindy Ramirez, Clara E. Rivera, Clemencia Siro, Colin Raffel, Courtney Ashcraft, Cristina Garbacea, Damien Sileo, Dan Garrette, Dan Hendrycks, Dan Kilman, Dan Roth, Daniel Freeman, Daniel Khashabi, Daniel Levy, Daniel Moseguí González, Danielle Perszyk, Danny Hernandez, Danqi Chen, Daphne Ippolito, Dar Gilboa, David Dohan, David Drakard, David Jurgens, Debajyoti Datta, Deep Ganguli, Denis Emelin, Denis Kleyko, Deniz Yuret, Derek Chen, Derek Tam, Dieuwke Hupkes, Diganta Misra, Dilyar Buzan, Dimitri Coelho Mollo, Diyi Yang, Dong-Ho Lee, Dylan Schrader, Ekaterina Shutova, Ekin Dogus Cubuk, Elad Segal, Eleanor Hagerman, Elizabeth Barnes, Elizabeth Donoway, Ellie Pavlick, Emanuele Rodolà, Emma Lam, Eric Chu, Eric Tang, Erkut Erdem, Ernie Chang, Ethan A. Chi, Ethan Dyer, Ethan J. Jerzak, Ethan Kim, Eunice Engefu Manyasi, Evgenii Zheltonozhskii, Fanyue Xia, Fatemeh Siar, Fernando Martínez-Plumed, Francesca Happé, François Chollet, Frieda Rong, Gaurav Mishra, Genta Indra Winata, Gerard de Melo, Germán Kruszewski, Giambattista Parascandolo, Giorgio Mariani, Gloria Wang, Gonzalo Jaimovitch-López, Gregor Betz, Guy Gur-Ari, Hana Galijasevic, Hannah Kim, Hannah Rashkin, Hannaneh Hajishirzi, Harsh Mehta, Hayden Bogar, Henry Shevlin, Hinrich Schütze, Hiromu Yakura, Hongming Zhang, Hugh Mee Wong, Ian Ng, Isaac Noble, Jaap Jumelet, Jack Geissinger, Jackson Kernion, Jacob Hilton, Jaehoon Lee, Jaime Fernández Fisac, James B. Simon, James Koppel, James Zheng, James Zou, Jan Kocon, Jana Thompson, Janelle Wingfield, Jared Kaplan, Jarema Radom, Jascha Sohl-Dickstein, Jason Phang, Jason Wei, Jason Yosinski, Jekaterina Novikova, Jelle Bosscher, Jennifer Marsh, Jeremy Kim, Jeroen Taal, Jesse H. Engel, Jesujoba Alabi, Jiacheng Xu, Jiaming Song, Jillian Tang, Joan Waweru, John Burden, John Miller, John U. Balis, Jonathan Batchelder, Jonathan Berant, Jörg Frohberg, Jos Rozen, José Hernández-Orallo, Joseph Boudeman, Joseph Guerr, Joseph Jones, Joshua B. Tenenbaum, Joshua S. Rule, Joyce Chua, Kamil Kanclerz, Karen Livescu, Karl Krauth, Karthik Gopalakrishnan, Katerina Ignatyeva, Katja Markert, Kaustubh D. Dhole, Kevin Gimpel, Kevin Omondi, Kory Mathewson, Kristen Chiafullo, Ksenia Shkaruta, Kumar Shridhar, Kyle McDonell, Kyle Richardson, Laria Reynolds, Leo Gao, Li Zhang, Liam Dugan, Lianhui Qin, Lidia Contreras Ochando, Louis-Philippe Morency, Luca Moschella, Lucas Lam, Lucy Noble, Ludwig Schmidt, Luheng He, Luis Oliveros Colón, Luke Metz, Lütfi Kerem Senel, Maarten Bosma, Maarten Sap, Maartje ter Hoeve, Maheen Farooqi, Manaal Faruqui, Mantas Mazeika, Marco Baturan, Marco Marelli, Marco Maru, María José Ramírez-Quintana, Marie Tolkiehn, Mario Giulianelli, Martha Lewis, Martin Potthast, Matthew L. Leavitt, Matthias Hagen, Mátyás Schubert, Medina Baitemirova, Melody Arnaud, Melvin McElrath, Michael A. Yee, Michael Cohen, Michael Gu, Michael I. Ivanitskiy, Michael Starritt, Michael Strube, Michal Swedrowski, Michele Bevilacqua, Michihiro Yasunaga, Mihir Kale, Mike Cain, Mimee Xu, Mirac Suzgun, Mitch Walker, Mo Tiwari, Mohit Bansal, Moin Aminnaseri, Mor Geva, Mozhdeh Gheini, Mukund Varma T., Nanyun Peng, Nathan A. Chi, Nayeon Lee, Neta Gur-Ari Krakover, Nicholas Cameron, Nicholas Roberts, Nick Doiron, Nicole Martinez, Nikita Nangia, Niklas Deckers, Niklas Muennighoff, Nitish Shirish Keskar, Niveditha Iyer, Noah Constant, Noah Fiedel, Nuan Wen, Oliver Zhang, Omar Agha, Omar Elbaghdadi, Omer Levy, Owain Evans, Pablo Antonio Moreno Casares, Parth Doshi, Pascale Fung, Paul Pu Liang, Paul Vicol, Pegah Alipoormolabashi, Peiyuan Liao, Percy Liang, Peter Chang, Peter Eckersley, Phu Mon Htut, Pinyu Hwang, Piotr Milkowski, Piyush Patil, Pouya Pezeshkpour, Priti Oli, Qiaozhu Mei, Qing Lyu, Qinlang Chen, Rabin Banjade, Rachel Etta Rudolph, Raefer Gabriel, Rahel Habacker, Ramon Risco, Raphaël Millière, Rhythm Garg, Richard Barnes, Rif A. Saurous, Riku Arakawa, Robbe Raymaekers, Robert Frank, Rohan Sikand, Roman Novak, Roman Sitelew, Ronan LeBras, Rosanne Liu, Rowan Jacobs, Rui Zhang, Ruslan Salakhutdinov, Ryan Chi, Ryan Lee, Ryan Stovall, Ryan Teehan, Rylan Yang, Sahib Singh, Saif M. Mohammad, Sajant Anand, Sam Dillavou, Sam Shleifer, Sam Wiseman, Samuel Gruetter, Samuel R. Bowman, Samuel S. Schoenholz, Sanghyun Han, Sanjeev Kwatra, Sarah A. Rous, Sarik Ghazarian, Sayan Ghosh, Sean Casey, Sebastian Bischoff, Sebastian Gehrmann, Sebastian Schuster, Sepideh Sadeghi, Shadi Hamdan, Sharon Zhou, Shashank Srivastava, Sherry Shi, Shikhar Singh, Shima Asaadi, Shixiang Shane Gu, Shubh Pachchigar, Shubham Toshniwal, Shyam Upadhyay, Shyamolima (Shammie) Debnath, Siamak Shakeri, Simon Thormeyer, Simone Melzi, Siva Reddy, Sneha Priscilla Makini, Soo-Hwan Lee, Spencer Torene, Sriharsha Hatwar, Stanislas Dehaene, Stefan Divic, Stefano Ermon, Stella Biderman, Stephanie Lin, Stephen Prasad, Steven T. Piantadosi, Stuart M. Shieber, Summer Misherghi, Svetlana Kiritchenko, Swaroop Mishra, Tal Linzen, Tal Schuster, Tao Li, Tao Yu, Tariq Ali, Tatsu Hashimoto, Te-Lin Wu, Théo Desbordes, Theodore Rothschild, Thomas Phan, Tianle Wang, Tiberius Nkinyili, Timo Schick, Timofei Kornev, Titus Tunduny, Tobias Gerstenberg, Trenton Chang, Trishala Neeraj, Tushar Khot, Tyler Shultz, Uri Shaham, Vedant Misra, Vera Demberg, Victoria Nyamai, Vikas Raunak, Vinay V. Ramasesh, Vinay Uday Prabhu, Vishakh Padmakumar, Vivek Srikumar, William Fedus, William Saunders, William Zhang, Wout Vossen, Xiang Ren, Xiaoyu Tong, Xinran Zhao, Xinyi Wu, Xudong Shen, Yadollah Yaghoobzadeh, Yair Lakretz, Yangqiu Song, Yasaman Bahri, Yejin Choi, Yichi Yang, Yiding Hao, Yifu Chen, Yonatan Belinkov, Yu Hou, Yufang Hou, Yuntao Bai, Zachary Seid, Zhuoye Zhao, Zijian Wang, Zijie J. Wang, Zirui Wang, Ziyi Wu
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. Trans. Mach. Learn. Res. 2023 (2023)
Gonzalo Jaimovitch-Lopez, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed, María José Ramírez-Quintana
Can language models automate data wrangling? Mach. Learn. 112 (6) (2023)
Xiting Wang, Liming Jiang, José Hernández-Orallo, Luning Sun, David Stillwell, Fang Luo, Xing Xie
Evaluating General-Purpose AI with Psychometrics. CoRR (2023)
Lexin Zhou, Pablo Antonio Moreno Casares, Fernando Martínez-Plumed, John Burden, Ryan Burnell, Lucy Cheke, Cèsar Ferri, Alexandru Marcoci, Behzad Mehrbakhsh, Yael Moros-Daval, Seán Ó hÉigeartaigh, Danaja Rutar, Wout Schellaert, Konstantinos Voudouris, José Hernández-Orallo
Predictable Artificial Intelligence. CoRR (2023)
Ross Gruetzemacher, Alan Chan, Kevin Frazier, Christy Manning, Stepán Los, James Fox, José Hernández-Orallo, John Burden, Matija Franklin, Clíodhna Ní Ghuidhir, Mark M. Bailey, Daniel Eth, Toby Pilditch, Kyle A. Kilian
An International Consortium for Evaluations of Societal-Scale Risks from Advanced AI. CoRR (2023)
Ryan Burnell, Han Hao, Andrew R. A. Conway, José Hernández-Orallo
Revealing the structure of language model capabilities. CoRR (2023)
Radosvet Desislavov, Fernando Martínez-Plumed, José Hernández-Orallo
Trends in AI inference energy consumption: Beyond the performance-vs-parameter laws of deep learning. Sustain. Comput. Informatics Syst. 38 (2023)
Anthony G. Cohn, José Hernández-Orallo
Dialectical language model evaluation: An initial appraisal of the commonsense spatial reasoning abilities of LLMs. CoRR (2023)
Songül Tolan, Annarosa Pesole, Fernando Martínez-Plumed, Enrique Fernández-Macías, José Hernández-Orallo, Emilia Gómez
Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks (Extended Abstract). IJCAI (2022)
José Hernández-Orallo, Wout Schellaert, Fernando Martínez-Plumed
Training on the Test Set: Mapping the System-Problem Space in AI. AAAI (2022)
Konstantinos Voudouris, Niall Donnelly, Danaja Rutar, Ryan Burnell, John Burden, José Hernández-Orallo, Lucy Cheke
Evaluating Object Permanence in Embodied Agents using the Animal-AI Environment. EBeM@IJCAI (2022)
Lexin Zhou, Fernando Martínez-Plumed, José Hernández-Orallo, Cèsar Ferri, Wout Schellaert
Reject Before You Run: Small Assessors Anticipate Big Language Models. EBeM@IJCAI (2022)
Yue Zhao, José Hernández-Orallo
Heterogeneity Breaks the Game: Evaluating Cooperation-Competition with Multisets of Agents. ECML/PKDD (4) (2022)
Tijl De Bie, Luc De Raedt, José Hernández-Orallo, Holger H. Hoos, Padhraic Smyth, Christopher K. I. Williams
Automating data science. Commun. ACM 65 (3) (2022)
Pablo Antonio Moreno Casares, Bao Sheng Loe, John Burden, Seán Ó hÉigeartaigh, José Hernández-Orallo
How General-Purpose Is a Language Model? Usefulness and Safety with Human Prompters in the Wild. AAAI (2022)
Fernando Martínez-Plumed, David Castellano Falcón, Carlos Monserrat Aranda, José Hernández-Orallo
When AI Difficulty Is Easy: The Explanatory Power of Predicting IRT Difficulty. AAAI (2022)
Anthony G. Cohn, José Hernández-Orallo, Julius Sechang Mboli, Yael Moros-Daval, Zhiliang Xiang, Lexin Zhou
A Framework for Categorising AI Evaluation Instruments. EBeM@IJCAI (2022)
Ryan Burnell, John Burden, Danaja Rutar, Konstantinos Voudouris, Lucy Cheke, José Hernández-Orallo
Not a Number: Identifying Instance Features for Capability-Oriented Evaluation. IJCAI (2022)
Cèsar Ferri, José Hernández-Orallo, Jan Arne Telle
Non-Cheating Teaching Revisited: A New Probabilistic Machine Teaching Model. IJCAI (2022)
Gonzalo Jaimovitch-Lopez, David Castellano Falcón, César Ferri, José Hernández-Orallo
Think Big, Teach Small: Do Language Models Distil Occam's Razor? NeurIPS (2021)
Songül Tolan, Annarosa Pesole, Fernando Martínez-Plumed, Enrique Fernández-Macías, José Hernández-Orallo, Emilia Gómez
Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks. J. Artif. Intell. Res. 71 (2021)
Fernando Martínez-Plumed, Emilia Gómez, José Hernández-Orallo
Futures of artificial intelligence through technology readiness levels. Telematics Informatics 58 (2021)
Radosvet Desislavov, Fernando Martínez-Plumed, José Hernández-Orallo
Compute and Energy Consumption Trends in Deep Learning Inference. CoRR (2021)
Richard Evans, José Hernández-Orallo, Johannes Welbl, Pushmeet Kohli, Marek J. Sergot
Making sense of sensory input. Artif. Intell. 293 (2021)
Tijl De Bie, Luc De Raedt, José Hernández-Orallo, Holger H. Hoos, Padhraic Smyth, Christopher K. I. Williams
Automating Data Science: Prospects and Challenges. CoRR (2021)
Manuel Garcia-Piqueras, José Hernández-Orallo
Optimal Teaching Curricula with Compositional Simplicity Priors. ECML/PKDD (1) (2021)
Lidia Contreras Ochando, Cèsar Ferri, José Hernández-Orallo
AUTOMAT[R]IX: learning simple matrix pipelines. Mach. Learn. 110 (4) (2021)
Amparo Alonso-Betanzos, Pedro Cabalar, Graçaliz Pereira Dimuro, Marcos García, José Hernández-Orallo, Raquel Hervás, Angeles Manjarés, Fernando Martínez-Plumed, Inmaculada Mora-Jiménez, Miquel Sànchez-Marrè
Editor's Note. Int. J. Interact. Multim. Artif. Intell. 6 (5) (2021)
Fernando Martínez-Plumed, José Hernández-Orallo
Project-Based Learning for Scaffolding Data Scientists' Skills. ICCSE (2021)
Manuel Garcia-Piqueras, José Hernández-Orallo
Conditional Teaching Size. CoRR (2021)
John Burden, José Hernández-Orallo, Seán Ó hÉigeartaigh
Negative Side Effects and AI Agent Indicators: Experiments in SafeLife. SafeAI@AAAI (2021)
Fernando Martínez-Plumed, Cèsar Ferri, David Nieves, José Hernández-Orallo
Missing the missing values: The ugly duckling of fairness in machine learning. Int. J. Intell. Syst. 36 (7) (2021)
Gust Verbruggen, Lidia Contreras Ochando, Cèsar Ferri, José Hernández-Orallo, Luc De Raedt
Muppets: Multipurpose Table Segmentation. IDA (2021)
Fernando Martínez-Plumed, Lidia Contreras Ochando, Cèsar Ferri, José Hernández-Orallo, Meelis Kull, Nicolas Lachiche, María José Ramírez-Quintana, Peter A. Flach
CRISP-DM Twenty Years Later: From Data Mining Processes to Data Science Trajectories. IEEE Trans. Knowl. Data Eng. 33 (8) (2021)
Fernando Martínez-Plumed, José Hernández-Orallo
Dual Indicators to Analyze AI Benchmarks: Difficulty, Discrimination, Ability, and Generality. IEEE Trans. Games 12 (2) (2020)
José Hernández-Orallo, Jan Arne Telle
Finite and Confident Teaching in Expectation: Sampling from Infinite Concept Classes. ECAI (2020)
David Nieves, María José Ramírez-Quintana, Carlos Monserrat Aranda, Cèsar Ferri, José Hernández-Orallo
Learning alternative ways of performing a task. Expert Syst. Appl. 148 (2020)
Grace Bang, Guy Barash, Ryan Beal, Jacques Calì, Mauricio Castillo-Effen, Xin Cynthia Chen, Niyati Chhaya, Rachel Cummings, Rohan Dhoopar, Sebastijan Dumancic, Huáscar Espinoza, Eitan Farchi, Ferdinando Fioretto, Raquel Fuentetaja, Christopher William Geib, Odd Erik Gundersen, José Hernández-Orallo, Xiaowei Huang, Kokil Jaidka, Sarah Keren, Seokhwan Kim, Michel Galley, Xiaomo Liu, Tyler Lu, Zhiqiang Ma, Richard Mallah, John McDermid, Martin Michalowski, Reuth Mirsky, Seán Ó hÉigeartaigh, Deepak Ramachandran, Javier Segovia Aguas, Onn Shehory, Arash Shaban-Nejad, Vered Shwartz, Siddharth Srivastava, Kartik Talamadupula, Jian Tang, Pascal Van Hentenryck, Dell Zhang, Jian Zhang
The Association for the Advancement of Artificial Intelligence 2020 Workshop Program. AI Mag. 41 (4) (2020)
John Burden, José Hernández-Orallo
Exploring AI Safety in Degrees: Generality, Capability and Control. SafeAI@AAAI (2020)
Fernando Martínez-Plumed, Songül Tolan, Annarosa Pesole, José Hernández-Orallo, Enrique Fernández-Macías, Emilia Gómez
Does AI Qualify for the Job?: A Bidirectional Model Mapping Labour and AI Intensities. AIES (2020)
José Hernández-Orallo, Fernando Martínez-Plumed, Shahar Avin, Jess Whittlestone, Seán Ó hÉigeartaigh
AI Paradigms and AI Safety: Mapping Artefacts and Techniques to Safety Issues. ECAI (2020)
José Hernández-Orallo
AI Safety Landscape From short-term specific system engineering to long-term artificial general intelligence. DSN Workshops (2020)
José Hernández-Orallo
Twenty Years Beyond the Turing Test: Moving Beyond the Human Judges Too. Minds Mach. 30 (4) (2020)
Fernando Martínez-Plumed, José Hernández-Orallo, Emilia Gómez
Tracking AI: The Capability Is (Not) Near. ECAI (2020)
Richard Evans, José Hernández-Orallo, Johannes Welbl, Pushmeet Kohli, Marek J. Sergot
Evaluating the Apperception Engine. CoRR (2020)
Raül Fabra-Boluda, Cèsar Ferri, Fernando Martínez-Plumed, José Hernández-Orallo, M. José Ramírez-Quintana
Family and Prejudice: A Behavioural Taxonomy of Machine Learning Techniques. ECAI (2020)
Lidia Contreras Ochando, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed, María José Ramírez-Quintana, Susumu Katayama
Automated Data Transformation with Inductive Programming and Dynamic Background Knowledge. ECML/PKDD (3) (2019)
José Hernández-Orallo
Gazing into Clever Hans machines. Nat. Mach. Intell. 1 (4) (2019)
Richard Evans, José Hernández-Orallo, Johannes Welbl, Pushmeet Kohli, Marek J. Sergot
Making sense of sensory input. CoRR (2019)
José Hernández-Orallo
AI Generality and Spearman's Law of Diminishing Returns. J. Artif. Intell. Res. 64 (2019)
Benjamin Beyret, José Hernández-Orallo, Lucy Cheke, Marta Halina, Murray Shanahan, Matthew Crosby
The Animal-AI Environment: Training and Testing Animal-Like Artificial Cognition. CoRR (2019)
Cèsar Ferri, José Hernández-Orallo, Peter A. Flach
Setting decision thresholds when operating conditions are uncertain. Data Min. Knowl. Discov. 33 (4) (2019)
Guy Barash, Mauricio Castillo-Effen, Niyati Chhaya, Peter Clark, Huáscar Espinoza, Eitan Farchi, Christopher W. Geib, Odd Erik Gundersen, Seán Ó hÉigeartaigh, José Hernández-Orallo, Chiori Hori, Xiaowei Huang, Kokil Jaidka, Pavan Kapanipathi, Sarah Keren, Seokhwan Kim, Marc Lanctot, Danny Lange, Julian J. McAuley, David R. Martinez, Marwan Mattar, Mausam, Martin Michalowski, Reuth Mirsky, Roozbeh Mottaghi, Joseph C. Osborn, Julien Pérolat, Martin Schmid, Arash Shaban-Nejad, Onn Shehory, Biplav Srivastava, William W. Streilein, Kartik Talamadupula, Julian Togelius, Koichiro Yoshino, Quanshi Zhang, Imed Zitouni
Reports of the Workshops Held at the 2019 AAAI Conference on Artificial Intelligence. AI Mag. 40 (3) (2019)
Fernando Martínez-Plumed, Ricardo B. C. Prudêncio, Adolfo Martínez Usó, José Hernández-Orallo
Item response theory in AI: Analysing machine learning classifiers at the instance level. Artif. Intell. 271 (2019)
José Hernández-Orallo, Karina Vold
AI Extenders: The Ethical and Societal Implications of Humans Cognitively Extended by AI. AIES (2019)
Matthew Crosby, Benjamin Beyret, Murray Shanahan, José Hernández-Orallo, Lucy Cheke, Marta Halina
The Animal-AI Testbed and Competition. NeurIPS (Competition and Demos) (2019)
Lidia Contreras Ochando, César Ferri, José Hernández-Orallo, Fernando Martínez-Plumed, María José Ramírez-Quintana, Susumu Katayama
BK-ADAPT: Dynamic Background Knowledge for Automating Data Transformation. ECML/PKDD (3) (2019)
Fernando Martínez-Plumed, Cèsar Ferri, David Nieves, José Hernández-Orallo
Fairness and Missing Values. CoRR (2019)
Jan Arne Telle, José Hernández-Orallo, Cèsar Ferri
The teaching size: computable teachers and learners for universal languages. Mach. Learn. 108 (8-9) (2019)
José Hernández-Orallo, Fernando Martínez-Plumed, Shahar Avin, Seán Ó hÉigeartaigh
Surveying Safety-relevant AI Characteristics. SafeAI@AAAI (2019)
Lidia Contreras Ochando, Cèsar Ferri, José Hernández-Orallo
Automating Common Data Science Matrix Transformations. PKDD/ECML Workshops (1) (2019)
Fernando Martínez-Plumed, José Hernández-Orallo
Analysing Results from AI Benchmarks: Key Indicators and How to Obtain Them. CoRR (2018)
Emilia Gómez, Carlos Castillo, Vicky Charisi, Verónica Dahl, Gustavo Deco, Blagoj Delipetrev, Nicole Dewandre, Miguel Ángel González Ballester, Fabien Gouyon, José Hernández-Orallo, Perfecto Herrera, Anders Jonsson, Ansgar Koene, Martha A. Larson, Ramón López de Mántaras, Bertin Martens, Marius Miron, Rubén Moreno-Bote, Nuria Oliver, Antonio Puertas Gallardo, Heike Schweitzer, Núria Sebastián, Xavier Serra, Joan Serrà, Songül Tolan, Karina Vold
Assessing the impact of machine intelligence on human behaviour: an interdisciplinary endeavour. CoRR (2018)
Enrique Fernández-Macías, Emilia Gómez, José Hernández-Orallo, Bao Sheng Loe, Bertin Martens, Fernando Martínez-Plumed, Songül Tolan
A multidisciplinary task-based perspective for evaluating the impact of AI autonomy and generality on the future of work. CoRR (2018)
José Hernández-Orallo, Jan Arne Telle
Finite Biased Teaching with Infinite Concept Classes. CoRR (2018)
Fernando Martínez-Plumed, Shahar Avin, Miles Brundage, Allan Dafoe, Seán Ó hÉigeartaigh, José Hernández-Orallo
Accounting for the Neglected Dimensions of AI Progress. CoRR (2018)
Fernando Martínez-Plumed, Bao Sheng Loe, Peter A. Flach, Seán Ó hÉigeartaigh, Karina Vold, José Hernández-Orallo
The Facets of Artificial Intelligence: A Framework to Track the Evolution of AI. IJCAI (2018)
Raül Fabra-Boluda, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed, María José Ramírez-Quintana
Identifying the Machine Learning Family from Black-Box Models. CAEPIA (2018)
Lidia Contreras Ochando, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed, María José Ramírez-Quintana, Susumu Katayama
General-purpose Declarative Inductive Programming with Domain-Specific Background Knowledge for Data Wrangling Automation. CoRR (2018)
Fernando Martínez-Plumed, César Ferri, José Hernández-Orallo, María José Ramírez-Quintana
A computational analysis of general intelligence tests for evaluating cognitive development. Cogn. Syst. Res. 43 (2017)
Raül Fabra-Boluda, Cèsar Ferri, José Hernández-Orallo, Fernando Martínez-Plumed, M. José Ramírez-Quintana
Modelling Machine Learning Models. PT-AI (2017)
José Hernández-Orallo, Marco Baroni, Jordi Bieger, Nader Chmait, David L. Dowe, Katja Hofmann, Fernando Martínez-Plumed, Claes Strannegård, Kristinn R. Thórisson
A New AI Evaluation Cosmos: Ready to Play the Game? AI Mag. 38 (3) (2017)
Fernando Martínez-Plumed, Lidia Contreras Ochando, César Ferri, Peter A. Flach, José Hernández-Orallo, Meelis Kull, Nicolas Lachiche, María José Ramírez-Quintana
CASP-DM: Context Aware Standard Process for Data Mining. CoRR (2017)
Sankalp Bhatnagar, Anna Alexandrova, Shahar Avin, Stephen Cave, Lucy Cheke, Matthew Crosby, Jan Feyereisl, Marta Halina, Bao Sheng Loe, Seán Ó hÉigeartaigh, Fernando Martínez-Plumed, Huw Price, Henry Shevlin, Adrian Weller, Alan F. T. Winfield, José Hernández-Orallo
Mapping Intelligence: Requirements and Possibilities. PT-AI (2017)
José Hernández-Orallo
Evaluation in artificial intelligence: from task-oriented to ability-oriented measurement. Artif. Intell. Rev. 48 (3) (2017)
Kristina Y. Yordanova, Carlos Monserrat, David Nieves, José Hernández-Orallo
Knowledge Extraction from Task Narratives. iWOAR (2017)
José Hernández-Orallo, Fernando Martínez-Plumed, Ute Schmid, Michael Siebers, David L. Dowe
Computer Models Solving Intelligence Test Problems: Progress and Implications (Extended Abstract). IJCAI (2017)
David Nieves, César Ferri, José Hernández-Orallo, Carlos Monserrat
Low-level Event Detection System for Minimally-Invasive Surgery Training. iWOAR (2017)
José Hernández-Orallo, Adolfo Martínez Usó, Ricardo B. C. Prudêncio, Meelis Kull, Peter A. Flach, Chowdhury Farhan Ahmed, Nicolas Lachiche
Reframing in context: A systematic approach for model reuse in machine learning. AI Commun. 29 (5) (2016)
Fernando Martínez-Plumed, Ricardo B. C. Prudêncio, Adolfo Martínez Usó, José Hernández-Orallo
Making Sense of Item Response Theory in Machine Learning. ECAI (2016)
José Hernández-Orallo, Fernando Martínez-Plumed, Ute Schmid, Michael Siebers, David L. Dowe
Computer models solving intelligence test problems: Progress and implications. Artif. Intell. 230 (2016)
José Hernández-Orallo
Is Spearman's Law of Diminishing Returns (SLODR) Meaningful for Artificial Agents? ECAI (2016)
José Hernández-Orallo, César Ferri, Nicolas Lachiche, Adolfo Martínez Usó, M. José Ramírez-Quintana
Binarised regression tasks: methods and evaluation metrics. Data Min. Knowl. Discov. 30 (4) (2016)
Adolfo Martínez Usó, José Hernández-Orallo, M. José Ramírez-Quintana, Fernando Martínez-Plumed
Pentaho + R: An Integral View for Multidimensional Prediction Models. CAEPIA (2015)
Tarek R. Besold, José Hernández-Orallo, Ute Schmid
Can Machine Intelligence be Measured in the Same Way as Human intelligence? Künstliche Intell. 29 (3) (2015)
José Hernández-Orallo
Derek Partridge: What Makes You Clever: The Puzzle of Intelligence - World Scientific, 2013, xvi+447, $25.00, ISBN: 978-981-4513. Minds Mach. 25 (1) (2015)
José Hernández-Orallo
Stochastic Tasks: Difficulty and Levin Search. AGI (2015)
José Hernández-Orallo, Stephen H. Muggleton, Ute Schmid, Benjamin G. Zorn
Approaches and Applications of Inductive Programming (Dagstuhl Seminar 15442). Dagstuhl Reports 5 (10) (2015)
Javier Insa-Cabrera, José Hernández-Orallo
Instrumental Properties of Social Testbeds. AGI (2015)

José Hernández-Orallo.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

José Hernández-Orallo