Scaling Vision Transformers to 22 Billion Parameters.

Mostafa Dehghani Josip Djolonga Basil Mustafa Piotr Padlewski Jonathan Heek Justin Gilmer Andreas Peter Steiner Mathilde Caron Robert Geirhos Ibrahim Alabdulmohsin Rodolphe Jenatton Lucas Beyer Michael Tschannen Anurag Arnab Xiao Wang Carlos Riquelme Ruiz Matthias Minderer Joan Puigcerver Utku Evci Manoj Kumar Sjoerd van Steenkiste Gamaleldin Fathy Elsayed Aravindh Mahendran Fisher Yu Avital Oliver Fantine Huot Jasmijn Bastings Mark Collier Alexey A. Gritsenko Vighnesh Birodkar Cristina Nader Vasconcelos Yi Tay Thomas Mensink Alexander Kolesnikov Filip Pavetic Dustin Tran Thomas Kipf Mario Lucic Xiaohua Zhai Daniel Keysers Jeremiah J. Harmsen Neil Houlsby

Published in: ICML (2023)

Keyphrases

real time
computer vision
maximum likelihood
parameter estimation
image processing
vision system
input parameters
maximum likelihood estimation
fine tuning
learning environment
sensitivity analysis
parameter space
parameter values
parameter settings
parameter tuning
measured data