Grid Search Hyperparameter Benchmarking of BERT, ALBERT, and LongFormer on DuoRC.
Alex John QuijanoSam NguyenJuanita OrdonezPublished in: CoRR (2021)
Keyphrases
- grid search
- hyperparameters
- cross validation
- random forest
- generalization ability
- support vector machine
- model selection
- random search
- gaussian process
- support vector regression
- parameter values
- parameter optimization
- bayesian inference
- support vector
- bilevel programming
- meta learning
- closed form
- prior information
- bayesian framework
- random sampling
- incremental learning
- training set
- decision trees
- em algorithm
- incomplete data
- fold cross validation
- gaussian processes
- maximum likelihood
- support vector machine svm
- probabilistic model
- parameter estimation
- noise level
- sample size
- missing values
- learning algorithm
- maximum a posteriori
- upper bound
- kernel function
- genetic algorithm