The Effect of Inter-Assessor Disagreement on IR System Evaluation: A Case Study with Lancers and Students.
Tetsuya SakaiPublished in: EVIA@NTCIR (2017)
Keyphrases
- relevance assessments
- student learning
- learning experience
- case study
- college students
- learning environment
- higher education
- ir evaluation
- learning outcomes
- e learning
- university students
- distance learning
- learning activities
- test collection
- learning styles
- high school
- evaluation measures
- interactive information retrieval
- evaluation framework
- assessment process
- high school students
- learning to rank algorithms
- relevance judgments
- tutoring system
- online course
- evaluation metrics
- distance education
- learning to rank
- collaborative learning
- concept maps
- science education
- retrieval effectiveness
- text retrieval
- computer self efficacy
- university level
- mobile learning
- learning process
- factorial design
- learning algorithm