Are Large Kernels Better Teachers than Transformers for ConvNets?
Tianjin HuangLu YinZhenyu ZhangLi ShenMeng FangMykola PechenizkiyZhangyang WangShiwei LiuPublished in: CoRR (2023)
Keyphrases
- feed forward
- professional development
- learning environment
- kernel function
- high school
- neural network
- learning process
- e learning
- artificial neural networks
- linear combination
- back propagation
- elementary school
- student learning
- kernel methods
- educational technology
- technology enhanced
- support vector
- learning scenarios
- authoring tool
- learning community
- feature space
- high school students
- multiple kernel learning
- genetic algorithm
- secondary school
- learning opportunities
- middle school students
- teaching materials
- problem based learning
- blended learning
- learning analytics
- distance learning
- fuzzy logic
- learning sciences
- learning design
- subject matter
- kernel learning
- teacher education
- middle school
- support vector machine
- pre service