Aakriti Budhraja

Publication Activity (10 Years)

Years Active: 2020-2021
Publications (10 Years): 5

Top Topics

Information Theory

Statistical Models

Magnetic Recording

Top Venues

Publications

Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra
The Heads Hypothesis: A Unifying Statistical Approach Towards Understanding Multi-Headed Attention in BERT. AAAI (2021)
Aakriti Budhraja, Madhura Pande, Pratyush Kumar, Mitesh M. Khapra
On the Prunability of Attention Heads in Multilingual BERT. CoRR (2021)
Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra
The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT. CoRR (2021)
Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra
On the Importance of Local Information in Transformer Based Models. CoRR (2020)
Aakriti Budhraja, Madhura Pande, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra
On the weak link between importance and prunability of attention heads. EMNLP (1) (2020)