Ivan Stelmakh

Publication Activity (10 Years)

Years Active: 2018-2024
Publications (10 Years): 26

Top Topics

Automatic Transcription

Peer Assessment

Top Venues

Publications

Charvi Rastogi, Xiangchen Song, Zhijing Jin, Ivan Stelmakh, Hal Daumé III, Kun Zhang, Nihar B. Shah
A Randomized Controlled Trial on Anonymizing Reviewers to Each Other in Peer Review Discussions. CoRR (2024)
Alexander Goldberg, Ivan Stelmakh, Kyunghyun Cho, Alice H. Oh, Alekh Agarwal, Danielle Belgrave, Nihar B. Shah
Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments. CoRR (2023)
Ivan Stelmakh, John Wieting, Graham Neubig, Nihar B. Shah
A Gold Standard Dataset for the Reviewer Assignment Problem. CoRR (2023)
Ivan Stelmakh, Yi Luan, Bhuwan Dhingra, Ming-Wei Chang
ASQA: Factoid Questions Meet Long-Form Answers. EMNLP (2022)
Charvi Rastogi, Ivan Stelmakh, Xinwei Shen, Marina Meila, Federico Echenique, Shuchi Chawla, Nihar B. Shah
To ArXiv or not to ArXiv: A Study Quantifying Pros and Cons of Posting Preprints Online. CoRR (2022)
Ivan Stelmakh, Charvi Rastogi, Ryan Liu, Shuchi Chawla, Federico Echenique, Nihar B. Shah
Cite-seeing and Reviewing: A Study on Citation Bias in Peer Review. CoRR (2022)
Charvi Rastogi, Ivan Stelmakh, Nihar B. Shah, Sivaraman Balakrishnan
No Rose for MLE: Inadmissibility of MLE for Evaluation Aggregation Under Levels of Expertise. ISIT (2022)
Charvi Rastogi, Ivan Stelmakh, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, Zhenyu Xue, Hal Daumé III, Emma Pierson, Nihar B. Shah
How do Authors' Perceptions of their Papers Compare with Co-authors' Perceptions and Peer-review Decisions? CoRR (2022)
Ivan Stelmakh, Yi Luan, Bhuwan Dhingra, Ming-Wei Chang
ASQA: Factoid Questions Meet Long-Form Answers. CoRR (2022)
Ivan Stelmakh, Nihar B. Shah, Aarti Singh, Hal Daumé III
Prior and Prejudice: The Novice Reviewers' Bias against Resubmissions in Conference Peer Review. Proc. ACM Hum. Comput. Interact. 5 (CSCW1) (2021)
Nikita Pavlichenko, Ivan Stelmakh, Dmitry Ustalov
Vox Populi, Vox DIY: Benchmark Dataset for Crowdsourced Audio Transcription. CoRR (2021)
Ivan Stelmakh, Nihar B. Shah, Aarti Singh
PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Review. J. Mach. Learn. Res. 22 (2021)
Ivan Stelmakh, Nihar B. Shah, Aarti Singh
Catch Me if I Can: Detecting Strategic Behaviour in Peer Assessment. AAAI (2021)
Dmitry Ustalov, Nikita Pavlichenko, Ivan Stelmakh, Dmitriy Kuznetsov
VLDB 2021 Crowd Science Challenge on Aggregating Crowdsourced Audio Transcriptions. CSW@VLDB (2021)
Nikita Pavlichenko, Ivan Stelmakh, Dmitry Ustalov
CrowdSpeech and Vox DIY: Benchmark Dataset for Crowdsourced Audio Transcription. NeurIPS Datasets and Benchmarks (2021)
Jingyan Wang, Ivan Stelmakh, Yuting Wei, Nihar B. Shah
Debiasing Evaluations That Are Biased by Evaluations. AAAI (2021)
Ivan Stelmakh, Nihar B. Shah, Aarti Singh, Hal Daumé III
A Novice-Reviewer Experiment to Address Scarcity of Qualified Reviewers in Large Conferences. AAAI (2021)
Ivan Stelmakh
Towards Fair, Equitable, and Efficient Peer Review. AAAI (2021)
Ivan Stelmakh, Charvi Rastogi, Nihar B. Shah, Aarti Singh, Hal Daumé III
A Large Scale Randomized Controlled Trial on Herding in Peer-Review Discussions. CoRR (2020)
Ivan Stelmakh, Nihar B. Shah, Aarti Singh, Hal Daumé III
Prior and Prejudice: The Novice Reviewers' Bias against Resubmissions in Conference Peer Review. CoRR (2020)
Jingyan Wang, Ivan Stelmakh, Yuting Wei, Nihar B. Shah
Debiasing Evaluations That are Biased by Evaluations. CoRR (2020)
Ivan Stelmakh, Nihar B. Shah, Aarti Singh
Catch Me if I Can: Detecting Strategic Behaviour in Peer Assessment. CoRR (2020)
Ivan Stelmakh, Nihar B. Shah, Aarti Singh, Hal Daumé III
A Novice-Reviewer Experiment to Address Scarcity of Qualified Reviewers in Large Conferences. CoRR (2020)
Ivan Stelmakh, Nihar B. Shah, Aarti Singh
On Testing for Biases in Peer Review. NeurIPS (2019)
Ivan Stelmakh, Nihar B. Shah, Aarti Singh
PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Review. ALT (2019)
Ivan Stelmakh, Nihar B. Shah, Aarti Singh
PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Review. CoRR (2018)