Tetsuya Sakai

ORCID

Publication Activity (10 Years)

Years Active: 1998-2024
Publications (10 Years): 143

Top Venues

Publications

Tetsuya Sakai, Jinyoung Kim, Inho Kang
A Versatile Framework for Evaluating Ranked Lists in Terms of Group Fairness and Relevance. ACM Trans. Inf. Syst. 42 (1) (2024)
Junjie Wang, Yatai Ji, Yuxiang Zhang, Yanru Zhu, Tetsuya Sakai
Modeling Multimodal Uncertainties via Probability Distribution Encoders Included Vision-Language Models. IEEE Access 12 (2024)
Tetsuya Sakai, Sijie Tao, Nuo Chen, Yujing Li, Maria Maistro, Zhumin Chu, Nicola Ferro
On the Ordering of Pooled Web Pages, Gold Assessments, and Bronze Assessments. ACM Trans. Inf. Syst. 42 (1) (2024)
Kevin Roitero, David La Barbera, Michael Soprano, Gianluca Demartini, Stefano Mizzaro, Tetsuya Sakai
How Many Crowd Workers Do I Need? On Statistical Power when Crowdsourcing Relevance Judgments. ACM Trans. Inf. Syst. 42 (1) (2024)
Yiyao Yu, Junjie Wang, Yuxiang Zhang, Lin Zhang, Yujiu Yang, Tetsuya Sakai
EALM: Introducing Multidimensional Ethical Alignment in Conversational Information Retrieval. CoRR (2023)
Rikiya Takehi, Akihisa Watanabe, Tetsuya Sakai
Open-Domain Dialogue Quality Evaluation: Deriving Nugget-level Scores from Turn-level Scores. SIGIR-AP (2023)
Nuo Chen, Donghyun Park, Hyungae Park, Kijun Choi, Tetsuya Sakai, Jinyoung Kim
Practice and Challenges in Building a Business-oriented Search Engine Quality Metric. SIGIR (2023)
Junjie Wang, Ping Yang, Ruyi Gan, Yuxiang Zhang, Jiaxing Zhang, Tetsuya Sakai
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple-Choice Perspective. IEEE Access 11 (2023)
Tetsuya Sakai
SWAN: A Generic Framework for Auditing Textual Conversational Systems. CoRR (2023)
Yatai Ji, Junjie Wang, Yuan Gong, Lin Zhang, Yanru Zhu, Hongfa Wang, Jiaxing Zhang, Tetsuya Sakai, Yujiu Yang
MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model. CVPR (2023)
Nuo Chen, Jiqun Liu, Tetsuya Sakai
A Reference-Dependent Model for Web Search Evaluation: Understanding and Measuring the Experience of Boundedly Rational Users. WWW (2023)
Yuxiang Zhang, Junjie Wang, Xinyu Zhu, Tetsuya Sakai, Hayato Yamana
NER-to-MRC: Named-Entity Recognition Completely Solving as Machine Reading Comprehension. CoRR (2023)
Haoxiang Shi, Sumio Fujita, Tetsuya Sakai
Towards Consistency Filtering-Free Unsupervised Learning for Dense Retrieval. CoRR (2023)
Yiyao Yu, Junjie Wang, Yuxiang Zhang, Lin Zhang, Yujiu Yang, Tetsuya Sakai
EALM: Introducing Multidimensional Ethical Alignment in Conversational Information Retrieval. SIGIR-AP (2023)
Tetsuya Sakai
Evaluating Parrots and Sociopathic Liars (keynote). ICTIR (2023)
Haoxiang Shi, Tetsuya Sakai
Self-Supervised and Few-Shot Contrastive Learning Frameworks for Text Clustering. IEEE Access 11 (2023)
Zhumin Chu, Tetsuya Sakai, Qingyao Ai, Yiqun Liu
Chuweb21D: A Deduped English Document Collection for Web Search Tasks. SIGIR-AP (2023)
Nuo Chen, Tetsuya Sakai
A Meta-Evaluation of C/W/L/A Metrics: System Ranking Similarity, System Ranking Consistency and Discriminative Power. CoRR (2023)
Tetsuya Sakai
On a Few Responsibilities of (IR) Researchers (Fairness, Awareness, and Sustainability): A Keynote at ECIR 2023. SIGIR Forum 57 (1) (2023)
Qijiong Liu, Nuo Chen, Tetsuya Sakai, Xiao-Ming Wu
A First Look at LLM-Powered Generative News Recommendation. CoRR (2023)
Nuo Chen, Jiqun Liu, Tetsuya Sakai, Xiao-Ming Wu
Decoy Effect in Search Interaction: A Pilot Study. CoRR (2023)
Rikiya Takehi, Akihisa Watanabe, Tetsuya Sakai
Open-Domain Dialogue Quality Evaluation: Deriving Nugget-level Scores from Turn-level Scores. CoRR (2023)
Tetsuya Sakai
Evaluating Parrots and Sociopathic Liars: A keynote at ICTIR 2023. SIGIR Forum 57 (2) (2023)
Tetsuya Sakai, Sijie Tao, Zhaohao Zeng
Relevance Assessments for Web Search Evaluation: Should We Randomise or Prioritise the Pooled Documents? (Corrected Version). CoRR (2022)
Riku Togashi, Mayu Otani, Yuta Nakashima, Esa Rahtu, Janne Heikkilä, Tetsuya Sakai
AxIoU: An Axiomatically Justified Measure for Video Moment Retrieval. CoRR (2022)
Tetsuya Sakai, Sijie Tao, Maria Maistro, Zhumin Chu, Yujing Li, Nuo Chen, Nicola Ferro, Junjie Wang, Ian Soboroff, Yiqun Liu
Corrected Evaluation Results of the NTCIR WWW-2, WWW-3, and WWW-4 English Subtasks. CoRR (2022)
Tetsuya Sakai, Sijie Tao, Zhaohao Zeng
Relevance Assessments for Web Search Evaluation: Should We Randomise or Prioritise the Pooled Documents? ACM Trans. Inf. Syst. 40 (4) (2022)
Tetsuya Sakai, Jin Young Kim, Inho Kang
A Versatile Framework for Evaluating Ranked Lists in terms of Group Fairness and Relevance. CoRR (2022)
Rei Shimizu, Sumio Fujita, Tetsuya Sakai
Do Extractive Summarization Algorithms Amplify Lexical Bias in News Articles? ICTIR (2022)
Yuji Naraki, Tetsuya Sakai, Yoshihiko Hayashi
Evaluating the Effects of Embedding with Speaker Identity Information in Dialogue Summarization. LREC (2022)
Atsuko Natatsuka, Ryo Iijima, Takuya Watanabe, Mitsuaki Akiyama, Tetsuya Sakai, Tatsuya Mori
Understanding the Behavior Transparency of Voice Assistant Applications Using the ChatterBox Framework. RAID (2022)
Yatai Ji, Junjie Wang, Yuan Gong, Lin Zhang, Yanru Zhu, Hongfa Wang, Jiaxing Zhang, Tetsuya Sakai, Yujiu Yang
MAP: Modality-Agnostic Uncertainty-Aware Vision-Language Pre-training Model. CoRR (2022)
Haoxiang Shi, Rongsheng Zhang, Jiaan Wang, Cen Wang, Yinhe Zheng, Tetsuya Sakai
LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency. COLING (2022)
Ping Yang, Junjie Wang, Ruyi Gan, Xinyu Zhu, Lin Zhang, Ziwei Wu, Xinyu Gao, Jiaxing Zhang, Tetsuya Sakai
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice Perspective. CoRR (2022)
Tetsuya Sakai
On Variants of Root Normalised Order-aware Divergence and a Divergence based on Kendall's Tau. CoRR (2022)
Ping Yang, Junjie Wang, Ruyi Gan, Xinyu Zhu, Lin Zhang, Ziwei Wu, Xinyu Gao, Jiaxing Zhang, Tetsuya Sakai
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice Perspective. EMNLP (2022)
Riku Togashi, Mayu Otani, Yuta Nakashima, Esa Rahtu, Janne Heikkilä, Tetsuya Sakai
AxIoU: An Axiomatically Justified Measure for Video Moment Retrieval. CVPR (2022)
Nuo Chen, Fan Zhang, Tetsuya Sakai
Constructing Better Evaluation Metrics by Incorporating the Anchoring Effect into the User Model. SIGIR (2022)
Zhaohao Zeng, Tetsuya Sakai
DCH-2: A Parallel Customer-Helpdesk Dialogue Corpus with Distributions of Annotators' Labels. CoRR (2021)
Junjie Wang, Yatai Ji, Jiaqi Sun, Yujiu Yang, Tetsuya Sakai
MIRTT: Learning Multimodal Interaction Representations from Trilinear Transformers for Visual Question Answering. EMNLP (Findings) (2021)
Jia Chen, Yiqun Liu, Jiaxin Mao, Fan Zhang, Tetsuya Sakai, Weizhi Ma, Min Zhang, Shaoping Ma
Incorporating Query Reformulating Behavior into Web Search Evaluation. CIKM (2021)
Tetsuya Sakai, Zhaohao Zeng
Retrieval Evaluation Measures that Agree with Users' SERP Preferences: Traditional, Preference-based, and Diversity Measures. ACM Trans. Inf. Syst. 39 (2) (2021)
Riku Togashi, Masahiro Kato, Mayu Otani, Tetsuya Sakai, Shin'ichi Satoh
Scalable Personalised Item Ranking through Parametric Density Estimation. CoRR (2021)
Yuki Amemiya, Tomohiro Manabe, Sumio Fujita, Tetsuya Sakai
How Do Users Revise Zero-Hit Product Search Queries? ECIR (2) (2021)
Riku Togashi, Masahiro Kato, Mayu Otani, Tetsuya Sakai, Shin'ichi Satoh
Scalable Personalised Item Ranking through Parametric Density Estimation. SIGIR (2021)
Zhumin Chu, Jiaxin Mao, Fan Zhang, Yiqun Liu, Tetsuya Sakai, Min Zhang, Shaoping Ma
Evaluating Relevance Judgments with Pairwise Discriminative Power. CIKM (2021)
Tetsuya Sakai
Evaluating Evaluation Measures for Ordinal Classification and Ordinal Quantification. ACL/IJCNLP (1) (2021)
Haoxiang Shi, Cen Wang, Tetsuya Sakai
A Simple and Effective Usage of Self-supervised Contrastive Learning for Text Clustering. SMC (2021)
Rikiya Suzuki, Tetsuya Sakai
A Fast and Exact Randomisation Test for Comparing Two Systems with Paired Data. ICTIR (2021)
Tetsuya Sakai
On the Instability of Diminishing Return IR Measures. ECIR (1) (2021)
Tetsuya Sakai, Sijie Tao, Zhaohao Zeng
WWW3E8: 259, 000 Relevance Labels for Studying the Effect of Document Presentation Order for Relevance Assessors. SIGIR (2021)
Tetsuya Sakai
On the Two-Sample Randomisation Test for IR Evaluation. SIGIR (2021)
Tetsuya Sakai
A Closer Look at Evaluation Measures for Ordinal Quantification. CIKM Workshops (2021)
Zhicheng Dou, Xue Yang, Diya Li, Ji-Rong Wen, Tetsuya Sakai
Low-cost, bottom-up measures for evaluating search result diversification. Inf. Retr. J. 23 (1) (2020)
Timo Breuer, Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Philipp Schaer, Ian Soboroff
How to Measure the Reproducibility of System-oriented IR Experiments. SIGIR (2020)
Riku Togashi, Sumio Fujita, Tetsuya Sakai
Automatic Evaluation of Iconic Image Retrieval based on Colour, Shape, and Texture. ICMR (2020)
Shiyoh Goetsu, Tetsuya Sakai
Different Types of Voice User Interface Failures May Cause Different Degrees of Frustration. CoRR (2020)
Tetsuya Sakai
On Fuhr's guideline for IR evaluation. SIGIR Forum 54 (1) (2020)
Tetsuya Sakai, Zhaohao Zeng
Good Evaluation Measures based on Document Preferences. SIGIR (2020)
Sijie Tao, Tetsuya Sakai
RealSakaiLab at the TREC 2020 Health Misinformation Track. TREC (2020)
Timo Breuer, Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Philipp Schaer, Ian Soboroff
How to Measure the Reproducibility of System-oriented IR Experiments. CoRR (2020)
Haoxiang Shi, Cen Wang, Tetsuya Sakai
A Siamese CNN Architecture for Learning Chinese Sentence Similarity. AACL/IJCNLP (Student Research Workshop) (2020)
Riku Togashi, Tetsuya Sakai
Visual Intents vs. Clicks, Likes, and Purchases in E-commerce. SIGIR (2020)
Hsin Wen Liu, Sumio Fujita, Tetsuya Sakai
Towards Automatic Evaluation of Reused Answers in Community Question Answering. AIRS (2019)
Guoshuai Zhao, Hao Fu, Ruihua Song, Tetsuya Sakai, Zhongxia Chen, Xing Xie, Xueming Qian
Personalized Reason Generation for Explainable Song Recommendation. ACM Trans. Intell. Syst. Technol. 10 (4) (2019)
Riku Togashi, Tetsuya Sakai
Generalising Kendall's Tau for Noisy and Incomplete Preference Judgements. ICTIR (2019)
Tetsuya Sakai, Peng Xiao
Randomised vs. Prioritised Pools for Relevance Assessments: Sample Size Considerations. AIRS (2019)
Peng Xiao, Joo-Young Lee, Sijie Tao, Young-Sook Hwang, Tetsuya Sakai
Generating Short Product Descriptors Based on Very Little Training Data. AIRS (2019)
Shiyoh Goetsu, Tetsuya Sakai
Voice Input Interface Failures and Frustration: Developer and User Perspectives. UIST (Adjunct Volume) (2019)
Atsuko Natatsuka, Ryo Iijima, Takuya Watanabe, Mitsuaki Akiyama, Tetsuya Sakai, Tatsuya Mori
Poster: A First Look at the Privacy Risks of Voice Assistant Apps. CCS (2019)
Tetsuya Sakai, Zhaohao Zeng
Which Diversity Evaluation Measures Are "Good"? SIGIR (2019)
Chih-Hao Wang, Sosuke Kato, Tetsuya Sakai
RSL19BD at DBDC4: Ensemble of Decision Tree-Based and LSTM-Based Models. IWSDS (2019)
Zhaohao Zeng, Tetsuya Sakai
BM25 Pseudo Relevance Feedback Using Anserini at Waseda University. OSIRRC@SIGIR (2019)
Rikiya Suzuki, Sumio Fujita, Tetsuya Sakai
Arc Loss: Softmax with Additive Angular Margin for Answer Retrieval. AIRS (2019)
Sosuke Kato, Toru Shimizu, Sumio Fujita, Tetsuya Sakai
Unsupervised Answer Retrieval with Data Fusion for Community Question Answering. AIRS (2019)
Zhaohao Zeng, Ruihua Song, Pingping Lin, Tetsuya Sakai
Attitude Detection for One-Round Conversation: Jointly Extracting Target-Polarity Pairs. J. Inf. Process. 27 (2019)
Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff
Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. CLEF (2019)
Tetsuya Sakai
Graded Relevance Assessments and Graded Relevance Measures of NTCIR: A Survey of the First Twenty Years. CoRR (2019)
Shigeichi Hirasawa, Gendo Kumoi, Hideki Yagi, Manabu Kobayashi, Masayuki Goto, Tetsuya Sakai, Hiroshige Inazumi
System Evaluation of Ternary Error-Correcting Output Codes for Multiclass Classification Problems. SMC (2019)
Ryan Clancy, Nicola Ferro, Claudia Hauff, Jimmy Lin, Tetsuya Sakai, Ze Zhong Wu
The SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019). SIGIR (2019)
Tetsuya Sakai
Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-On Tutorial. WSDM (2019)
Ryan Clancy, Nicola Ferro, Claudia Hauff, Jimmy Lin, Tetsuya Sakai, Ze Zhong Wu
Overview of the 2019 Open-Source IR Replicability Challenge (OSIRRC 2019). OSIRRC@SIGIR (2019)
Chih-Hao Wang, Sosuke Kato, Tetsuya Sakai
RSL19BD at DBDC4: Ensemble of Decision Tree-based and LSTM-based Models. CoRR (2019)
Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff
CENTRE@CLEF 2019. ECIR (2) (2019)
Douglas W. Oard, Tetsuya Sakai, Noriko Kando
Celebrating 20 Years of NTCIR: The Book. EVIA@NTCIR (2019)
Chao-Chung Wu, Ruihua Song, Tetsuya Sakai, Wen-Feng Cheng, Xing Xie, Shou-De Lin
Evaluating Image-Inspired Poetry Generation. NLPCC (1) (2019)
Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff
CENTRE@CLEF2019: Overview of the Replicability and Reproducibility Tasks. CLEF (Working Notes) (2019)
Zhaohao Zeng, Ruihua Song, Pingping Lin, Tetsuya Sakai
Attitude Detection for One-Round Conversation: Jointly Extracting Target-Polarity Pairs. WSDM (2019)
Yiqun Liu, Makoto P. Kato, Charles L. A. Clarke, Noriko Kando, Tetsuya Sakai
Report on NTCIR-13: The Thirteenth Round of NII Testbeds and Community for Information Access Research. SIGIR Forum 52 (1) (2018)
Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff
CENTRE@CLEF2018: Overview of the Replicability Task. CLEF (Working Notes) (2018)
Tetsuya Sakai
Topic Set Size Design for Paired and Unpaired Data. ICTIR (2018)
Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff
Overview of CENTRE@CLEF 2018: A First Tale in the Systematic Reproducibility Realm. CLEF (2018)
Tetsuya Sakai
Comparing Two Binned Probability Distributions for Information Access Evaluation. SIGIR (2018)
Takuya Watanabe, Mitsuaki Akiyama, Tetsuya Sakai, Hironori Washizaki, Tatsuya Mori
Understanding the Inconsistency between Behaviors and Descriptions of Mobile Apps. IEICE Trans. Inf. Syst. (11) (2018)
Tetsuya Sakai
Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial. SIGIR (2018)
Zhaohao Zeng, Cheng Luo, Lifeng Shang, Hang Li, Tetsuya Sakai
Towards Automatic Evaluation of Customer-Helpdesk Dialogues. J. Inf. Process. 26 (2018)
Xiaojie Wang, Ji-Rong Wen, Zhicheng Dou, Tetsuya Sakai, Rui Zhang
Search Result Diversity Evaluation Based on Intent Hierarchies. IEEE Trans. Knowl. Data Eng. 30 (1) (2018)
Kenta Tamaki, Riku Togashi, Sosuke Kato, Sumio Fujita, Hideyuki Maeda, Tetsuya Sakai
Classifying Community QA Questions That Contain an Image. ICTIR (2018)
Guoshuai Zhao, Hao Fu, Ruihua Song, Tetsuya Sakai, Xing Xie, Xueming Qian
Why You Should Listen to This Song: Reason Generation for Explainable Recommendation. ICDM Workshops (2018)
Tetsuya Sakai
Towards Automatic Evaluation of Multi-Turn Dialogues: A Task Design that Leverages Inherently Subjective Annotations. EVIA@NTCIR (2017)

Tetsuya Sakai.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Tetsuya Sakai