Publications

2025

Derivational Probing: Unveiling the Layer-wise Construction of Syntactic Structures in Neural Language Models

Taiga Someya, Ryo Yoshida, Hitomi Yanaka, Yohei Oseki

CoNLL 2025

★ Oral

Information Locality as an Inductive Bias for Neural Language Models

Taiga Someya, Anej Svete, Brian DuSell, Timothy J. O'Donnell, Mario Giulianelli, Ryan Cotterell

ACL 2025

★ Oral + Panel (Top 0.8%)

If Attention Serves as a Cognitive Model of Human Memory Retrieval, What is the Plausible Memory Representation?

Ryo Yoshida, Shinnosuke Isono, Kohei Kajikawa, Taiga Someya, Yushi Sugimoto, Yohei Oseki

ACL 2025

Live Football Commentary (LFC): A Large-Scale Dataset for Building Football Commentary Generation Models

Taiga Someya, Tatsuya Ishigaki, Hiroya Takamura

INLG 2025

2024

Targeted Syntactic Evaluations on the Chomsky Hierarchy

Taiga Someya, Ryo Yoshida, Yohei Oseki

LREC-COLING 2024

★ Best Paper Award (1/1554; Top 0.06%)

Tree-Planted Transformers: Unidirectional Transformer Language Models with Implicit Syntactic Supervision

Ryo Yoshida, Taiga Someya, Yohei Oseki

ACL 2024 Findings

FootballGPT: Counterfactual Evaluation With a Foundation Model for Football

Taiga Someya, Atom Scott, Keisuke Fujii, Hidehisa Akiyama, Tomoharu Nakashima, Hitomi Yanaka

Opta Forum 2024

Interpretable Low-Dimensional Modeling of Spatiotemporal Agent States for Decision Making in Football Tactics

Kenjiro Ide, Taiga Someya, Kohei Kawaguchi, Keisuke Fujii

icSPORTS 2024

JCoLA: Japanese Corpus of Linguistic Acceptability

Taiga Someya, Yushi Sugimoto, Yohei Oseki

LREC-COLING 2024

Leveraging Player Embeddings for Soccer Event Prediction

Taiga Someya, Tatsuya Ishigaki, Yohei Oseki, Ryo Nagata, Hiroya Takamura

IT4PSS Workshop at IJCAI 2024

2023

JBLiMP: Japanese Benchmark of Linguistic Minimal Pairs

Taiga Someya, Yohei Oseki

EACL 2023 Findings