Ruchira’s Homepage
🎓 Short Intro: Hello there! I’m a PhD Researcher in Natural Language Processing and AI, supervised by Dr. Anders Søgaard, in the CoAStaL Lab at the Department of Computer Science, University of Copenhagen. Additionally, I am involved with the Centre of Philosophy of AI, exploring the societal and ethical dimensions of AI.
🧠 Research Interests: My research focus is on the science of evaluation of Large Language Models (LLMs)- What are the goals of evaluation for AI systems today? How do we evaluate intelligence? Are our current evaluation practices rigorous enough to measure actual scientific progress of the field? What can we do to make these systems’ strengths and limitations more interpretable and actionable for the general public?. On a related note, I’m also interested in AI Policy and Governance and how evaluation practices can play a key role in such efforts.
👩🏽🏫 Teaching: I serve as a Teaching Assistant for the NLP Course in 2025. I was also the TA for the course last year.
👥 Affiliations: I’m a community lead at Cohere Labs ,formerly Cohere For AI, where I host talks, socials, and meetups to foster open-source research and collaborations in AI research. I am also a Venture Fellow at Creator Fund for 2025-2026.
🚶🏽♀️➡️ Hobbies: I love reading about art history and dabbling in oil painting!
📢 Contact: You can reach me on Linkedin or at rudh@di.ku.dk.
Research Updates
Selected Publications
Realist and Pluralist Conceptions of Intelligence and Their Implications on AI (Alignment) Research
Ninell Oldenburg, Ruchira Dhar, Anders Søgaard
Forthcoming in AAAI 2026 (Alignment Track)
On the Measure of a Model:From Intelligence to Generality
Ruchira Dhar, Ninell Oldenburg, Anders Søgaard
The Science of Benchmarking and Evaluating AI, EurIPS Workshop, 2025
EvalCards: A Framework for Standardized Evaluation Reporting
Dhar et al
The Science of Benchmarking and Evaluating AI, EurIPS Workshop, 2025
Beyond Technocratic XAI: The Who, What & How in Explanation Design
Ruchira Dhar , Stephanie Brandl, Ninell Oldenburg, Anders Søgaard
AIES 2025 (Main Conference)
Evaluating Multimodal Language Models as Visual Assistants for Visually Impaired Users
Antonia Karamolegkou, Malvina Nikandrou, Georgios Pantazopoulos, Danae Sanchez Villegas, Phillip Rust, Ruchira Dhar, Daniel Hershcovich, Anders Søgaard
ACL 2025 (Main Conference)
Investigating the Role of Modality and Training Objective on Representational Alignment Between Transformers and the Brain
Hyewon Willow Han, Ruchira Dhar, Qingqing Yang, Maryam Hoseini Behbahani, María Alejandra Martínez Ortiz, Tolulope Samuel Oladele, Diana C Dima, Hsin-Hung Li, Anders Søgaard, Yalda Mohsenzadeh
NeurIPS 2024 (UniReps Worskhop Proceedings)
Defining Knowledge: Bridging Epistemology and Large Language Models
Constanza Fierro, Ruchira Dhar, Filippos Stamatiou, Nicolas Garneau, Anders Søgaard
EMNLP 2024 (Main Conference)
Presentations/Invited Talks
Are We Testing the Right Things in Multi-Agent AI?
Ruchira Dhar
St John’s College, Cambridge, UK (Hosted by UKAI Forum and Meridian Cambridge), 2025
From Words to Worlds: Compositionality for Cognitive Architectures
Ruchira Dhar
LLMs & Cognition Workshop @ ICML (International Conference on Machine Learning), 2024
The Completeness Problem: Beyond Human Metrics in Assessing Abilities of Cognitive Systems
Ninell Oldenburg, Ruchira Dhar
ACAIN (International Symposium on AI & Neuroscience), 2024
Compositionality in Language Models: A Perspective in Changing Interpretations and Methods
Ruchira Dhar
AIAI (Symposium on Agency and Intentions in AI), 2024