João Miguel Coelho
My research interests lie in the areas of Machine Learning, Natural Language Processing, and Information Retrieval.
Currently a PhD Candidate at IST (DEEC) and CMU (LTI), under the dual degree CMU-Portugal program, supervised by Bruno Martins, João Magalhães, and Chenyan Xiong.
My current research focuses on dense retrieval and deep search systems, including training LLM search agents with reinforcement learning, and building infrastructure for deep research. During summer 2025, I worked with the AWS Connect team at Amazon on agentic search for contact centers.
Recent Work
- Oct 2026A conversational query rewriting agent that iteratively refines its queries based on the documents it retrieves, trained with reinforcement learning using retrieval quality as the only reward, without human rewrite annotations.
- Jun 2026Returning zero-variance queries to the training pool for later resampling makes GRPO training of search agents more effective, with a 1.7B agent matching prior systems of up to 7B parameters.
- Jun 2026DivInit is a training-free method that picks diverse first-turn queries for parallel search trajectories, reducing the redundancy that limits standard parallel sampling.
selected publications
- ICTIRDeepResearchGym: A Free, Transparent, and Reproducible Sandbox for Deep ResearchProceedings of the ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval, 2026
- ACLDwell in the Beginning: How Language Models Embed Long Documents for Dense RetrievalProceedings of the Annual Meeting of the Association for Computational Linguistics, 2024