Papers for

science software engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Scientific language models improved for clearer research conversations

CollabSciReM: Aligning Language Models for Scientific Conversations via Science-Aware Reward Decomposition

Abstract: Large Language Models (LLMs) are increasingly used as research collaborators for hypothesis refinement, methodological planning, and technical analysis across multi-turn interactions. In this setting, a useful assistant must be accurate, methodologically justified, logically consistent, and token-efficient. Current alignment approaches rarely achieve all of these together. Instruction-tuned models gain conversational quality through verbosity, and we show that science-agnostic general collaborative rewards compress responses at the expense of scientific rigor. We propose CollabSciReM, a goal-conditioned reward framework that decomposes the session-level reward into conversational quality, scientific rigor, and structural efficiency. We also introduce SciQuality, a pairwise evaluation of multi-turn research conversations grounded in 300 held-out scientific papers and scored on six dimensions: methodological soundness, justification, logical consistency, factual correctness, novelty, and responsiveness. Fine-tuned on 8.62K synthetic research conversations, CollabSciReM is preferred on SciQuality over a science-agnostic reward baseline trained on the same data for all four Llama and Qwen models, including a 65.3% win rate at matched response length. For the 7B and 8B models, CollabSciReM outperforms the science-agnostic reward baseline on the primary metric in 8 of 10 single- and multi-turn benchmark settings. In a blind study, domain experts rated CollabSciReM significantly higher on novelty than the general-reward variant and reported fewer hallucinated responses than both the general-reward variant and the base model.

Tue 20 OctComputation and LanguageArtificial Intelligence
The gist
Language models can help scientists talk through research ideas, but they often give answers that are too long or not precise enough. The authors created CollabSciReM, a way to train these models to give clearer, more accurate, and efficient scientific responses. They tested it with models like Llama and Qwen and found that CollabSciReM’s answers were preferred for being more novel and less prone to mistakes. This approach breaks down what makes a good scientific conversation into parts like accuracy, logic, and length to improve the model’s performance.
Open → 2610.27901v1