Papers for

language service providers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Language models enable accurate science translations for better education

CRITICS - Critical Science Without Borders: Language Models to Promote Critical Thinking in Science Education

Abstract: The CRITICS project addresses science accessibility and literacy by converging advanced Machine Translation (MT) based on Large Language Models (LLMs) with educational technology. By leveraging MT systems specifically optimized for scientific content, educational institutions can provide accurate, culturally relevant translations of scientific materials in students' native languages, ensuring that complex scientific concepts are comprehensible while maintaining technical accuracy. Building on these translations, the project explores the design and evaluation of innovative science teaching-learning proposals grounded in curriculum-aligned teaching-learning. Thus, CRITICS will investigate key components of scientific argumentation and critical thinking practices together with textual feedback aligned with learning objectives and assessment criteria inspired by competence-based evaluation frameworks. CRITICS aims to break down language barriers to accessing cutting-edge research and educational materials currently available only in high-resourced languages, thereby facilitating the democratization of scientific knowledge and fostering critical thinking in science education.

Sat 12 SeptComputation and LanguageArtificial Intelligence
The gist
Many scientific materials are only available in a few languages, making it hard for students worldwide to understand them. The authors of this paper show how advanced language models can translate science content into students' native languages without losing accuracy. This helps students learn complex science ideas more clearly and promotes better critical thinking skills. They also suggest ways to create lessons and feedback that match school goals and tests.
Open 2609.13942v1

North Small Translate delivers fast high-quality machine translation in 50 languages

North Small Translate: Advanced Cost-Effective Translation (Cohere CAT+)

Abstract: We present North Small Translate, an open-weight, LLM-based machine translation (MT) model with instruction-following capabilities built on the same foundation as Cohere's Command A Plus, a mixture-of-experts architecture with 25 billion active parameters out of 218 billion total parameters. North Small Translate is trained using difficulty sampling to obtain challenging documents and a five-step training protocol combining supervised fine-tuning, direct preference optimization, and online reinforcement learning. We prioritized throughput through a non-reasoning base model and supplemented with optional agentic capabilities to unlock translation quality gains. North Small Translate is trained to perform MT-related tasks, including post-editing and quality estimation, as well as related tasks such as general instruction following. The model achieves top MT performance across 50 languages in the class of models under 1T parameters, with no need to run expensive reasoning at inference time.

Sat 12 SeptComputation and Language
The gist
Translation software helps people understand text written in different languages, but it can be slow or inaccurate. The authors created North Small Translate, a large AI model designed to translate up to 50 languages quickly and well. It uses a smart training method that focuses on hard examples and a mix of learning steps to improve. Unlike some translation tools, it doesn’t need slow reasoning during use, making it fast. It also supports related tasks like improving translations and checking their quality.
Open 2609.13916v1

Fine-tuning models improves tasks by choosing change directions

Drift-Constrained Optimization: Only Direction Matters in Fine-Tuning Instruct Models

Abstract: Fine-tuning instruct models often improves target performance while inducing behavioral drift from the reference model, which can degrade existing capabilities. Rather than treating this drift as an uncontrolled consequence of optimization, we specify a behavioral drift budget before optimization and ask how to boost the target-task performance within it. Locally, behavioral drift induces a shared geometry anchored at the reference model, with the drift budget defining a boundary within this space. In this space, drift determines distance from the reference, leaving update direction as the remaining degree of freedom. Fine-tuning updates can therefore be compared through their directional efficiency, naturally reformulating fine-tuning as a direction-selection problem. This reformulation makes a concrete prediction: changing the accessible directions can qualitatively alter the outcome of fine-tuning. We test this prediction in a stringent QA-only setting, where strong instruct models are fine-tuned only on final answers but must still generate multi-step reasoning at inference. Despite this mismatch, a coarse layer-selective probe reverses the failure of QA-only fine-tuning and reveals the existence of effective directions, with multiple neighboring configurations improving target performance while preserving reasoning and general capabilities. Across Qwen3-8B and Qwen3-14B, these directions substantially improve scientific reasoning and multilingual translation. Over more than 100 languages, the resulting models match or outperform dedicated translation systems and provide a stronger initialization for subsequent reinforcement learning. Our results suggest that fine-tuning is not just about how much a model changes, but how that change is spent. https://github.com/CONE-MT/DCO and https://huggingface.co/collections/LLaMAX/dco

Sat 12 SeptArtificial Intelligence
The gist
Fine-tuning AI models often changes how they behave in ways that can hurt their other abilities. The authors propose limiting how much a model can drift from its original behavior and then focusing on picking the best direction to update the model within that limit. They tested this by fine-tuning models only on question answers, yet still preserving their reasoning skills by selecting specific layers to update. This method improved performance on scientific reasoning and language translation across many languages.
Open 2609.13680v1