Papers for

natural language interface developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Instruction tuning for Text-to-SQL works well with less data

LIMIT: Less Is More for Instruction Tuning in Text-to-SQL

Abstract: Large language models have achieved remarkable progress on Text-to-SQL through reasoning-enhanced fine-tuning, yet existing approaches predominantly rely on massive instruction corpora under the assumption that scale drives performance. We challenge this paradigm by investigating a fundamental question: what is the minimal data requirement for effective Text-to-SQL instruction tuning? We propose LIMIT(Less Is More for Instruction Tuning in Text-to-SQL), a data-centric framework that demonstrates strong database reasoning can emerge from an extremely compact training set when examples are strategically selected. LIMIT operates through four stages: difficulty-aware filtering that identifies samples within the model's learning frontier, chain-of-thought synthesis with consistency-based selection, multi-dimensional quality scoring via LLM-as-judge, and genetic algorithm optimization that jointly maximizes schema coverage and sample quality. On the BIRD and Spider benchmark, LIMIT selects only 796 and 863 samples while achieving 100% table coverage, enabling Qwen3-8B to reach 69.1% and 88.9% execution accuracy.This result surpasses methods trained on 20 times more data and establishes a new state-of-the-art among open-source approaches. Our findings suggest that careful data curation, rather than scale, is the key to efficient Text-to-SQL learning.

Mon 21 SeptArtificial Intelligence
The gist
Converting questions into database queries usually requires training large language models with lots of examples. This paper finds that carefully choosing a small set of examples is more effective than using a large amount of data. The authors developed a method called LIMIT that picks the most useful samples based on difficulty, consistency, diversity, and quality. With only a few hundred examples, they matched or beat performance of systems trained on much more data.
Open 2609.24186v1

Pretrained image generators show competence on visual tasks zero shot

Are Image Generators Zero-Shot Perceivers? A Rigorous Evaluation

Abstract: Recent work, such as Vision Banana, shows that lightweight instruction tuning can enable an image generator to achieve state-of-the-art performance across multiple visual perception tasks. Motivated by this perspective, we ask how far image generators can go on public visual perception benchmarks in a zero-shot setting. We introduce ProbeGen, a benchmark for zero-shot generative perception that casts monocular depth estimation, referring/reasoning segmentation, and object counting as conditional generation tasks specified through text prompts, and compares 20 models in total---including proprietary and open-weight image generators, specialist perception models, and MLLMs---across 11 published benchmarks. We observe that pretrained image generators show measurable zero-shot perceptual competence, but with a clear trade-off: specialist models remain stronger for in-distribution accuracy and efficiency, while generative models are often more robust under distribution shift and better at compositional semantic reasoning. We hope this study helps establish zero-shot generative perception as a meaningful research direction and provides a useful foundation for future work at the intersection of visual generation and understanding.

Mon 7 SeptComputer Vision and Pattern Recognition
The gist
The paper studies how well image-generating AI models can understand and interpret images without additional training, called zero-shot learning. The authors created a new benchmark called ProbeGen to test tasks like depth estimation, segmentation, and counting using text prompts. They found that while specialized AI models perform better on known data and run more efficiently, image generators are often more adaptable when faced with new kinds of images and more skilled at complex reasoning. This suggests that image generators have some surprising abilities in image understanding beyond just creating pictures.
Open 2609.07884v1