AI and humans solve math problems using different research styles
AI and Human Approaches to Mathematical Problem Solving
Computers and SocietyArtificial Intelligence
Summary
AI systems and human mathematicians both tackle tough math problems, but they do it differently. The researchers looked at papers from both groups on the same math challenges. They found AI focuses more on finishing problems and linking ideas between fields, while humans explain their methods and highlight what’s still unknown or needs further work. This shows that AI and humans contribute to math knowledge in complementary ways.
What this means in practice
- •For software developers of ai research tools: Design AI systems that better document methods and uncertainties to align with human research practices and support cumulative knowledge building.
- •For science policy makers: Create evaluation frameworks for AI research that consider how AI organizes inquiry, not just whether problems are solved.
Authors
Yang Ding
Abstract
AI systems have begun to report solutions, disproofs, and substantive advances on long-standing mathematical problems, raising questions about whether they approach research in the same way as mathematicians. This study compares public AI research accounts with the human literature on 11 such problems. The human corpus contains 58 papers that directly addressed the same mathematical targets later reported by AI sources as resolved, disproved, or substantially advanced; 31 within-problem comparisons were constructed from these materials. Six validated text-based measures capture problem resolution, method articulation, uncertainty and boundary specification, successor-question generation, generality, and cross-disciplinary integration. AI accounts place greater emphasis on resolving the focal problem and connecting ideas across fields. Human papers devote significantly more attention to explaining methods, specifying assumptions and limitations, and identifying questions for subsequent research. No precise difference is detected in generality. The estimated directions remain unchanged when each mathematical problem is removed in turn. The findings reveal two distinct research profiles: AI accounts concentrate on closing and recombining problems, whereas mathematical papers more extensively document the procedures, limits, and research opportunities through which results become cumulative knowledge. Evaluating research AI therefore requires attention to the organization of inquiry, not only whether a target is solved.