Papers for

optimization specialists

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Low crossing paths improve algorithms for set system problems

Low-Crossing Spanning Paths via Quasi-Uniform Sampling and their Applications

Abstract: Given a set system (X, S), we consider the problems of constructing perfect matchings and spanning paths (also known as Welzl orders) of X with low crossing numbers with respect to S. Matchings with low crossing numbers were originally introduced in the late 1980s in the seminal works of Welzl [29, 30] and Chazelle-Welzl [7], who showed that any set system (X, S) with bounded dual VC-dimension d has a matching with crossing number O |X| 1-1/d , which is optimal. Low-crossing matchings and spanning paths have found several applications outside of their initial realm of computational geometry, including algorithmic graph theory, model checking, and game theory. In many of these applications, |S| is near-linear in |X|, which motivated the search for an improved construction for this regime. However, the proposed new algorithms provided only average-case bounds or sub-optimal crossing number guarantees for d $\ge$ 2 [5, 12]. We propose a new quasi-uniform sampling based framework. This allows us to obtain a simple algorithm with expected running time of __ |X| 2 + |S| $\bullet$ |X| , which improves upon the previous-best Our result has several immediate consequences, including new faster algorithms for constructing low-crossing spanning paths for set systems induced by balls, as well as for neighborhood set systems of graphs. Moreover, we get the first quadratic-time algorithm for combinatorial discrepancy, with nearly optimal discrepancy (up to a log factor), for bounded dual VC-dimension set systems. Beyond these applications, we believe that our idea could be applied to other algorithms that use the multiplicative weight update method.

Fri 23 OctComputational GeometryData Structures and Algorithms
The gist
This paper deals with ways to connect points with lines so that these lines cross fewer sets in a given system, which is useful in many areas of computer science. The authors introduce a new method using a sampling technique that speeds up the process for certain types of systems and improves performance guarantees. Their approach leads to faster algorithms for connecting points in patterns that are important in geometry and graph theory. It also offers the first quick method to solve a known problem called combinatorial discrepancy for these systems. Overall, it opens the door to better algorithms in areas where crossing low numbers of sets matters.
Open → 2610.32806v1

Large language models improve search with context-aware post training

From Search to Signal: Online Post-Training in Automatic Heuristic Design

Abstract: Large language model (LLM)-based automatic heuristic design (AHD) iteratively proposes and refines heuristics, pairing design rationales with executable code. Task-specific evaluators assess programs; execution outcomes and performance scores guide search. Many AHD systems keep the generator frozen; EvoTune and Co-Evolution of Algorithms and Language Model (CALM) instead update it from evaluated candidates. When such outcomes drive reinforcement learning with verifiable rewards (RLVR), they create a search-coupled loop: the evaluated candidate stream supplies both search-state updates and training signals for the model that generates future candidates. Yet validity and performance do not uniquely determine useful model updates; converting them into learning signals must account for the prompt and evolving search state that produced each candidate. We formulate online post-training of small open-weight LLMs in AHD as context-dependent signal construction and develop alternative mappings from program validity, task performance, and generation context to update signals. Using shared evaluated rollouts and matched update budgets, controlled experiments across AHD tasks and model families compare these mappings with online post-training baselines, testing their effects on validity, performance among valid proposals, and the yield of valid proposals that improve under contextual comparisons. Complementary checkpoint, frozen-search, and live-system evaluations assess whether proposal-level gains appear in updated checkpoint behavior and subsequent search, rather than arising solely from accumulated search state. A resource-matched comparison under pre-specified cost accounting tests whether online updating adds value beyond additional search with a frozen generator. Together, this design avoids treating end-to-end search gains alone as evidence of stronger heuristic-design capabilities.

Wed 30 SeptMachine LearningArtificial Intelligence
The gist
Finding good problem-solving strategies automatically can be tricky and slow because many ideas have to be tested and improved. This paper looks at how small language models, which suggest these strategies, can learn and get better during the search process itself by using feedback about what works well. The authors explore different ways to turn performance feedback into learning signals, considering the context in which strategies were generated. Their experiments show how these online updates can make the models suggest better and more valid solutions, beyond just remembering what happened before.
Open → 2609.39383v1