Papers for

engineering design teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

New optimization method speeds up medium-scale black-box searches

A practical DIRECT-type algorithm for medium-scale black-box global optimization

Abstract: The DIRECT algorithm is a deterministic global optimization method known for its versatility and balanced exploration-exploitation strategy. However, DIRECT-type algorithms are primarily effective for low-dimensional problems and often exhibit slow convergence as dimensionality increases, limiting their applicability to more complex optimization tasks. To address this limitation, this paper introduces X-DTC-GL, a novel DIRECT-type algorithm that incorporates dynamic partitioning and hybridization techniques. The dynamic partitioning approach adaptively refines the search space based on local one-dimensional surrogate models, enabling rapid subdivision of promising hyper-rectangles. The hybridization strategy selectively employs a hill-climbing method to exploit promising regions identified by the surrogate models. Extensive experiments on four diverse benchmark suites demonstrate that X-DTC-GL significantly outperforms existing DIRECT-type baselines, achieving improvements of ~12% in solvability and ~27% in solution quality. Performance-profile analyses indicate the fastest convergence on up to ~40% of instances, the best runtime performance on ~17% of problems, and competitive overall execution times. By improving performance within the partition-based framework, these advances strengthen the algorithm's competitiveness in state-of-the-art black-box optimization.

Wed 9 SeptMachine Learning
The gist
Finding the best solution when you can’t see inside the system can be slow, especially when the problem involves many factors. The authors designed a method that smartly breaks down the search space and combines it with focused local improvements. Their approach finds better answers faster than older methods on a variety of test problems. This makes it more practical for complex optimization tasks where guessing and checking take too long.
Open 2609.09796v1

Tensor method improves search for valid solutions in discrete optimization

Constraint-Aware Discrete Black-Box Optimization Using Tensor Decomposition

Abstract: Discrete black-box optimization is often addressed using approaches such as Sequential Model-Based Optimization (SMBO), which aims to improve sample efficiency by fitting surrogate models that approximate a costly objective function over a discrete search space. In many real-world problems, the set of feasible inputs is often given by logical constraints known in advance. However, existing surrogate modeling techniques generally fail to capture the symbolic rules governing feasibility in discrete input spaces. In this paper, we propose a surrogate modeling approach based on tensor decomposition that captures the structure of discrete search spaces while directly integrating feasibility information. To implement this approach, we formulate surrogate model training as a constrained polynomial optimization problem and solve a relaxed formulation using a differentiable penalty term derived from T-norms. Our experiments on both synthetic and real-world benchmarks, including a pressure vessel design task, demonstrate that the proposed method improves sample efficiency by effectively guiding the search away from infeasible regions.

Tue 8 SeptMachine Learning
The gist
Many problems require finding the best choice from a list of options, but not all options are allowed because of certain rules. Existing methods struggle to learn these rules and avoid impossible choices. The authors introduce a new mathematical model that better understands these rules while searching, making the search more efficient. They tested it on examples including designing a pressure vessel and showed it helps find good, allowed options faster.
Open 2609.09370v1

Physical law ecology finds multiple governing laws in complex systems

Physical Law Ecology: mapping multi-mechanism ecologies as the zeroth step of data-driven scientific discovery

Abstract: Every data-driven equation discovery method assumes (implicitly and without verification) that the target system obeys a single governing law ($K{=}1$). Here we show that this assumption is the primary bottleneck limiting scientific discovery in multi-mechanism systems, and introduce Physical Law Ecology, a framework that makes $K^*$ (the number of coexisting independent mechanisms) itself the first quantity to be determined from data. The framework automatically mines a pool of topologically distinct candidate equations, constructs a continuous dominance weight field across parameter space, and discovers analytic evolution laws governing mechanism succession---with optional monotonicity constraints encoding irreversible physics. Across four unrelated systems (elastomer mechanics, pool boiling, galactic dynamics, and droplet evaporation), BIC consistently identifies $K^*{=}3$ independent governing topologies. Applied to 163 SPARC galaxies (3,269 spatially resolved measurements), the framework autonomously recovers three gravitational laws whose coexistence provides evidence against the single-universal-acceleration hypothesis of MOND ($p<10^{-34}$). In engineering applications, multi-law weighted prediction reduces error by 67-72\% over single-equation baselines while retaining full interpretability. By establishing the determination of $K^*$ as the zeroth step of scientific discovery-prior to and independent of equation search---this work opens a direction orthogonal to existing symbolic regression: not finding better equations, but mapping the ecology of mechanisms that govern complex systems.

Tue 8 SeptSymbolic Computation
The gist
Many scientific methods assume complex systems follow just one main rule, but this paper shows that often several rules work together. The authors introduce Physical Law Ecology, a way to figure out how many different rules are at play before trying to find the rules themselves. They tested this on four very different systems and in all cases found three main rules working together. This approach also improved predictions in engineering tasks and challenged some existing theories about how gravity works in galaxies.
Open 2609.08536v1

Generative approach guides design toward optimal multi-goal tradeoffs

ParetoTransport: Generative Optimization by Mass Transport Toward The Pareto Front

Abstract: Offline multi-objective optimization requires not only moving the objective vectors of candidate designs toward the Pareto front, but also distributing them effectively along it. Generative methods have recently emerged as a natural approach because they learn a distribution over feasible designs while allowing generation to be steered toward promising designs. Existing methods, however, largely retain classical sample-wise guidance strategies, leaving the distribution-level modeling capability of generative methods underused. We propose ParetoTransport, a training-free guidance method for pre-trained flow-matching models that explicitly specifies and refines a population-level distribution in objective space. ParetoTransport guides a flow-matching sampler to iteratively transport the empirical offline distribution toward the Pareto front, with Wasserstein matching to intermediate proxy distributions. This directly controls distributional displacement and mass allocation along the front. We establish a convergence result and demonstrate state-of-the-art performance on standard offline MOO benchmarks, extending recent evaluations beyond hypervolume to generational distance, inverted generational distance, and Wasserstein distance.

Mon 7 SeptMachine Learning
The gist
When designing things that need to be good in many different ways at once, it’s hard to find choices that balance all goals well. The authors created a way for computer models to move groups of design options closer to the best set of tradeoffs, called the Pareto front, by shaping their overall distribution rather than working on each option separately. Their method, ParetoTransport, uses a mathematical approach to gently push design options closer to balance in a smooth and controlled way, improving how well designs meet multiple goals at once. Testing shows this method works better than previous ones on several common benchmarks.
Open 2609.07706v1