Summary
Architectural plans use different types of repeated hatch patterns to show various materials, but recognizing these patterns can be tricky. The authors use a model based on a fly's visual system, originally trained to detect motion, and test if it can identify hatch patterns without extra training. They find that this fly-inspired model performs well compared to some traditional methods, but not as well as a task-specific neural network trained just for the job. This work shows that biology-inspired vision systems can be useful for texture recognition, though the specific advantages of using fly-like wiring remain uncertain.
What this means in practice
- •For architectural software developers: Improve materials recognition in architectural drawing software using biologically inspired visual descriptors trained for motion detection.
- •For computer vision engineers: Use pre-trained biological visual models for texture classification without retraining weights on new tasks involving repeated patterns.
Abstract
Architectural drawings encode material classes through repeated hatch patterns. We test whether a connectome-constrained fly visual network, pretrained for motion, can be repurposed without task-specific weight updates as a descriptor for one-shot hatch matching. Each 64 x 64 patch is translated over eight scan trajectories and summarized across 57 cell types; query descriptors are then matched to one legend strip per class. On 400 development sheets from a synthetic benchmark built on CubiCasa5K geometry, the frozen fly pipeline reaches 0.857 area-weighted accuracy and 0.910 with an extended legend. On an equal-brightness orientation condition it reaches 0.840 versus 0.299 for eleven pixel statistics, while a Gabor bank reaches 0.900. Replacing drift with a repeated still frame lowers the combined equal-condition score by 0.089 [0.066, 0.112]. However, a receptors-only descriptor reaches 0.891 and a task-trained 5,888-parameter CNN averages 0.959, so the current evidence supports transfer and the usefulness of active sampling, but not an advantage of the biological wiring. We separate project-recorded results from recomputed checks and report a small real-drawing audit. The supported claim is therefore narrow: motion-oriented biological vision can be repurposed as a useful texture representation for architectural hatch matching, while the topology contribution and end-to-end BIM utility remain open questions.