PsyArXiv Preprints | What is "where": Physical reasoning informs object location

A central puzzle the visual system tries to solve is: “what is where?” While a great deal of research attempts to model object recognition (“what”), a comparatively smaller body of work seeks to model object location (“where”), especially in perceiving everyday objects. How do people locate an object, right now, in front of them? In three experiments collecting over 35,000 judgements on stimuli spanning different levels of realism (line drawings, real images, and crude forms), participants clicked “where” an object is, as if pointing to it. We modeled their responses with eight different methods, including both human response-based models (judgements of physical reasoning, spatial memory, free-response “click anywhere” judgements, and judgements of where people would grab the object), and image-based models (uniform distributions over the image, convex hull, saliency map, and medial axis). Physical reasoning was the best predictor of “where,” performing significantly better than even s

OSF

related reading

• Homeperceptron.inc
• When Models Manipulate Manifolds: The Geometry of a Counting Tasktransformer-circuits.pub
• Cartoon Epistemology by Steven Lehar (2003) | Qualia Computingqualiacomputing.com
• Generalizing From One Example — LessWronglesswrong.com
• Book Review: Surfing Uncertaintyslatestarcodex.com
• Invariant representations of mass in the human brain | eLifeelifesciences.org
• Intuitive experimentation in the physical worldcicl.stanford.edu
• Learning 3D object-centric representation through predictionarxiv.org
• Evidence that recurrent circuits are critical to the ventral stream’s execution of core object recognition behaviornature.com
• A Model of Biological Motion Perception from Configural Form Cuespmc.ncbi.nlm.nih.gov
• Target Confusability Competition Modelbradylab.ucsd.edu
• How to reason from first principles – Casey Handmer's blogcaseyhandmer.wordpress.com