Catalogue Search | MBRL
Are you sure you want to remove the book from the shelf?
{{itemTitle}}
33
result(s) for
"Pizlo, Zygmunt"
Sort by:
Monocular reconstruction of shapes of natural objects from orthographic and perspective images
Human subjects were tested in perception of shapes of 3D objects. The subjects reconstructed 3D shapes by viewing orthographic and perspective images. Perception of natural shapes was very close to veridical and was clearly better than perception of random symmetrical polyhedra. Viewing perspective images led to only slightly better performance than viewing orthographic images. In order to account for subjects’ performance, we elaborated the previous computational models of 3D shape reconstruction. The previous models used as constraints mirror-symmetry and 3D compactness. The critical additional constraint was the use of a secondary mirror-symmetry that exists in most natural shapes. It is known that two planes of mirror symmetry are sufficient for a unique and veridical shape reconstruction. We also generalized the model so that it applies to both orthographic and perspective images. The results of our experiment suggest that the human visual system uses two planes of symmetry in addition to two forms of 3D compactness. Performance of the new model was highly correlated with subjects’ performance with both orthographic and perspective images, which supports the claim that the most important 3D shape constraints that are used by the human visual system have been identified.
Journal Article
The Concept of Symmetry and the Theory of Perception
Perceptual constancy refers to the fact that the perceived geometrical and physical characteristics of objects remain constant despite transformations of the objects such as rigid motion. Perceptual constancy is essential in everything we do, like recognition of familiar objects and scenes, planning and executing visual navigation, visuomotor coordination, and many more. Perceptual constancy would not exist without the geometrical and physical permanence of objects: their shape, size, and weight. Formally, perceptual constancy and permanence of objects are invariants, also known in mathematics and physics as symmetries. Symmetries of the Laws of Physics received a central status due to mathematical theorems of Emmy Noether formulated and proved over 100 years ago. These theorems connected symmetries of the physical laws to conservation laws through the least-action principle. We show how Noether's theorem is applied to mirror-symmetrical objects and establishes mental shape representation (perceptual conservation) through the application of a simplicity (least-action) principle. This way, the formalism of Noether's theorem provides a computational explanation of the relation between the physical world and its mental representation.
Journal Article
Camouflage and visual perception
How does an animal conceal itself from visual detection by other animals? This review paper seeks to identify general principles that may apply in this broad area. It considers mechanisms of visual encoding, of grouping and object encoding, and of search. In most cases, the evidence base comes from studies of humans or species whose vision approximates to that of humans. The effort is hampered by a relatively sparse literature on visual function in natural environments and with complex foraging tasks. However, some general constraints emerge as being potentially powerful principles in understanding concealment-a 'constraint' here means a set of simplifying assumptions. Strategies that disrupt the unambiguous encoding of discontinuities of intensity (edges), and of other key visual attributes, such as motion, are key here. Similar strategies may also defeat grouping and object-encoding mechanisms. Finally, the paper considers how we may understand the processes of search for complex targets in complex scenes. The aim is to provide a number of pointers towards issues, which may be of assistance in understanding camouflage and concealment, particularly with reference to how visual systems can detect the shape of complex, concealed objects.
Journal Article
Philosophizing cannot substitute for experimentation: comment on Hoffman, Singh & Prakash (2014)
The perception of a 3D shape must be excluded from Hoffman et al.’s “interface theory” primarily because shape is characterized by its symmetries. When these symmetries are used as a priori constraints, 3D shapes are always recovered from 2D retinal images veridically. These facts make it clear that 3D shape perception is completely different from, as well as more important than, all other perceptions because the veridicality of our perception of 3D shapes (and 3D scenes) accounts for our successful adaptation to the natural environment.
Journal Article
Unifying Physics and Psychophysics on the Basis of Symmetry, Least-Action ≈ Simplicity Principle, and Conservation Laws ≈ Veridicality
Psychophysics is the branch of experimental psychology that deals with the study of sensation and perception. A consensus has grown up among experts in psychophysics in the last hundred years that the human being’s percepts are inferences, which are based on a minimum, or simplicity, principle that is applied to the currently available sensory data. These educated guesses play the critical role in establishing veridical perceptual representations of the three-dimensional environment, where by “veridical” we mean that the percept agrees with what is “out there.” These veridical representations cannot be achieved without making use of symmetries, much like those known in physics, where they are essential for characterizing our physical world and deriving the conservation laws. But, unlike in physics, the important role that symmetry plays in psychophysics has been demonstrated and explained only within the last 10 years. Symmetries represent regularities in our physical world. These symmetries also serve as the source of the redundancies that are inherent in 3D objects and make vision possible. The main goal of this article is to show that the similarity between the mathematical formalisms used in physics and in psychophysics is not coincidental and that exploring this similarity can benefit the sciences of perception and cognition. This article includes a brief tutorial about symmetry groups and their relationship to transformation groups as well as to their invariants. It was included to make this material available to readers who are not familiar with these topics.
Journal Article
Automatic segmentation and implicit surface representation of dynamic cardiac data
Segmentation of anatomical structures on 2D images of cardiac exams is necessary for performing 3D volumetric analysis, enabling the computation of parameters for diagnosing cardiovascular disease. In this work, we present robust algorithms to automatically segment cardiac imaging data and generate a volumetric anatomical reconstruction of a patient-specific heart model by propagating active contour output within a patient stack through a self-supervised learning model. Contour initializations are automatically generated, then output segmentations on sparse image slices are transferred and merged across a stack of images within the same heart data set during the segmentation process. We demonstrate whole-heart segmentation and compare the results with ground truth manual annotations. Additionally, we provide a framework to represent segmented heart data in the form of implicit surfaces, allowing interpolation operations to generate intermediary models of heart sections and volumes throughout the cardiac cycle and to estimate ejection fraction.
Journal Article
3D shape : its unique place in visual perception
In this account of how we perceive the 3D shapes of objects and of how to design machines that can see shapes the way we do, Pizlo focuses on the main concepts, telling the story of shape without interuption. Appendices provide the basic mathematical and computational information necessary for a technical understanding of the argument.
eBook
Perception of 3D Symmetrical and Nearly Symmetrical Shapes
The human visual system uses priors to convert an ill-posed inverse problem of 3D shape recovery into a well-posed one. In previous studies, we have demonstrated the use of priors like symmetry, compactness and minimal surface in the perception of 3D symmetric shapes. We also showed that binocular perception of symmetric shapes can be well modeled by the above-mentioned priors and binocular depth order information. In this study, which used a shape-matching task, we show that these priors can also be used to model perception of near-symmetrical shapes. Our near-symmetrical shapes are asymmetrical shapes obtained from affine distortions of symmetrical shapes. We found that the perception of symmetrical shapes is closer to veridical than the perception of asymmetrical shapes. We introduce a metric to measure asymmetry of abstract polyhedral shapes, and a similar metric to measure shape dissimilarity between two polyhedral shapes. We report some key observations obtained by analyzing the data from the experiment. A website was developed with all the shapes used in the experiment, along with the shapes recovered by the subject and the shapes recovered by the model. This website provides a qualitative analysis of the effectiveness of the model and also helps demonstrate the goodness of the shape metric.
Journal Article
Binocular 3D Object Recovery Using a Symmetry Prior
We present a new algorithm for 3D shape reconstruction from stereo image pairs that uses mirror symmetry as a biologically inspired prior. 3D reconstruction requires some form of prior because it is an ill-posed inverse problem. Psychophysical research shows that mirror-symmetry is a key prior for 3D shape perception in humans, suggesting that a general purpose solution to this problem will have many applications. An approach is developed for finding objects that fit a given shape definition. The algorithm is developed for shapes with two orthogonal planes of symmetry, thus allowing for straightforward recovery of occluded portions of the objects. Two simulations were run to test: (1) the accuracy of 3D recovery, and (2) the ability of the algorithm to find the object in the presence of noise. We then tested the algorithm on the Children’s Furniture Corpus, a corpus of stereo image pairs of mirror symmetric furniture objects. Runtimes and 3D reconstruction errors are reported and failure modes described.
Journal Article