QJFQJF StructureQJF KioskQJF BulletinQJF A&S GalleryQJRIUMembership

The Queen Jadwiga Research Institute 
of Understanding

Next

 

Shape Understanding System – visual thinking capabilities of the machine

ZBIGNIEW LES and MAGDALENA LES

The Queen Jadwiga Foundation

This project does not have any financial support from any Australian Institution. Authors of this project do not receive any payment for work that is connected with this project.

We are forced to participate in the ARC Grant “competition” in category a “Private Researcher”. Until now we have not obtained any clear explanation from ARC Grant Committee and any other Australian Institution, what does it mean to be a “private researcher” in Australia.

All applications for ARC Grant connected with this project were unsuccessful. It is our filing that the evaluation of our application was not based on the contents of the proposal. We do not agree with all the procedure in which applications were processed and evaluated.

 

ARC Applications:

2000 Z. Les. ‘The Method of Shape Understanding– The Study of The Visual Thinking Possibilities’

2001 L. Sterling, Z.Les, R. Tadeusiewicz, L. Latecki, S. Raudys, B. Falcidieno, M. Pawlak: ‘The Method of Shape Understanding– The Study of The Visual Thinking Possibilities’

2002 Z. Les, L. Zadeh, R. Tadeusiewicz, J. Bezdek: ‘The Method of Shape Understanding– The Study of The Visual Thinking Possibilities’

 

This project is carried out based on the own resources of the authors of the project; it includes computer equipment, software and all spending connected with presenting papers at conferences. Outcomes of the research of this project are donation to The Queen Jadwiga Foundation by authors of this project.

 

 

 

1. Shape and shape understanding method

The main novelty of the presented method is that the process of understanding is related to the visual concept represented as a symbolic name of the possible classes of shapes. The possible classes of shapes, viewed as hierarchical structures, are incorporated into the shape model. At each stage of the reasoning process that led to assigning an examined object to one of the possible classes, novel processing methods are used. An understanding is based on interpretation of the visual object as a meaningful unit. A big advantage of the proposed method of understanding of the visual objects is that it can explain many problems connected with understanding visual forms.

The focus of this research is on shapes that are characteristic of visual objects perceived as two-dimensional patterns. The shape is considered as a meaningful unit called a phantom and is related to a meaningful object that in semiotics is called a sign. The visual objects that are designed to convey meaning and are used in the computer industry are called icons. All written languages evolved from pictographic images. Examples of these pictographic images are hieroglyphs of the ancient Egyptian language. Modern iconic languages e.g. semantography or ISOTYPE use visual forms to be able to communicate their meaning.

In shape understanding, shape is the main ‘ingredient’ of the visual thinking process. However, shape information is complex and its various components are thoroughly interdependent, and there is no definition of shape that could include all aspects of shape information. Geometry and topology, the components of shape information, have been the subject of study by such mathematicians as Euclid, Pythagoras, Archimedes, Euler, Mobus, Polya and Lacatos. The shape not only determines how an object looks, but also forms the basis for many of its other properties. Webster defines shape as ‘that quality of an object which depends on the relative position of all points composing its outline or external surface.’ The shape is also described as a silhouette of the object (e.g. obtained by illuminating the object by an infinitely distant light source). Marr treats shape as one of the forms of an object representation or a ‘special visual’ feature of an object. Perception research lays emphasis on the use of boundaries in decomposing objects into their parts, especially on describing rules for detection of part boundaries, e.g. based on notions as ‘concavities’ of concave regions or the ‘minimal rule’. Based on the geometrical permissions Leyton developed a theory that claims that all shapes are basically circles, which changed form as a result of various deformations caused by external forces like pushing.

In this research the shape is considered as a meaningful unit called a phantom and is related to a meaningful object that in semiotics is called a sign. A shape understanding system is designed to become an independent module that performs a shape understanding task. Understanding involves a transformation of the data given in the form of critical points into a set of descriptors and next into the sub-symbolic and symbolic representations. The shape understanding system (SUS) consists of two main modules: the central module (the master expert and the reasoning expert) and the peripheral module (the generating expert, the query expert, the self-correcting expert, the learning expert and the spatial-logic expert).

2. Visual perception

Shape understanding is an activity that makes available a number of different visual, semantics and verbal descriptions. Normally, when we recognize a particular instance of a shape category, we are able to describe how the object would look if seen from a different viewpoint. Shape understanding method is a multidisciplinary research area that is focused on the understanding of the visual objects. Understanding of the visual object is related to research in the area of human visual perception

3. Understanding the task

Understanding is power that enables objects to be thought. Understanding and thought were topics of philosophical thinkers (e.g. Locke, Hume, Berkeley, Leibnitz, Kant, Popper). The classical preoccupation with forms and universals was concerned with generality of thought. This spawned a whole class of general or potentially general entities such as forms, universals, essences and sensible species. Thoughts and their contents possess two strictly distinct but closely connected properties: intentionality - they are about things other than themselves and generality - nearly all our concepts express features which an indefinite number of things might posses.

According to Aquinas, the direct object of human intellectual knowledge is the form abstracted from matter, which is the principle of individuation, and known through the universal concept. Scotus discarded the traditional Augustinian-Franciscan theory of a special divine illumination and held, with Aquinas, that Aristotelian doctrine of the abstraction of the universal can explain the genesis of human knowledge without it being necessary to invoke either innate ideas or a special divine illumination. According to Kant understanding is one of the higher faculties of knowledge.

In hermeneutics understanding is the inversion of a speech act, during which the thought that was the basis of the speech must become conscious. More recently, Jean Piaget specified four stages through which he said individuals construct an understanding of reality by means of internalized, reversible mental operations that act on the world to produce a cognitive independence from physical appearance.

Visual Understanding involves:

1.     Knowing what is meant or intended by a visual object. In the case of a perception of the real world object, it can be an obstacle on the road or a block to be moved, whereas in the case of an icon it can be a description of the scene.

2.     Knowing how it works. It involves schematic drawing (engineering, anatomy).

3.     Transformation of the schematic representation in the visual problem solving process.

4. The shape understanding system

The proposed shape understanding system  operates on the knowledge of image processing, decision making and search strategies as well as the knowledge of shape description and representation distributed among the specialized experts. SUS consists of the two main modules: the central reasoning module and the peripheral module. The central reasoning module consists of the master expert, the reasoning expert, the manager expert, the processing expert and the end-the analysis expert. The peripheral module consists of the generating expert, the question expert, the self-correcting expert, the learning.

 

Next

Home

 

Copyright the Queen Jadwiga Foundation

Address:

The Queen Jadwiga Foundation

P.O. Box 654, Toorak, VIC 3142, Australia