Blind Information System (BIS)

Authors: Zdenek Mikovec, Martin Klima, Dusan Pavlica


Contents

Home Page Zdenek Mikovec

General information

Motivation

Development of Information Technologies (IT) at the end of 20th century brought two main changes for blind people. The first, positive one, can be described as extensive electronic communication (mainly Internet - e-mail and WEB), which gave blind people the ability to work and communicate with other people at nearly the same level as non-blind people. The second, negative change (for blinds), can be found in more intensive use of graphical representation of information - graphical user interface (GUI) with pictures and visual effects. The problem of graphical information is based on its very difficult presentation for blinds caused by complicated structure of graphical information. The use of GUI is very complicated for blinds because the communication in standard computer environment is based on the use of pointing devices (e.g. mouse), which is totally unacceptable for blind.

The orientation in GUI without a visual feedback is absolutely confusing. The original motivation of our work was to enable to blind to use IT more extensively by suppressing negative aspects and supporting positive changes in IT development described above.

Back to Top

Goal of this project

At the beginning the main goal of our project was to help visually impaired people in perception of graphically represented information, but later we realize that the problem with perception of graphical information is based not only at the user side but can be found at the side of a system too (e.g. hand held computers with reduced screen, mobile telephones).

The goal of our project is to solve the problem of perception of graphical information without GUI.
In fact it meant that we had to develop

Our project goal was not to create a solution of a complex analysis of a picture structure and semantic or universal methodology for a complex picture description. Our goal was neither to create system for an automatic picture description nor to analyze how blind people understand pictures (human vision, memory trace, etc.).

Our approach

Our approach to picture perception process (see Fig. 1) is focused on following application areas:

These pictures can be characterized by structure, objects and relations among them.

Picture perception process

Fig. 1: Picture perception process

To handle these application areas the picture description method must keep complexity and specific structure of graphical information and might not loose any important information and must allow later efficient browsing in the description.

Description creation and later browsing in such a very complex information like a picture description could be complicated and time consuming. It is clear that only easy and quick solution can be widely used and this is why we decide to develop software tools for creation and browsing in the description. Next problem we had to solve was keeping consistency of documents with additional picture description (for unified user access - blind and non-blind; for administrators of these documents - e.g. Web masters). The suggested solution was to integrate the description directly into the picture file and to eliminate necessity of additional pages with description.

The conceptual model of such a system - BIS (see Fig. 2) consists of three modules:

Creating/browsing in description file & Grammar of description module

In this module we give a definition of the picture description creating/browsing methodology and the picture description grammar. The grammar as a formal definition of the picture description structure is used to automate creation of next two modules of the system (Description creator and browser) and to make the picture description understandable and usable for other systems that can operate with formal grammar definitions. This is implemented as a basic software module that consists of functions for manipulating with description file (loading, saving, searching, etc.), creation and browsing in the description. The next two modules of the system use this basic module.

This module of the system will be designed and implemented in this Master thesis.

Description creator module

Software tool for creating the picture description. This tool is not designed for automatic description creation - it will only help the human user to speed up the creation of picture description. The human user assistance during the creation process is necessary.

This tool uses the services of the basic module of the BIS system. Development of this tool is described in Bachelor thesis of Dusan Pavlica.

Description browser module

Software tool for browsing in the picture description in the form suitable for blinds. This tool must offer all the functionality needed for efficient browsing in the description and for obtaining required information.

This tool uses the services of the basic module of the BIS system. Development of this tool is described in Bachelor and Master thesis of Martin Klima.
Blind Information System (BIS) - Conceptual scheme

Fig. 2: Blind Information System (BIS) - Conceptual scheme
Back to Top

History and participants i this project

All of these activities were supervised by Prof. Ing. Pavel Slavik, CSc.

1997 Seminar: NUR (Design and Implementation of User Interface)
Topic: Specification of methodology of picture description for blind and browser implementation.
Team: Zdenek Mikovec
Result:
- grammar for object, behavior and relations description (pilot version, not in XML)
- pilot browser application for MS DOS (not suitable for blind users)
- summary of activities at SONS (Czech Blind United), CU Prague, Masaryk University Brno and CTU Prague
(Zdenek Mikovec has organized a meeting of these institution)
1997 Sep. Study Visit at HTW Dresden (one month)
Topic: New approach to picture description for blind
Team: Zdenek Mikovec
Result: Methodology of picture description for blind based on XML grammar (pilot version)
1997 Seminar: SI (Software Engineering)
Topic: Analysis and design of BIS (Blind Information System)
Team: Zdenek Mikovec (manager), Martin Klima, Dusan Pavlica, Petr Mikes
Result: Object relation diagram of BIS - the basic material for Bachelor theses
1997
Nov.
Student Workshop at HTW Dresden: User Interfaces, Germany
Topic of presentation: Picture interpretation for blind users - Methodology and XML approach
Team: Zdenek Mikovec (manager), Dusan Pavlica
1998 Seminar: Bachelor theses
Topic: Picture description for blind - Implementation of BIS (Blind Information System)
Team: Zdenek Mikovec, Martin Klima, Dusan Pavlica
Result: Pilot implementation of BIS creator and BIS browser based on XML description (implementation in Java, Browser not sufficiently tailored to blind users)
1998 Student Workshop at HTW Dresden: User Interfaces, Germany
Topic of presentation: Results of Bachelor works
Team: Zdenek Mikovec
1999 Seminar: SI 2 (Software Engineering 2)
Topic: DBS and WEB interface of BIS (Blind Information System)
Team: Martin Klima (manager), Zdenek Mikovec, Dusan Pavlica, Michal Jun, Tomas Podzimek, Pavel Stengl, David Vilimek
Result: Implementation specification of DBS and WEB interface to BIS
1999 Seminar: RPS (Implementation of programming systems)
Topic: WEB interface of BIS (Blind Information System), unification of BIS Browser and BIS Creator
Team: Zdenek Mikovec (manager), Jiri Mzourek, Dusan Pavlica, Josef Trcka, Petr Kacalek
Result: Implementation of WEB interface to BIS and new UI and control of BIS Creator (unified with BIS Browser)
1999
Sep.
Presentation at 2nd International Workshop Text, Speech and Dialog, Czech republic
Topic of presentation: Structural and semantic dialogue filters.
Team: Zdenek Mikovec, Martin Klima, Pavel Slavik
1999
Nov.
Presentation at 5th ERCIM Workshop on "User Interfaces for All", Germany
Topic of presentation: Perception of pictures without graphical interface.
Team: Zdenek Mikovec, Pavel Slavik
1999
Dec.
Student Workshop at HTW Dresden, Germany
Topic of presentation: Picture interpretation for blind users - Filtering information and navigation, demonstration of Browser application
Team: Zdenek Mikovec (manager), Martin Klima
Back to Top

Pictures

Ruby laser - picture

Fig. 4-1: Ruby laser

Flat scheme - picture

Fig.5-1: Flat scheme