Text entry interface

Last updated

A text entry interface or text entry device is an interface that is used to enter text information in an electronic device. A commonly used device is a mechanical computer keyboard. Most laptop computers have an integrated mechanical keyboard, and desktop computers are usually operated primarily using a keyboard and mouse. Devices such as smartphones and tablets mean that interfaces such as virtual keyboards and voice recognition are becoming more popular as text entry systems.

Contents

Background

With the increasing popularity of mobile electronic information management, the variety in text entry interfaces has developed considerably. Such interfaces are primarily used to communicate and record information and data.

Computer keyboard text entry

A computer keyboard is a typewriter-style device which uses an arrangement of buttons or keys to act as mechanical levers or electronic switches. Each button typically represents one character, but some symbols may only be accessible via a combination of buttons. The layout of the keyboard is like that of a traditional typewriter, although there are some additional keys provided for performing further functions. There are a number of different keyboard layouts available: QWERTY is the standard English-language keyboard layout, as the first six keys on the row of letters are Q, W, E, R, T and Y. Other keyboards layouts include AZERTY and Dvorak. The AZERTY keyboard is a variation of the standard QWERTY keyboard adapted for French-language input. The AZERTY layout is optimised for French language use. Some QWERTY and AZERTY keyboards have explicitly labelled keycaps for diacritics (accents) but, given the appropriate keyboard mapping, any keyboard may be used where these letters are needed. The Dvorak keyboard is designed so that the middle row of keys includes the most common letters, with the goal of allowing greater efficiency and comfort while typing.

These keyboards usually contains letters, numbers, currency sign(s), punctuation, function and control keys, arrow keys, a keypad, and may include a wristpad.

ITU-T text entry (phone keyboard)

With the popularity of text messaging , text entry with mobile phones has gained use. [lower-alpha 1] Each key contains multiple characters, and these are reached through multiple key presses. This is frequently used in conjunction with predictive text (also known as T9) entry. Although once popular, this system has been mostly displaced with the widespread use of touchscreens on smartphones and is now mostly found on budget feature phones.

Virtual keyboards

Ubuntu's Onboard on-screen keyboard Onboard OSK.png
Ubuntu's Onboard on-screen keyboard

Virtual keyboards are similar to mechanical keyboards, but do not make use of physical keys. These may be implemented on systems using a screen or projected onto a surface. The individual letters may be selected by touching them as on a touch screen or surface, or by clicking on them with a classical pointing device (a mouse or touchpad), like in the case of virtual computer keyboards. Multi-touch screens even support virtual chorded keyboards.

On-screen keyboards can be used to type and enter data without using the physical keyboard. An on-screen keyboard may contain all the standard keys including all letters, numbers, symbols, and system keys like Home, End, Insert, Page Up and Page Down, Ctrl, Alt, Caps, and Shift, and can even extend the set of characters available by simulating alternative layouts. These keys can be selected using the mouse or another pointing device, or a single key or small group of keys can be used to cycle through the keys on the screen. The on-screen keyboard is the most common type of virtual keyboard. The accuracy of this keyboard depends only on hitting the right key. The main purpose of an on-screen keyboard is to provide an alternative mechanism for disabled users who cannot use a physical keyboard, or to provide text input on devices lacking a physical keyboard, such as smartphones and tablets.

Virtual keyboards also allow users to enter characters not available on their physical keyboard, enabling support for a number of languages with only one hardware keyboard.

Devices such as smartphones and tablets come with touchscreens and make use of virtual keyboards. Keyboards vary between operating systems but many third-party applications are available to replace the system keyboard. Mobile virtual keyboards are often used alongside predictive text.

Voice recognition

Voice recognition is a system that allows using one's voice in order to send messages, make phone calls and more. The most powerful voice entry systems can recognize thousands of words. It usually requires the speaker to speak slowly, distinctly and to separate each word with a short pause. This system can replace or supplement other input devices such as keyboards and different pointing devices. The software has been developed to provide a fast method of writing without using a keyboard and can help people with various disabilities. The system works by analysing sounds and converting them to text. It knows how the language is usually spoken and decides what the speaker is most probably saying. The most powerful systems should recognise around 95% of clear speech correctly. Several voice recognition applications are available. Some of the most well-known systems are Apple Inc.'s Siri and Cortana which is developed by Microsoft. Many voice-recognition programs offer the ability to start and control programs through spoken commands.

Individual letter selection

This is commonly used on electronic systems where text entry is not important. Examples include television channel naming and text entry in video game systems such as the Sony PSP. Usually directional input devices (arrow keys, joysticks) are used to highlight a letter or number, then an enter key used to select the letter.

Handwriting recognition

Handwriting recognition (or HWR) is the ability of a computer to receive and interpret intelligible handwritten input from sources such as paper documents, photographs, touch-screens and other devices. It allows users to use a touch screen device much like a notepad on which they can write without the need for a keyboard, and the software finds the closest match in its symbol database to replace the handwritten letters with. Handwriting recognition primarily uses either optical character recognition which uses an optical scanner to scan the words written by the user to determine the best suitable match, or by using a pen-based computer interface to track the movements of the tip of the pen as the user is writing.

Light pen

Photo of the Hypertext Editing System (HES) console in use at Brown University, circa October 1969. The photo shows HES on an IBM 2250 Mod 4 display station, including lightpen and programmed function keyboard, channel coupled to Brown's IBM 360 mainframe. HypertextEditingSystemConsoleBrownUniv1969.jpg
Photo of the Hypertext Editing System (HES) console in use at Brown University, circa October 1969. The photo shows HES on an IBM 2250 Mod 4 display station, including lightpen and programmed function keyboard, channel coupled to Brown's IBM 360 mainframe.

A light pen is a computer input device used in conjunction with a computer's CRT display. It is used to select a displayed menu item. A light pen can also allow users draw on the screen with great positional accuracy. It consists of a photocell and an optical system placed in a small tube. When the tip of a light pen is moved over the monitor screen and pen button is pressed, its photocell sensing element detects the screen location and sends the corresponding signal to the CPU. The first light pen was created around 1952 as part of the Whirlwind project at MIT. Because the user was required to hold his/her arm in front of the screen for long periods of time, the light pen fell out of use as a general purpose input device. Nevertheless, modern touch screens on desktop computers require similar ergonomic behaviour from users.

Touch screen

A touchscreen (or touch screen) is a both input and output device and normally layered on an electronic visual display of an information processing system. A user can give input or control the information processing system through simple or multi-touch gestures by touching the screen with a special stylus or one or more fingers. [1]

Digital pen

A digital pen is an input device which captures the handwriting or brush strokes of a user, converts handwritten analog information created using "pen and paper" into digital data, enabling the data to be utilized in various applications. For example, the writing data can be digitized and uploaded to a computer and displayed on its monitor. The data can then be interpreted by handwriting software (OCR) to allow the digital pen to act as a text entry interface and be used in different applications or just as graphics.

A digital pen is generally larger and has more features than a stylus. Digital pens typically contain internal electronics and have features such as touch sensitivity, input buttons, memory, writing data transmission capabilities, and electronic erasers

Graphics tablet

A graphics tablet or digitizer is a computer input device that enables a user to hand-draw images, animations and graphics, similar to the way a person draws images with a pencil and paper, typically using a stylus. These tablets may also be used to capture data or handwritten signatures. It can also be used to trace an image from a piece of paper which is taped or otherwise secured to the surface. Capturing data in this way, by tracing or entering the corners of linear poly-lines or shapes, is called digitizing. The image is displayed on the computer monitor, although some graphics tablets also have a screen.

Some tablets are intended as a replacement for the mouse as the primary pointing and navigation device.

Graphics tablets can be use with handwriting recognition software to input text, using the graphics tablet to write on the handwriting recognition detects the letters and converts it to digital information.

Punched card input

One of the earliest text entry interfaces was the punched card reader. Text (which could be data or source code) was punched off-line using a keypunch machine. Most early computers used punched cards as their main input medium and usually also had an online card puncher for output.

Notes

  1. ITU-T refers to the particular keypad and letter layout specified in ITU-T E.161
  1. Walker, Geoff (August 2012). "A review of technologies for sensing contact location on the surface of a display". Journal of the Society for Information Display. 20 (8): 413–440. doi:10.1002/jsid.100. S2CID   40545665.

Related Research Articles

<span class="mw-page-title-main">Graphical user interface</span> User interface allowing interaction through graphical icons and visual indicators

A graphical user interface, or GUI, is a form of user interface that allows users to interact with electronic devices through graphical icons and visual indicators such as secondary notation. In many applications, GUIs are used instead of text-based UIs, which are based on typed command labels or text navigation. GUIs were introduced in reaction to the perceived steep learning curve of command-line interfaces (CLIs), which require commands to be typed on a computer keyboard.

<span class="mw-page-title-main">Personal digital assistant</span> Multi-purpose mobile device

A personal digital assistant (PDA), also known as a handheld PC, is a multi-purpose mobile device which functions as a personal information manager. PDAs have been mostly displaced by the widespread adoption of highly capable smartphones, in particular those based on iOS and Android, and thus saw a rapid decline in use after 2007.

<span class="mw-page-title-main">Pointing device</span> Human interface device for computers

A pointing device is a human interface device that allows a user to input spatial data to a computer. CAD systems and graphical user interfaces (GUI) allow the user to control and provide data to the computer using physical gestures by moving a hand-held mouse or similar device across the surface of the physical desktop and activating switches on the mouse. Movements of the pointing device are echoed on the screen by movements of the pointer and other visual changes. Common gestures are point and click and drag and drop.

<span class="mw-page-title-main">Graphics tablet</span> Computer input device

A graphics tablet is a computer input device that enables a user to hand-draw images, animations and graphics, with a special pen-like stylus, similar to the way a person draws images with a pencil and paper. These tablets may also be used to capture data or handwritten signatures. It can also be used to trace an image from a piece of paper that is taped or otherwise secured to the tablet surface. Capturing data in this way, by tracing or entering the corners of linear polylines or shapes, is called digitizing.

<span class="mw-page-title-main">Handwriting recognition</span> Ability of a computer to receive and interpret intelligible handwritten input

Handwriting recognition (HWR), also known as handwritten text recognition (HTR), is the ability of a computer to receive and interpret intelligible handwritten input from sources such as paper documents, photographs, touch-screens and other devices. The image of the written text may be sensed "off line" from a piece of paper by optical scanning or intelligent word recognition. Alternatively, the movements of the pen tip may be sensed "on line", for example by a pen-based computer screen surface, a generally easier task as there are more clues available. A handwriting recognition system handles formatting, performs correct segmentation into characters, and finds the most possible words.

<span class="mw-page-title-main">Touchpad</span> Type of pointing device

A touchpad or trackpad is a type of pointing device. Its largest component is a tactile sensor: an electronic device with a flat surface, that detects the motion and position of a user's fingers, and translates them to a position on a screen, to control a pointer in a graphical user interface. Touchpads are common on laptop computers, contrasted with desktop computers, where mice are more prevalent. Trackpads are sometimes used on desktops, where desk space is scarce. Because trackpads can be made small, they can be found on personal digital assistants (PDAs) and some portable media players. Wireless touchpads are also available, as detached accessories.

<span class="mw-page-title-main">Gesture recognition</span> Topic in computer science and language technology

Gesture recognition is an area of research and development in computer science and language technology concerned with the recognition and interpretation of human gestures. A subdiscipline of computer vision, it employs mathematical algorithms to interpret gestures.

ShapeWriter was a keyboard text input method for tablet, handheld PCs, and mobile phones invented by Shumin Zhai and Per Ola Kristensson at IBM Almaden Research Center and the Department of Computer and Information Science at Linköping University.

<span class="mw-page-title-main">Virtual keyboard</span> Software component

A virtual keyboard is a software component that allows the input of characters without the need for physical keys. The interaction with a virtual keyboard happens mostly via a touchscreen interface, but can also take place in a different form when in virtual or augmented reality.

<span class="mw-page-title-main">Tablet computer</span> Mobile computer with integrated display, circuitry and battery

A tablet computer, commonly shortened to tablet or pad, is a mobile device, typically with a mobile operating system and touchscreen display processing circuitry, and a rechargeable battery in a single, thin and flat package. Tablets, being computers, have similar capabilities, but lack some input/output (I/O) abilities that others have. Modern tablets largely resemble modern smartphones, the only differences being that tablets are relatively larger than smartphones, with screens 7 inches (18 cm) or larger, measured diagonally, and may not support access to a cellular network. Unlike laptops, tablets usually run mobile operating systems, alongside smartphones.

<span class="mw-page-title-main">Projection keyboard</span> Virtual device projected onto a surface

A projection keyboard is a form of computer input device whereby the image of a virtual keyboard is projected onto a surface: when a user touches the surface covered by an image of a key, the device records the corresponding keystroke. Some connect to Bluetooth devices, including many of the latest smartphone, tablet, and mini-PC devices with Android, iOS or Windows operating system.

<span class="mw-page-title-main">Multi-touch</span> Technology

In computing, multi-touch is technology that enables a surface to recognize the presence of more than one point of contact with the surface at the same time. The origins of multitouch began at CERN, MIT, University of Toronto, Carnegie Mellon University and Bell Labs in the 1970s. CERN started using multi-touch screens as early as 1976 for the controls of the Super Proton Synchrotron. Capacitive multi-touch displays were popularized by Apple's iPhone in 2007. Multi-touch may be used to implement additional functionality, such as pinch to zoom or to activate certain subroutines attached to predefined gestures using gesture recognition.

<span class="mw-page-title-main">Pen computing</span> Uses a stylus and tablet/touchscreen

Pen computing refers to any computer user-interface using a pen or stylus and tablet, over input devices such as a keyboard or a mouse.

TouchPal is an alternative input method for mobile devices, designed and developed by Shanghai-based CooTek. It is a software application running on multiple platforms, including Android, iOS, Windows Mobile, and Windows 8. It simulates a keyboard on the screen of the device, which is used to enter text by tapping on the screen or sliding a finger between letters constructing the word. It is an optional text input method to the traditional physical keyboards and default keyboards provided by the device manufacturer.

<span class="mw-page-title-main">Computer keyboard</span> Data input device

A computer keyboard is a peripheral input device modeled after the typewriter keyboard which uses an arrangement of buttons or keys to act as mechanical levers or electronic switches. Replacing early punched cards and paper tape technology, interaction via teleprinter-style keyboards have been the main input method for computers since the 1970s, supplemented by the computer mouse since the 1980s.

<span class="mw-page-title-main">Input device</span> Device that provides data and signals to a computer

In computing, an input device is a piece of equipment used to provide data and control signals to an information processing system, such as a computer or information appliance. Examples of input devices include keyboards, computer mice, scanners, cameras, joysticks, and microphones.

<span class="mw-page-title-main">Stylus (computing)</span> Pen-shaped instrument used as a human-computer interface

In computing, a stylus is a small pen-shaped instrument whose tip position on a computer monitor can be detected. It is used to draw, or make selections by tapping. While devices with touchscreens such as newer computers, mobile devices, game consoles, and graphics tablets can usually be operated with a fingertip, a stylus provides more accurate and controllable input. The stylus has the same function as a mouse or touchpad as a pointing device; its use is commonly called pen computing.

The history of tablet computers and the associated special operating software is an example of pen computing technology, and thus the development of tablets has deep historical roots. The first patent for a system that recognized handwritten characters by analyzing the handwriting motion was granted in 1914. The first publicly demonstrated system using a tablet and handwriting recognition instead of a keyboard for working with a modern digital computer dates to 1956.

<span class="mw-page-title-main">Microsoft Tablet PC</span> Microsofts former line of tablets

Microsoft Tablet PC is a term coined by Microsoft for tablet computers conforming to a set of specifications announced in 2001 by Microsoft, for a pen-enabled personal computer, conforming to hardware specifications devised by Microsoft and running a licensed copy of Windows XP Tablet PC Edition operating system or a derivative thereof.

<span class="mw-page-title-main">Active pen</span> Type of input device

An active pen is an input device that includes electronic components and allows users to write directly onto the display of a computing device such as a smartphone, tablet computer or ultrabook. The active pen marketplace has long been dominated by N-trig and Wacom, but newer firms Atmel and Synaptics also offer active pen designs.

References

  1. Ahmed Sabbir Arif and Ali Mazalek. 2016. WebTEM: A Web application to record text entry metrics. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS '16). ACM, New York, NY, USA.