Graffiti (Palm OS)

Last updated
Gestures used by original Palm OS handheld computers Palm Graffiti gestures.png
Gestures used by original Palm OS handheld computers

Graffiti is an essentially single-stroke shorthand handwriting recognition system used in PDAs based on the Palm OS. Graffiti was originally written by Palm, Inc. as the recognition system for GEOS-based devices such as HP's OmniGo 100 and 120 or the Magic Cap-line and was available as an alternate recognition system for the Apple Newton MessagePad, when NewtonOS 1.0 could not recognize handwriting very well. Graffiti also runs on the Windows Mobile platform, where it is called "Block Recognizer", and on the Symbian UIQ platform as the default recognizer and was available for Casio's Zoomer PDA.

Contents

The software is based primarily on a neography of upper-case characters that can be drawn blindly with a stylus on a touch-sensitive panel. Since the user typically cannot see the character as it is being drawn, complexities have been removed from four of the most difficult letters. "A" "F", "K" and "T" all are drawn without any need to match up a cross-stroke.

Some letters can be drawn with strokes other than the "official" ones. Two examples of these alternative strokes are the letters "V" (drawn the same only from right to left) and "X" (drawn the same as the letter "K" except reversed from right to left). These alternative strokes are frequently recognized with greater reliability.

History

Graffiti was developed by Jeff Hawkins, who had previously created "PalmPrint" (the character recognition system used by the Casio Zoomer [1] ) to recognize natural handwriting. [2] By using a simpler alphabet, computers could easily recognize handwriting. Hawkins believed that people would take the time to learn Graffiti just as people learn to touch-type. Hawkins recalled his insight: "And then it came to me in a flash. Touch-typing is a skill you learn." [2]

Hawkins also envisioned a single area for writing letters on top of each other. [2]

Hawkins called this system "PowerPalmPrint" or P3. Other engineers at Palm revised and expanded the alphabet that Hawkins had created. Joe Sipher and Ron Marianetti created more characters and punctuation and also designed a prototype of Graffiti that ran on a PC with a tablet peripheral. [2]

Non-Palm OS versions

Graffiti was also implemented on the Apple Newton. In 2008, an unauthorized version of Graffiti was introduced for iOS (iPhone and iPad) devices. An Android version was released in 2010 by ACCESS Co., Ltd. of Japan, which acquired the rights to Graffiti when it acquired PalmSource, Inc. in 2005. [3] The original patent expired at the end of 2016. [4]

StrokeInput, [5] is an Apple App for an additional keyboard that enables - when activated - Graffiti input for every text on iPhone or iPad.

Lawsuit

The original Graffiti system was the subject of a lawsuit from Xerox, claiming it violated Xerox's patent relating to its Unistrokes technology ( U.S. patent 5,596,656 , granted in 1997). The Unistrokes technology was invented at the Palo Alto Research Center (PARC) by David Goldberg in 1993. [6]

Palm later appealed the original court ruling both on the claim it violated Xerox's patent and as to the validity of the patent in the first place. An appeals court ruled in favor of Xerox with regard to the original ruling, that Palm had violated Xerox's patent, but sent the case back down to the lower court to decide whether the patent was valid to begin with. In 2004, a judge ruled in favor of Palm on the patent review, saying Xerox's patent was not valid on the basis that "prior art references anticipate and render obvious the claim." [7] [8] [9] Xerox appealed the ruling. [10] Xerox also obtained a US$22.5 million payment from Palm for retrospective licensing fees. Palm and Xerox agreed to not sue each other for seven years over certain patents, without publicly specifying which patents. [11]

See also

Related Research Articles

<span class="mw-page-title-main">MessagePad</span> Personal digital assistant made by Apple in 1993

The MessagePad is a discontinued series of personal digital assistant devices developed by Apple Computer for the Newton platform in 1993. Some electronic engineering and the manufacture of Apple's MessagePad devices was undertaken in Japan by Sharp. The devices are based on the ARM 610 RISC processor and all featured handwriting recognition software and were developed and marketed by Apple. The devices run Newton OS.

<span class="mw-page-title-main">Personal digital assistant</span> Multi-purpose mobile device

A personal digital assistant (PDA), also known as a handheld PC, is a multi-purpose mobile device which functions as a personal information manager. PDAs have been mostly displaced by the widespread adoption of highly capable smartphones, in particular those based on iOS and Android, and thus saw a rapid decline in use after 2007.

<span class="mw-page-title-main">Palm OS</span> Mobile operating system

Palm OS was a mobile operating system initially developed by Palm, Inc., for personal digital assistants (PDAs) in 1996. Palm OS was designed for ease of use with a touchscreen-based graphical user interface. It was provided with a suite of basic applications for personal information management. Later versions of the OS were extended to support smartphones. The software appeared on the company's line of Palm devices while several other licensees have manufactured devices powered by Palm OS.

<span class="mw-page-title-main">Palm, Inc.</span> 1992–2010 American electronics company

Palm, Inc., was an American company that specialized in manufacturing personal digital assistants (PDAs) and developing software. Palm designed the PalmPilot, the first PDA successfully marketed worldwide, and was known for the Treo 600, one of the earlier successful smartphones. Palm developed the Palm OS software for PDAs and smartphones released under its line of Palm-branded devices and also licensed to other PDA manufacturers.

<span class="mw-page-title-main">Palm (PDA)</span> Line of personal digital assistants and mobile phones

Palm is a line of personal digital assistants (PDAs) and mobile phones developed by California-based Palm, Inc., originally called Palm Computing, Inc. Palm devices are often remembered as "the first wildly popular handheld computers," responsible for ushering in the smartphone era.

<span class="mw-page-title-main">Handwriting recognition</span> Ability of a computer to receive and interpret intelligible handwritten input

Handwriting recognition (HWR), also known as handwritten text recognition (HTR), is the ability of a computer to receive and interpret intelligible handwritten input from sources such as paper documents, photographs, touch-screens and other devices. The image of the written text may be sensed "off line" from a piece of paper by optical scanning or intelligent word recognition. Alternatively, the movements of the pen tip may be sensed "on line", for example by a pen-based computer screen surface, a generally easier task as there are more clues available. A handwriting recognition system handles formatting, performs correct segmentation into characters, and finds the most possible words.

<span class="mw-page-title-main">Palm Tungsten</span>

The Tungsten series was Palm, Inc.'s line of business-class Palm OS-based PDAs.

<span class="mw-page-title-main">Newton OS</span> Discontinued operating system by Apple Inc.

Newton OS is a discontinued operating system for the Apple Newton PDAs produced by Apple Computer, Inc. between 1993 and 1997. It was written entirely in C++ and trimmed to be low power consuming and use the available memory efficiently. Many applications were pre-installed in the ROM of the Newton to save on RAM and flash memory storage for user applications.

<span class="mw-page-title-main">GEOS (16-bit operating system)</span> Graphical operating system (16-bit)

GEOS is a computer operating environment, graphical user interface (GUI), and suite of application software. Originally released as PC/GEOS, it runs on DOS-based, IBM PC compatible computers. Versions for some handheld platforms were also released and licensed to some companies.

<span class="mw-page-title-main">Graffiti 2</span> Revised version of the original Palm OS handwriting system Graffiti

"Graffiti 2 Powered by Jot" was introduced in 2003 as a revised version of the original Palm OS handwriting system Graffiti. In January 2003, PalmSource announced the change explaining that Graffiti 2 was based on Jot by Communication Intelligence Corporation (CIC) and would replace the original version of Graffiti. Graffiti 2 made its debut in Palm OS 4.1.2 for Motorola DragonBall-based handhelds and in Palm OS Garnet 5.2 for ARM-based ones.

In graphonomics, sloppiness space is a term introduced by David Goldberg and Cate Richardson of Xerox to describe the shape space of all graph (handwriting) around an idealized allograph. Sloppiness space can be so large that optical character recognition becomes difficult due to overlap with shapes for non-intended characters.

Inkwell, or simply Ink, is the name of the handwriting recognition technology developed by Apple Inc. and built into the Mac OS X operating system. Introduced in an update to Mac OS X v10.2 "Jaguar", Inkwell can translate English, French, and German writing. The technology made its debut as "Rosetta", an integral feature of Apple Newton OS, the operating system of the short-lived Apple Newton personal digital assistant. Inkwell's inclusion in Mac OS X led many to believe Apple would be using this technology in a new PDA or other portable tablet computer. None of the touchscreen iOS devices – iPhone/iPod/iPad – has offered Inkwell handwriting recognition. However in iPadOS 14 handwriting recognition has been introduced, as a feature called Scribble.

<span class="mw-page-title-main">Pilot 1000</span> Personal digital assistant by Palm

The Pilot 1000 and Pilot 5000 are the first generations of PDAs produced by Palm Computing. It was introduced in March 1996.

ShapeWriter was a keyboard text input method for tablet, handheld PCs, and mobile phones invented by Shumin Zhai and Per Ola Kristensson at IBM Almaden Research Center and the Department of Computer and Information Science at Linköping University.

<span class="mw-page-title-main">Virtual keyboard</span> Software component

A virtual keyboard is a software component that allows the input of characters without the need for physical keys. The interaction with a virtual keyboard happens mostly via a touchscreen interface, but can also take place in a different form when in virtual or augmented reality.

<span class="mw-page-title-main">Tablet computer</span> Mobile computer with integrated display, circuitry and battery

A tablet computer, commonly shortened to tablet or pad, is a mobile device, typically with a mobile operating system and touchscreen display processing circuitry, and a rechargeable battery in a single, thin and flat package. Tablets, being computers, have similar capabilities, but lack some input/output (I/O) abilities that others have. Modern tablets largely resemble modern smartphones, the only differences being that tablets are relatively larger than smartphones, with screens 7 inches (18 cm) or larger, measured diagonally, and may not support access to a cellular network. Unlike laptops, tablets usually run mobile operating systems, alongside smartphones.

<span class="mw-page-title-main">Pen computing</span> Uses a stylus and tablet/touchscreen

Pen computing refers to any computer user-interface using a pen or stylus and tablet, over input devices such as a keyboard or a mouse.

<span class="mw-page-title-main">Apple Newton</span> PDA platform by Apple Inc.

The Newton is a series of personal digital assistants (PDAs) developed and marketed by Apple Computer, Inc. An early device in the PDA category, it was the first to feature handwriting recognition. Apple started developing the platform in 1987 and shipped the first devices in August 1993. Production officially ended on February 27, 1998. Newton devices ran on a proprietary operating system, Newton OS; examples include Apple's MessagePad series and the eMate 300, and other companies also released devices running on Newton OS. Most Newton devices were based on the ARM 610 RISC processor and all featured handwriting-based input.

<span class="mw-page-title-main">Grid Systems</span> Early portable computer manufacturer

Grid Systems Corporation was an early portable computer manufacturer, based in United States and oriented for producing of rugged and semi-rugged machines; currently the Grid computer brand still exist as Grid Defence Systems Ltd. in United Kingdom.

The history of tablet computers and the associated special operating software is an example of pen computing technology, and thus the development of tablets has deep historical roots. The first patent for a system that recognized handwritten characters by analyzing the handwriting motion was granted in 1914. The first publicly demonstrated system using a tablet and handwriting recognition instead of a keyboard for working with a modern digital computer dates to 1956.

References

  1. ↑ Tebbutt, David (October 1993). "Zoomer XL-7000". Personal Computer World.
  2. 1 2 3 4 Butter, Andrea; Pogue, David (2002). Piloting Palm . New York: John Wiley & Sons. pp.  62–66. ISBN   0-471-08965-6.
  3. ↑ "ACCESS Completes Acquisition of PalmSource". access-company.com (Press release). ACCESS Co. Ltd. November 14, 2005. Archived from the original on 2012-06-20. Retrieved August 14, 2020.
  4. ↑ https://patents.google.com/patent/US6567549B1/en
  5. ↑ Website StrokeInput
  6. ↑ Goldberg, David; Richardson, Cate (May 1993). "Touch-typing with a stylus". Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93. Association for Computing Machinery. pp. 80–87. doi:10.1145/169059.169093. ISBN   0897915755. S2CID   17507192 . Retrieved 18 April 2014.
  7. ↑ "PalmOne overturns Xerox Graffiti patent". The Register . Bloomberg. May 24, 2004. Retrieved August 14, 2020.
  8. ↑ Rohde, Laura (May 26, 2004). "Xerox loses patent claim against PalmOne". ComputerWeekly.com. IDG News Service. Retrieved August 14, 2020.
  9. ↑ Burr, D. J. (September 1983). "Designing a Handwriting Reader". IEEE Transactions on Pattern Analysis and Machine Intelligence. IEEE Computer Society. PAMI-5 (5): 554–559. doi:10.1109/TPAMI.1983.4767435. ISSN   0162-8828. PMID   21869141. S2CID   16042308. The curves resemble lowercase cursive script, but the user may change them to suit his own writing style. The only restriction is that each symbol consist of a single curve (no pen lifts).
  10. ↑ Mello, John P. Jr. (May 25, 2004). "Xerox To Appeal PalmOne Ruling". TechNewsWorld.com. ECT News Network. Retrieved August 14, 2020.
  11. ↑ "Xerox collects from PalmOS". The Australian . July 4, 2006. Archived from the original on February 13, 2009.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.