Pen computing
Encyclopedia
Pen computing refers to a computer user-interface using a pen (or stylus
Stylus (computing)
In computing, a stylus is a small pen-shaped instrument that is used to input commands to a computer screen, mobile device or graphics tablet...

) and tablet, rather than devices such as a keyboard, joysticks or a mouse.

Pen computing is also used to refer to the usage of mobile devices such as wireless
Wireless
Wireless telecommunications is the transfer of information between two or more points that are not physically connected. Distances can be short, such as a few meters for television remote control, or as far as thousands or even millions of kilometers for deep-space radio communications...

 tablet personal computer
Tablet computer
A tablet computer, or simply tablet, is a complete mobile computer, larger than a mobile phone or personal digital assistant, integrated into a flat touch screen and primarily operated by touching the screen...

s, PDA
Personal digital assistant
A personal digital assistant , also known as a palmtop computer, or personal data assistant, is a mobile device that functions as a personal information manager. Current PDAs often have the ability to connect to the Internet...

s and GPS receivers. The term has been used to refer to the usage of any product allowing for mobile communication. An indication of such a device is a stylus
Stylus (computing)
In computing, a stylus is a small pen-shaped instrument that is used to input commands to a computer screen, mobile device or graphics tablet...

, generally used to press upon a graphics tablet
Graphics tablet
A graphics tablet is a computer input device that enables a user to hand-draw images and graphics, similar to the way a person draws images with a pencil and paper. These tablets may also be used to capture data or handwritten signatures...

 or touchscreen
Touchscreen
A touchscreen is an electronic visual display that can detect the presence and location of a touch within the display area. The term generally refers to touching the display of the device with a finger or hand. Touchscreens can also sense other passive objects, such as a stylus...

, as opposed to using a more traditional interface such as a keyboard
Computer keyboard
In computing, a keyboard is a typewriter-style keyboard, which uses an arrangement of buttons or keys, to act as mechanical levers or electronic switches...

, keypad
Keypad
A keypad is a set of buttons arranged in a block or "pad" which usually bear digits, symbols and usually a complete set of alphabetical letters. If it mostly contains numbers then it can also be called a numeric keypad...

, mouse
Mouse (computing)
In computing, a mouse is a pointing device that functions by detecting two-dimensional motion relative to its supporting surface. Physically, a mouse consists of an object held under one of the user's hands, with one or more buttons...

 or touchpad
Touchpad
A touchpad is a pointing device featuring a tactile sensor, a specialized surface that can translate the motion and position of a user's fingers to a relative position on screen. Touch pads are a common feature of laptop computers, and they are also used as a substitute for a mouse where desk...

.

Historically, pen computing (defined as a computer system employing a user-interface using a pointing device plus handwriting recognition as the primary means for interactive user input) predates the use of a mouse and graphical display by at least two decades, starting with the
Stylator and RAND tablet systems of the 1950s and early 1960s.

General techniques of pen computing

User interfaces for pen computing can be implemented in several ways. Actual systems generally employ a combination of these techniques.

Pointing/Locator input

The tablet and stylus
Stylus (computing)
In computing, a stylus is a small pen-shaped instrument that is used to input commands to a computer screen, mobile device or graphics tablet...

 are used as pointing devices, such as to replace a mouse. Note that a mouse is a relative pointing device—one uses the mouse to "push the cursor around" on a screen. However, a tablet is an absolute pointing device—one must put the stylus is exactly where the cursor goes.

There are a number of human factors considerations when actually substituting a stylus and tablet for a mouse. For example, it is much harder to target or tap the same exact position twice with a stylus, so "double-tap" operations with a stylus are harder to perform if the system is expecting "double-click" input from a mouse.

Note that a finger can be used as the stylus on a touch-sensitive tablet surface, such as with a touchscreen
Touchscreen
A touchscreen is an electronic visual display that can detect the presence and location of a touch within the display area. The term generally refers to touching the display of the device with a finger or hand. Touchscreens can also sense other passive objects, such as a stylus...

.

Handwriting recognition

The tablet and stylus
Stylus (computing)
In computing, a stylus is a small pen-shaped instrument that is used to input commands to a computer screen, mobile device or graphics tablet...

 can be used to replace a keyboard, or both a mouse and a keyboard, by using the tablet and stylus in two modes:
  • Pointing mode: The stylus is used as a pointing device as above.
  • On-line Handwriting recognition mode: The strokes made with the stylus are analyzed as a "electronic ink", by software which recognizes the shapes of the strokes or marks as handwritten characters. The characters are then input as text, as if from a keyboard.


Different systems switch between the modes (pointing vs. handwriting recognition) by different means, e.g.
  • by writing in separate areas of the tablet for pointing mode and for handwriting-recognition mode.
  • by pressing a special button on the side of the stylus to change modes.
  • by context, such as treating any marks not recognized as text as pointing input.
  • by recognizing a special gesture mark.


The term "on-line handwriting recognition" is used to distinguish recognition of handwriting using a real-time digitizing tablet for input, as contrasted to "off-line handwriting recognition", which is optical character recognition
Optical character recognition
Optical character recognition, usually abbreviated to OCR, is the mechanical or electronic translation of scanned images of handwritten, typewritten or printed text into machine-encoded text. It is widely used to convert books and documents into electronic files, to computerize a record-keeping...

 of static handwritten symbols from paper.

Direct manipulation

The stylus
Stylus (computing)
In computing, a stylus is a small pen-shaped instrument that is used to input commands to a computer screen, mobile device or graphics tablet...

 is used to touch, press, and drag on simulated objects directly. The Wang Freestyle system is one example. Freestyle worked entirely by direct manipulation, with the addition of electronic "ink" for adding handwritten notes.

Gesture recognition

This is the technique of recognizing certain special shapes not as handwriting input, but as an indicator of a special command.

For example, a "pig-tail" shape (used often as a proofreader's mark) would indicate a "delete" operation. Depending on the implementation, what is deleted might be the object or text where the mark was made, or the stylus can be used as a pointing device to select what it is that should be deleted. With Apple's Newton OS
Newton OS
Newton OS was the operating system for the Apple Newton PDAs produced by Apple from 1993-1997. Newton OS was written entirely in C++ and trimmed to be low power consuming and use the available memory efficiently...

, text could be deleted by scratching in a vertical zig-zag pattern over the text which the user desired to remove.

Recent systems have used digitizers which can recognize more than one "stylus" (usually a finger) at a time, and make use of Multi-touch
Multi-touch
In computing, multi-touch refers to a touch sensing surface's ability to recognize the presence of two or more points of contact with the surface...

 gestures.

The PenPoint OS
PenPoint OS
The PenPoint OS was a product of GO Corporation and was one of the earliest operating systems written specifically for graphical tablets and personal digital assistants...

 was a special operating system which incorporated gesture recognition and handwriting input at all levels of the operating system. Prior systems which employed gesture recognition only did so within special applications, such as CAD/CAM applications or text processing.

History

Pen computing has very deep historical roots.
The depth of these roots can be quite surprising to people who are only familiar with current commercial products. For example, the first patent for an electronic tablet used for handwriting was granted in 1888.
What is probably the first patent for a system that recognized handwritten characters by analyzing the handwriting motion was granted in 1915.
The first publicly-demonstrated system using a tablet and handwriting text recognition instead of a keyboard for working with a modern digital computer dates to 1956.

In addition to many academic and research systems, there were several companies with commercial products in the 1980s: Pencept
Pencept
Pencept, Inc. was one of a small number of pioneering companies in the 1980s developing and marketing technology known as Pen computing, prior to the entry of larger companies such as Microsoft and GO Corporation....

, Communications Intelligence Corporation, and Linus
were among the best known of a crowded field. Later, GO Corp.
GO Corp.
GO Corporation was founded in 1987 to create portable computers, an operating system, and software with a pen-based user interface. It was famous not only for its pioneering work in Pen-based computing but as well as being one of the most well-funded start-up companies of its time.Though the...

 brought out the PenPoint OS
PenPoint OS
The PenPoint OS was a product of GO Corporation and was one of the earliest operating systems written specifically for graphical tablets and personal digital assistants...

 operating system for a tablet PC product: one of the patents from GO corporation was the subject of recent infringement lawsuit concerning the Tablet PC operating system.

The following timeline list gives some of the highlights of this history:
  • Before 1950
    • 1888: U.S. Patent granted to Elisha Gray
      Elisha Gray
      Elisha Gray was an American electrical engineer who co-founded the Western Electric Manufacturing Company...

       on electrical stylus device for capturing handwriting.
    • 1915: U.S. Patent on handwriting recognition user interface with a stylus.
    • 1942: U.S. Patent on touchscreen for handwriting input.
    • 1945: Vannevar Bush
      Vannevar Bush
      Vannevar Bush was an American engineer and science administrator known for his work on analog computing, his political role in the development of the atomic bomb as a primary organizer of the Manhattan Project, the founding of Raytheon, and the idea of the memex, an adjustable microfilm viewer...

       proposes the Memex
      Memex
      The memex is the name given by Vannevar Bush to the hypothetical proto-hypertext system he described in his 1945 The Atlantic Monthly article As We May Think...

      , a data archiving device including handwriting input, in an essay As We May Think
      As We May Think
      As We May Think is an essay by Vannevar Bush, first published in The Atlantic Monthly in July 1945, and republished again as an abridged version in September 1945 — before and after the U.S. nuclear attacks on Japan...

      .
  • 1950s
    • Tom Dimond demonstrates the Styalator electronic tablet with pen for computer input and handwriting recognition.
  • Early 1960s
    • RAND Tablet invented.

  • Late 1960s
    • Alan Kay
      Alan Kay
      Alan Curtis Kay is an American computer scientist, known for his early pioneering work on object-oriented programming and windowing graphical user interface design, and for coining the phrase, "The best way to predict the future is to invent it."He is the president of the Viewpoints Research...

       of Xerox PARC proposed a notebook using pen input called Dynabook
      Dynabook
      The Dynabook concept, created by Alan Kay in 1968, described what is now known as a laptop computer or a tablet or slate computer with nearly eternal battery life and software aimed at giving children access to digital media...

      : however device is never constructed.
  • 1982
    • Pencept
      Pencept
      Pencept, Inc. was one of a small number of pioneering companies in the 1980s developing and marketing technology known as Pen computing, prior to the entry of larger companies such as Microsoft and GO Corporation....

       of Waltham, Massachusetts markets a general-purpose computer terminal using a tablet and handwriting recognition instead of a keyboard and mouse.
    • Cadre System markets the Inforite point-of-sale terminal using handwriting recognition and a small electronic tablet and pen.
  • 1985:
    • Pencept
      Pencept
      Pencept, Inc. was one of a small number of pioneering companies in the 1980s developing and marketing technology known as Pen computing, prior to the entry of larger companies such as Microsoft and GO Corporation....

        and CIC both offer PC computers for the consumer market using a tablet and handwriting recognition instead of a keyboard and mouse. Operating system is MS-DOS
      MS-DOS
      MS-DOS is an operating system for x86-based personal computers. It was the most commonly used member of the DOS family of operating systems, and was the main operating system for IBM PC compatible personal computers during the 1980s to the mid 1990s, until it was gradually superseded by operating...

      .

  • 1989
    • The first commercially available tablet-type portable computer was the GRiDPad from GRiD Systems, released in September. Its operating system was based on MS-DOS
      MS-DOS
      MS-DOS is an operating system for x86-based personal computers. It was the most commonly used member of the DOS family of operating systems, and was the main operating system for IBM PC compatible personal computers during the 1980s to the mid 1990s, until it was gradually superseded by operating...

      .
    • Wang Laboratories introduces Freestyle. Freestyle was an application that would do a screen capture from an MS-DOS application, and let the user add voice and handwriting annotations. It was a sophisticated predecessor to later note-taking applications for systems like the Tablet PC. The operating system was MS-DOS
      MS-DOS
      MS-DOS is an operating system for x86-based personal computers. It was the most commonly used member of the DOS family of operating systems, and was the main operating system for IBM PC compatible personal computers during the 1980s to the mid 1990s, until it was gradually superseded by operating...

  • 1991
    • The Momenta Pentop was released.
    • GO Corp
      GO Corp.
      GO Corporation was founded in 1987 to create portable computers, an operating system, and software with a pen-based user interface. It was famous not only for its pioneering work in Pen-based computing but as well as being one of the most well-funded start-up companies of its time.Though the...

       announced a dedicated operating system, called PenPoint OS
      PenPoint OS
      The PenPoint OS was a product of GO Corporation and was one of the earliest operating systems written specifically for graphical tablets and personal digital assistants...

      , featuring control of the operating system desktop via handwritten gesture shapes. Gestures included "flick" gestures in different directions, check-marks, cross-outs, pig-tails, and circular shapes, among others.
    • Portia Isaacsen of Future Computing estimates the total annual market for pen computers such as those running the PenPoint OS to be on the order of $500 Million.
    • NCR released model 3125 pen computer running MS-DOS, Penpoint or Pen Windows.
    • The Apple Newton
      Apple Newton
      The MessagePad was the first series of personal digital assistant devices developed by Apple for the Newton platform in 1993. Some electronic engineering and the manufacture of Apple's MessagePad devices was done in Japan by the Sharp Corporation...

       entered development; although it ultimately became a PDA
      Personal digital assistant
      A personal digital assistant , also known as a palmtop computer, or personal data assistant, is a mobile device that functions as a personal information manager. Current PDAs often have the ability to connect to the Internet...

      , its original concept (which called for a larger screen and greater sketching capabilities) resembled that of a tablet PC.
    • Sam Tramiel of Atari Corp.
      Atari
      Atari is a corporate and brand name owned by several entities since its inception in 1972. It is currently owned by Atari Interactive, a wholly owned subsidiary of the French publisher Atari, SA . The original Atari, Inc. was founded in 1972 by Nolan Bushnell and Ted Dabney. It was a pioneer in...

       presented the "ST-Pad
      Atari ST
      The Atari ST is a home/personal computer that was released by Atari Corporation in 1985 and commercially available from that summer into the early 1990s. The "ST" officially stands for "Sixteen/Thirty-two", which referred to the Motorola 68000's 16-bit external bus and 32-bit internals...

      " (codenamed "STylus") at the CeBIT
      CeBIT
      CeBIT is the world's largest and most international computer expo. CeBIT is held each year on the world's largest fairground in Hanover, Germany, and is a barometer of the state of the art in information technology...

       '91 in Hanover
      Hanover
      Hanover or Hannover, on the river Leine, is the capital of the federal state of Lower Saxony , Germany and was once by personal union the family seat of the Hanoverian Kings of Great Britain, under their title as the dukes of Brunswick-Lüneburg...

      , Germany
      Germany
      Germany , officially the Federal Republic of Germany , is a federal parliamentary republic in Europe. The country consists of 16 states while the capital and largest city is Berlin. Germany covers an area of 357,021 km2 and has a largely temperate seasonal climate...

      . The computer never went into production.
  • 1992
    • GO Corp shipped PenPoint and IBM announced IBM 2125 pen computer (the first IBM model named "ThinkPad") in April.
    • Microsoft
      Microsoft
      Microsoft Corporation is an American public multinational corporation headquartered in Redmond, Washington, USA that develops, manufactures, licenses, and supports a wide range of products and services predominantly related to computing through its various product divisions...

       releases Windows for Pen Computing
      Windows for Pen Computing
      Windows for Pen Computing was a software suite for Windows 3.1x, that Microsoft designed to incorporate pen computing capabilities into the Windows operating environment...

       as a response to the PenPoint OS.
  • 1993
    • The IBM releases the ThinkPad
      ThinkPad
      ThinkPad is line of laptop computers originally sold by IBM but now produced by Lenovo. They are known for their boxy black design, which was modeled after a traditional Japanese lunchbox...

      , IBM's first commercialized portable tablet computer product available to the consumer market, as the IBM
      IBM
      International Business Machines Corporation or IBM is an American multinational technology and consulting corporation headquartered in Armonk, New York, United States. IBM manufactures and sells computer hardware and software, and it offers infrastructure, hosting and consulting services in areas...

       ThinkPad
      ThinkPad
      ThinkPad is line of laptop computers originally sold by IBM but now produced by Lenovo. They are known for their boxy black design, which was modeled after a traditional Japanese lunchbox...

       750P and 360P
    • Apple Computer announces the Newton PDA, also known as the Apple MessagePad, which includes handwriting recognition with a stylus.
    • Amstrad
      Amstrad
      Amstrad is a British electronics company, now wholly owned by BSkyB. As of 2006, Amstrad's main business is manufacturing Sky Digital interactive boxes....

       release the "Pen Pad" or PDA6000, a similar pen-based device. It did not achieve commercial success.
    • AT&T
      AT&T
      AT&T Inc. is an American multinational telecommunications corporation headquartered in Whitacre Tower, Dallas, Texas, United States. It is the largest provider of mobile telephony and fixed telephony in the United States, and is also a provider of broadband and subscription television services...

       introduced the EO Personal Communicator
      EO Personal Communicator
      The EO was an early commercial tablet computer created by GO/Eo and released in April 1993. Eo was the hardware spin-out of GO. Officially named the AT&T EO Personal Communicator, it was similar to a large personal digital assistant with wireless communications, and competed against the Apple...

       combining PenPoint with wireless communications.
    • BellSouth released the IBM Simon
      IBM Simon
      The IBM Simon Personal Communicator was an advanced cellular telephone, created by a joint venture between IBM and BellSouth. Simon was first shown as a product concept in 1992 at COMDEX, the computer and technology trade show held in Las Vegas, Nevada. Launched in 1993 it combined the features of...

       Personal Communicator, an analog cellphone using a touch-screen and display. It did not include handwriting recognition, but did permit users to write messages and send them as faxes on the analog cellphone network, and included PDA and Email features.
  • 1999
    • The "QBE" pen computer created by Aqcess Technologies wins Comdex
      COMDEX
      COMDEX was a computer expo held in Las Vegas, Nevada, each November from 1979 to 2003. It was one of the largest computer trade shows in the world, usually second only to the German CeBIT, and by many accounts one of the largest trade shows in any industry sector...

       Best of Show.
  • 2000
    • The "QBE Vivo" pen computer created by Aqcess Technologies ties for Comdex
      COMDEX
      COMDEX was a computer expo held in Las Vegas, Nevada, each November from 1979 to 2003. It was one of the largest computer trade shows in the world, usually second only to the German CeBIT, and by many accounts one of the largest trade shows in any industry sector...

       Best of Show.
  • 2001
    • Bill Gates of Microsoft demonstrates first public prototype of a Tablet PC (defined by Microsoft as a pen-enabled computer conforming to hardware specifications devised by Microsoft and running a licensed copy of the "Windows XP Tablet PC Edition" operating system) at Comdex
      COMDEX
      COMDEX was a computer expo held in Las Vegas, Nevada, each November from 1979 to 2003. It was one of the largest computer trade shows in the world, usually second only to the German CeBIT, and by many accounts one of the largest trade shows in any industry sector...

      .
  • 2003
    • Fingerworks develops the touch technology and touch gestures later used in the Apple iPhone
      IPhone
      The iPhone is a line of Internet and multimedia-enabled smartphones marketed by Apple Inc. The first iPhone was unveiled by Steve Jobs, then CEO of Apple, on January 9, 2007, and released on June 29, 2007...

      .

  • 2006
    • Windows Vista released for general availability. Vista included the functionality of the special Tablet PC edition of Windows XP.

  • 2008
    • In April 2008, as part of a larger federal court case, the gesture features of the Windows/Tablet PC operating system and hardware were found to infringe on a patent by GO Corp.
      GO Corp.
      GO Corporation was founded in 1987 to create portable computers, an operating system, and software with a pen-based user interface. It was famous not only for its pioneering work in Pen-based computing but as well as being one of the most well-funded start-up companies of its time.Though the...

       concerning user interfaces for pen computer operating systems. Microsoft's acquisition of the technology is the subject of a separate lawsuit.
    • HP releases the second MultiTouch capable tablet: the HP TouchSmart
      HP TouchSmart
      HP TouchSmart is a series of tablet PC laptops and touchscreen all-in-one desktop computers designed by HP. It features various Intel or AMD processors and runs Windows Vista or Windows 7 as standard.-HP TouchSmart Crossfire:...

       tx2z.

See also

  • Gesture recognition
    Gesture recognition
    Gesture recognition is a topic in computer science and language technology with the goal of interpreting human gestures via mathematical algorithms. Gestures can originate from any bodily motion or state but commonly originate from the face or hand. Current focuses in the field include emotion...

  • Handwriting movement analysis
    Handwriting movement analysis
    Handwriting movement analysis is the study and analysis of the movements involved in handwriting and drawing. It forms an important part of graphonomics, which became established after the "International Workshop on Handwriting Movement Analysis" in 1982 in Nijmegen, The Netherlands. It would...

  • Handwriting recognition
    Handwriting recognition
    Handwriting recognition is the ability of a computer to receive and interpret intelligible handwritten input from sources such as paper documents, photographs, touch-screens and other devices. The image of the written text may be sensed "off line" from a piece of paper by optical scanning or...

  • Interactive whiteboard
    Interactive whiteboard
    An interactive whiteboard , is a large interactive display that connects to a computer and projector. A projector projects the computer's desktop onto the board's surface where users control the computer using a pen, finger, stylus, or other device...

  • Laser pointer
    Laser pointer
    A laser pointer or laser pen is a small portable device with a power source and a laser emitting a very narrow coherent low-powered beam of visible light, intended to be used to highlight something of interest by illuminating it with a small bright spot of colored light...

     (e.g. highlighting)
    • Graffiti Lighting
      Light Painting
      Light painting, also known as light drawing or light graffiti is a photographic technique in which exposures are made usually at night or in a darkened room by moving a hand-held light source or by moving the camera. In many cases the light source itself does not have to appear in the image...

  • Light Pen
    Light pen
    A light pen is a computer input device in the form of a light-sensitive wand used in conjunction with a computer's CRT TV set or monitor. It allows the user to point to displayed objects, or draw on the screen, in a similar way to a touch screen but with greater positional accuracy...

  • Sketch recognition
    Sketch recognition
    Sketch recognition is the automated recognition of hand-drawn diagrams by a computer. Research in sketch recognition lies at the crossroads of Artificial Intelligence and Human Computer Interaction...


External links

The source of this article is wikipedia, the free encyclopedia.  The text of this article is licensed under the GFDL.
 
x
OK