Martin Frank - lecture notes, CS588 interaction styles ---------------------------------------- Note: these notes are made available to you for use in this class only ; please do not re-distribute them without my permission. ---------------------------------------- Also, obviously, these notes are written to help me stay organized during the lecture, not as stand-alone reading. They may not make any sense to you if you didn't attend the class. ---------------------------------------- "What's wrong with this interface" CHI'95, page 587 Cluttered Color Scheme Hard-to-read fonts Can't tell buttons from labels ... Input Keyboards Piano Layout QWERTY Layout (1874) reduces incidence of levered hammers jamming 's' and 't' are far apart Dvorak Layout use Preece page 215 'home row' concept Chord Keyboard (1932) use Preece page 216 can't hunt and peck! Engelbart 1968: chord keyboard and mouse use Steve Roberts picture, Preece page 254 (also has a "private eye") Half-QWERTY use CHI'93, page 89 Flat-Membrane Keyboards A word about modifier keys: "Usability in inversely proportional to the number of modifier keys." (Martin's Hypothesis) Pointing Devices Joystick use Preece page 217 left talk about digital vs analog ones Trackball (older Apple PowerBooks, Arcade Games ("Missile Command")) use Preece page 217 right TouchPad (newer Apple PowerBooks) IBM "Eraser Pen Head" (IBM ThinkPad Notebooks) Potentiometer & Button (e.g PONG Video Game) LightPen Mouse Touch Screen (Project: simulate realistically!) use CHI'92 page 667 Pen-Based Systems use Doonesbury cartoon, page 233 talk about direction sensitivity, pressure sensitivity, angle sensitivity talk about Apple Newton Gestures in the penpoint OS: Preece page 229 Gestures in a queuing analyzer: Foley page 371 Pie Menus, CHI'94 page 258 Pen-Based Alphabet, CHI'94 pages 265-... Unistrokes, CHI'93, pages 80-... Video: CHI'93, number 6, Xerox PARC Graspable Bricks, CHI'95, pages 442-... Voice Input Speaker-dependent vs. Speaker-independent isolated-word vs. continuous some voice mail systems: "press or say three", etc.. talk about danger of high expectations Video: CHI'93, number 10, MIT [Hyperspeech] Eye and Head Movement Input Head tracking: humor, CHI'93, page 37 Better ways: radio signals in virtual reality applications Tracking eye movement Fighter Pilots - use Preece page 225 Disabled: The eye-typer: input by focusing on the key for a short time. 3-D Input & Virtual Reality use Preece page 219 Shape Deformation Widget, CHI'94, page 465 Brainwave Detection Detecting brain activity and moving a cursor based on the user's thoughts. A word about user interfaces for disabled users. The device where it lights up the keys in order. Canned Interaction, CHI'93 page 238 tell story about pressing mouse button by exhaling -> often produce good interfaces for non-disabled users -> "sticky keys" extension on the Macintosh Footmouse: "Mole" use Preece page 234 talk about repetitive strain injuries briefly mention non-interactive input devices: scanners, digital cameras, etc Output Devices and Techniques Cathode-Ray Tubes Matrix Displays Augmented Reality Overhead Displays Sound Output: Key-Clicking, Sonic Finder use Preece page 250 - picture of sonic finder Speech Output NeXT Conputers: "Your printer is out of paper." Talking Cars, Elevators, Coke Machines Voice Mail Systems Attracting Attention: Synthesized Speech Output Atlanta Airport "Stop! Do not enter!" disabled-users: tactile feedback: braille pads force feedback e.g. used in aircraft briefly mention non-interactive output devices: printers, etc Interaction Tasks & Techniques [mostly based on Foley Chapter 8, pages 347-] Talk about rise of human-computer interaction: reason: relative costs os a computer-hour vs. a man-hour Basic Interaction Tasks Specify-Position typically type-in & return or point & click resolution: unlimited with type-in mouse can be augmented by cursor keys touch screen techniques gridding semantic snapping gravity constraint modifiers Select (Variable, Large Set of Choices) choices are: commands, attribute values, object instances selection by naming: talk about automatic completion talk about close-ness checking talk about wildcards selection by pointing: talk about problems with hierachical objects -> solution in CAD systems: hierarchy up-down keys click vs double-click: double click to select word, etc... selection by Alpha-Slider: CHI'94 page 365 Select (Relatively Fixed Set of Choices) selection by menu selection menu order frequent-first alphabetical functional grouping use Foley page 364 flat vs scrolling vs cascading: use Foley 365 - scrolling use Foley 366 - cascading seven +/- two rule too small - too may levels too large exceptions: e.g. twelve months menu placement: menubar on top (Mac) on bottom (Windows'95) top of application window (Motif) menu buttons popup menus e.g. Netscape - click'n'hold save screen space, trade-off visibility nice: can put recent-choice under mouse object-specific menus tear-down menus menu accelerator keys mac-style framemaker-style selection through palettes mention floating palettes selection through function keys mention visiblity problem selection by single or multiple choice widgets Input-Text Interaction Task Keyboard Character Recognition Simulated Keyboard (Touchscreens) Voice Input Quantify show Foley page 375 show Foley page 376 upper also used in Macintosh to set time and date Composite Interaction Tasks Dialog Boxes use Foley page 382 mention TAB and RETURN keys File Selection use Foley 366 lower - NeXT style use Foley ~200 Plate I-22 Object Creation rubber-banding in line creation polyline cration Object Manipulation selection-handles: use Foley page 387 lower use page 388 Copy-and-Paste Browsing Dynamic Queries: CHI'92 pages 619 Starfield Displays: CHI'94 page 479-480 Dynamic HomeFinder: CHI'94 page 314 Table Lens: CHI'94 page 481-482 Fisheye View: CHI'92 page 84-... TreeMaps: CHI'92 Spiral Calendar: CHI'94 page 239 Movable Filter: CHI'94 page 306 Butterfly Visualizer: CHI'95, page 70 Perspective Wall: CHI'95 page 336 Spheric Fish-Eye: CHI'95 page 401-... Fish-Eye, Multiple Foci: UIST'95 page 224 Camtree, Preece page 247 Video: CHI'93, number 2, from DEC Organizing Information Piles: CHI'92 pages 627- 3D-Interaction Specify-Position in 3D use Foley page 376 and page 377 use Foley page ~200 plate I.14 use Foley page ~200 plate I.15 use Foley page ~200 plate I.16 mention Van Dam's airplane shadows 3-D Manipulation: CHI'92 "Direct Manipulation" Interfaces Seminal paper: Shneiderman 1983 Definition: 1. visibility of the objects of interest 2. rapid, reversible, incremental actions 3. replaces complex command language syntax by direct manipulation of the objects of interest use MacPaint snapshot, Preece page 271 Collaborative Environments Synchronous vs asynchronous CSCW use CHI'93 page 541 - multi-user text editor use CHI'92 page 525-, pages 705/706 - ClearBoard: see-through whiteboard use CHI'92 page 50 - video-conferencing use CHI'92 page 542 - distributed group awareness use CHI'92 pages 599 - Xerox Lifeboard Show IBM Kiosk Design Video if there is time left