skip to main content
Electric field imaging
Publisher:
  • Massachusetts Institute of Technology
  • 201 Vassar Street, W59-200 Cambridge, MA
  • United States
Order Number:AAI0800637
Pages:
1
Bibliometrics
Skip Abstract Section
Abstract

The physical user interface is an increasingly significant factor limiting the effectiveness of our interactions with and through technology. This thesis introduces Electric Field Imaging, a new physical channel and inference framework for machine perception of human action. Though electric field sensing is an important sensory modality for several species of fish, it has not been seriously explored as a channel for machine perception. Technological applications of field sensing, from the Theremin to the capacitive elevator button, have been limited to simple proximity detection tasks. This thesis presents a solution to the inverse problem of inferring geometrical information about the configuration and motion of the human body from electric field measurements. It also presents simple, inexpensive hardware and signal processing techniques for makin the field measurements, and several new applications of electric field sensing.

The signal processing contribution includes synchronous undersampling, a narrowband, phase sensitive detection technique that is well matched to the capabilities of contemporary microcontrollers. In hardware, the primary contributions are the School of Fish, a scalable network of microcontroller-based transceive electrodes, and the LazyFish, a small footprint integrated sensing board. Connecting n School of Fish electrodes results in an array capable of making heterodyne measurements of any or all n ( n – 1) off-diagonal entries in the capacitance matrix. The LazyFish uses synchronous undersampling to provide up to 8 high signal-to-noise homodyne measurements in a very small package. The inverse electrostatics portion of the thesis presents a fast, general method for extracting geometrical information about the configuration and motion of the human body from field measurements. The method is based on the Sphere Expansion, a novel fast method for generating approximate solutions to the Laplace equation. Finally, the thesis describes a variety of applications of electric field sensing, many enabled by the small footprint of the LazyFish. To demonstrate the School of Fish hardware and the Sphere Expansion inversion method, the thesis presents 3 dimensional position and orientation tracking of two hands. 1 (Copies available exclusively from MIT Libraries, Rm. 14-0551, Cambridge, MA 02139-4307. Ph. 617-253-5668; Fax 617-253-1690.)

1 Please see the URL http://www.media.mit.edu/people/jrs/thesis.html for video clips, code, and other information related to this thesis.

Cited By

  1. ACM
    Rus S, Nottebaum M and Kuijper A Person Re-Identification in a Car Seat: Comparison of Cosine Similarity and Triplet Loss based approaches on Capacitive Proximity Sensing data Proceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference, (97-104)
  2. ACM
    Nguyen V, Rupavatharam S, Liu L, Howard R and Gruteser M HandSense Proceedings of the 17th Conference on Embedded Networked Sensor Systems, (285-297)
  3. ACM
    Schmitz M, Stitz M, Müller F, Funk M and Mühlhäuser M ./trilaterate Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, (1-13)
  4. ACM
    Zhang Y and Harrison C Pulp Nonfiction Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, (1-11)
  5. ACM
    Zhang Y, Yang C, Hudson S, Harrison C and Sample A Wall++ Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, (1-15)
  6. ACM
    Matthies D, Roumen T, Kuijper A and Urban B CapSoles Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services, (1-14)
  7. ACM
    Zhang Y, Laput G and Harrison C Electrick Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, (1-14)
  8. ACM
    Matthies D, Strecker B and Urban B EarFieldSensing Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, (1911-1922)
  9. ACM
    Grosse-Puppendahl T, Dellangnol X, Hatzfeld C, Fu B, Kupnik M, Kuijper A, Hastall M, Scott J and Gruteser M Platypus Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services, (17-30)
  10. ACM
    Grosse-Puppendahl T, Braun A and Dellangnol X (2016). Prototyping Capacitive Sensing Applications with OpenCapSense, GetMobile: Mobile Computing and Communications, 20:2, (16-21), Online publication date: 14-Oct-2016.
  11. ACM
    Haescher M, Matthies D, Bieber G and Urban B CapWalk Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments, (1-8)
  12. ACM
    Matthies D, Perrault S, Urban B and Zhao S Botential Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services, (207-216)
  13. ACM
    Wilhelm M, Krakowczyk D, Trollmann F and Albayrak S eRing Proceedings of the 2nd international Workshop on Sensor-based Activity Recognition and Interaction, (1-6)
  14. ACM
    Braun A, Frank S, Majewski M and Wang X CapSeat Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, (225-232)
  15. ACM
    Le Goc M, Taylor S, Izadi S and Keskin C A low-cost transparent electric field sensor for 3d interaction on mobile devices Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (3167-3170)
  16. ACM
    Grosse-Puppendahl T, Beck S and Wilbers D Rainbowfish CHI '14 Extended Abstracts on Human Factors in Computing Systems, (427-430)
  17. ACM
    Grosse-Puppendahl T, Herber S, Wimmer R, Englert F, Beck S, von Wilmsdorff J, Wichert R and Kuijper A Capacitive near-field communication for ubiquitous interaction and perception Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, (231-242)
  18. ACM
    Grosse-Puppendahl T, Braun A, Kamieth F and Kuijper A Swiss-cheese extended Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1401-1410)
  19. Grosse-Puppendahl T, Benchea S, Kamieth F, Braun A and Schuster C Unobtrusive Recognition of Working Situations Proceedings of the First International Conference on Distributed, Ambient, and Pervasive Interactions - Volume 8028, (115-121)
  20. Aylward R and Paradiso J Sensemble Proceedings of the 2006 conference on New interfaces for musical expression, (134-139)
  21. Martin F, Mikhak B and Silverman B (2000). MetaCricket, IBM Systems Journal, 39:3-4, (795-815), Online publication date: 1-Jul-2000.
Contributors
  • University of Washington
  • Massachusetts Institute of Technology

Recommendations