Visual light landmarks for mobile devices

ABSTRACT

The omnipresence of indoor lighting makes it an ideal vehicle for pervasive communication with mobile devices. In this paper, we present a communication scheme that enables interior ambient LED lighting systems to send data to mobile devices using either cameras or light sensors. By exploiting rolling shutter camera sensors that are common on tablets, laptops and smartphones, it is possible to detect high-frequency changes in light intensity reflected off of surfaces and in direct line-of-sight of the camera. We present a demodulation approach that allows smartphones to accurately detect frequencies as high as 8kHz with 0.2kHz channel separation. In order to avoid humanly perceivable flicker in the lighting, our system operates at frequencies above 2kHz and compensates for the non-ideal frequency response of standard LED drivers by adjusting the light's duty-cycle. By modulating the PWM signal commonly used to drive LED lighting systems, we are able to encode data that can be used as localization landmarks. We show through experiments how a binary frequency shift keying modulation scheme can be used to transmit data at 1.25 bytes per second (fast enough to send an ID code) from up to 29 unique light sources simultaneously in a single collision domain. We also show how tags can demodulate the same signals using a light sensor instead of a camera for low-power applications.

References

1. U. E. I. Administration, ''Annual energy outlook early relase,'' 2013.
2. Y. Tanaka, T. Komine, S. Haruyama, and M. Nakagawa, ''Indoor visible communication utilizing plural white leds as lighting,'' in 12th IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, vol. 2, 2001, pp. F-81--F-85 vol. 2.
3. T. Komine and M. Nakagawa, ''Fundamental analysis for visible-light communication system using led lights," IEEE Transactions on Consumer Electronics, vol. 50, no. 1, pp. 100--107, 2004.
4. J. Grubor, S. C. J. Lee, K.-D. Langer, T. Koonen, and J. W. Walewski, ''Wireless high-speed data transmission with phosphorescent white-light leds,'' in 33rd European Conference and Exhibition of Optical Communication - Post-Deadline Papers, 2007, pp. 1--2.
5. J. Grubor, O. C. G. Jamett, J. W. Walewski, and K. d. Langer, ''High-speed wireless indoor communication via visible light,'' in ITG Fachbericht, vol. 198, sept. 2007, pp. 203--208.
6. ''Sg vlc project draft 5c,'' IEEE Draft Std. IEEE P802. 15-08-0667-01-0vlc, Sep. 2008.
7. H. Elgala, R. Mesleh, and H. Haas, ''Indoor broadcasting via white leds and ofdm,'' IEEE Transactions on Consumer Electronics, vol. 55, no. 3, pp. 1127--1134, 2009.
8. C. Danakis, M. Afgani, G. Povey, I. Underwood, and H. Haas, ''Using a cmos camera sensor for visible light communication,'' in IEEE Globecom Workshops, 2012, pp. 1244--1248.
9. T. Hao, R. Zhou, and G. Xing, ''Cobra: color barcode streaming for smartphone systems,'' in Proceedings of the 10th international conference on Mobile systems, applications, and services. ACM, 2012, pp. 85--98.
10. W. Hu, H. Gu, and Q. Pu, ''Lightsync: unsynchronized visual communication over screen-camera links,'' in Proceedings of the 19th annual international conference on Mobile computing & networking. ACM, 2013, pp. 15--26.
11. G. Woo, A. Lippman, and R. Raskar, ''Vrcodes: Unobtrusive and active visual codes for interaction by exploiting rolling shutter,'' in IEEE International Symposium on Mixed and Augmented Reality, ser. ISMAR '12, 2012, pp. 59--64.
12. P. Lazik and A. Rowe, ''Indoor pseudo-ranging of mobile devices using ultrasonic chirps,'' in Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems, ser. SenSys '12. New York, NY, USA: ACM, 2012, pp. 99--112.
13. N. B. Priyantha, A. Chakraborty, and H. Balakrishnan, ''The cricket location-support system,'' in Proceedings of the 6th Annual International Conference on Mobile Computing and Networking (Mobicom '00). New York, NY, USA: ACM, 2000, pp. 32--43.
14. B. Parkinson and S. Gilbert, ''Navstar: Global positioning system - ten years later,'' Proceedings of the IEEE, vol. 71, no. 10, pp. 1177--1186, oct. 1983.
15. T. Tanaka and S. Haruyama, ''New position detection method using image sensor and visible light leds,'' in Second International Conference on Machine Vision, ser. ICMV '09, 2009, pp. 150--153.
16. A. Ward, A. Jones, and A. Hopper, ''A new location technique for the active office,'' IEEE Personal Communications, vol. 4, no. 5, pp. 42--47, oct 1997.
17. P. Bahl and V. Padmanabhan, ''Radar: an in-building rf-based user location and tracking system,'' in Proceedings of the 19th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM '00), vol. 2, 2000, pp. 775--784 vol.2.
18. K. Lorincz and M. Welsh, ''Motetrack: a robust, decentralized approach to rf-based location tracking,'' in Proceedings of the 1st International Conference on Location- and Context-Awareness (LoCA'05). Berlin, Heidelberg: Springer-Verlag, 2005, pp. 63--82.
19. A. Ganick and D. Ryan, ''Self identifying modulated light source,'' no. Patent No. US20130026940, 01 2013.
20. R. D. Roberts, ''Undersampled frequency shift on-off keying (ufsook) for camera communications (camcom),'' ser. WOCC '13, 2013.
21. J. Nakamura, Image Sensors and Signal Processing for Digital Still Cameras, ser. Optical Science and Engineering. Taylor & Francis, 2005.
22. C. Inc., ''Cree 9.5w (60w) warm white led bulb,'' 2009.
23. ''Apple Inc. 2011. AVCam Sample Code. (March 2011). Retrieved January 29, 2013 from https://developer.apple.com/library/ios/samplecode/AVCam.''
24. B. Kisaéecanin, S. Bhattacharyya, and S. Chai, Embedded computer vision, ser. Advances in Pattern Recognition Series. Springer-Verlag London Limited, 2009.
25. J. Bullough, K. S. Hickcox, T. Klein, and N. Narendran, ''Effects of flicker characteristics from solid-state lighting on detection,'' in Lighting Research and Technology, 2011.
26. J. Bullough, K. S. Hickcox, T. Klein, and N. Narendran, ''Detection and acceptability of stroboscopic effects from flicker.'' in Lighting Research and Technology, 2011.
27. F. Ferrari, M. Zimmerling, L. Thiele, and O. Saukh, ''Efficient network flooding and time synchronization with glossy,'' in Information Processing in Sensor Networks (IPSN), 2011 10th International Conference on, 2011, pp. 73--84.

Index Terms

• Applied computing

  • Physical sciences and engineering

    • Electronics

    • Engineering