ABSTRACT
A way to improve gaze tracking by spectral imaging is presented. Spectral still and video cameras enabled a collection of a novel database consisting of 180 multispectral eye movement videos and 30 spectral images of the eyes of 30 voluntary human subjects. Unfavorable conditions, such as eyewear reflections, extreme angles and make-up were incorporated. Unlike conventional RGB and gray scale eye tracking a seven-channel spectral video capture over the wavelength range of 380-1000 nm, in addition with spectral still images in the range of 450-950 nm, provided a detailed acquisition of spectral signatures of the eye and its surroundings. These signatures can be exploited to create new methodologies for imaging, training, analysis and interpretation of eye tracking data in harsh conditions.
- Rox R. Anderson, and John A. Parrish 1981. The optics of human skin. Journal of Investigative Dermatology 77, no. 1: 13--19.Google ScholarCross Ref
- Simona Crihalmeanu, and Arun Ross 2012. Multispectral scleral patterns for ocular biometric recognition. Pattern Recognition Letters 33.14: 1860--1869. Google ScholarDigital Library
- Mark D. Fairchild, Mitchell R. Rosen, and Garrett M. Johnson 2001. Spectral and metameric color imaging. RIT-MCSL Technical Report.Google Scholar
- Pauli Fält, Jouni Hiltunen, Markku Hauta-Kasari, Iiris Sorri, Valentina Kalesnykiene, Juhani Pietilä, and Hannu Uusitalo 2011. Spectral imaging of the human retina and computationally determined optimal illuminants for diabetic retinopathy lesion detection. Journal of Imaging Science and Technology 55, no. 3: 30509-1.Google ScholarCross Ref
- Ana Gebejes, Joni Orava, Niko Penttinen, Ville Heikkinen, Jouni Hiltunen, and Markku HautaKasari 2014. Color and Image Characterization of a Three CCD Seven Band Spectral Camera. In Image and Signal Processing, pp. 96--105. Springer International PublishingGoogle Scholar
- Nathan Hagen, and Michael W. Kudenov. 2013 Review of snapshot spectral imaging technologies. Optical Engineering 52, no. 9: 090901-090901.Google Scholar
- Dan Witzner Hansen, and Qiang Ji 2010. In the eye of the beholder: A survey of models for eyes and gaze. Pattern Analysis and Machine Intelligence, IEEE Transactions on 32.3: 478--500. Google ScholarDigital Library
- Dan-Ning Hu, John D. Simon, and Tadeusz Sarna 2008. Role of ocular melanin in ophthalmic physiology and pathology. Photochemistry and photobiology 84, no. 3: 639--644.Google Scholar
- José M. Medina, Luís M. Pereira, Hélder T. Correia, and Sérgio MC Nascimento 2011. "Hyperspectral optical imaging of human iris in vivo: characteristics of reflectance spectra." Journal of biomedical optics 16, no. 7: 076001--076001.Google ScholarCross Ref
- Scott Prahl 2014 Spectra http://omlc.org/spectra/water/abs/index.htmlGoogle Scholar
- Shishir Shah, James Thigpen, Fatima Merchant, and Kenneth Castleman 2006. Photometric calibration for automated multispectral imaging of biological samples. In Proceedings of the 1st Workshop on Microscopic Image Analysis with Applications in Biology (in conjunction with MICCAI, Copenhagen), pp. 27--33.Google Scholar
- Spectral Color Research Group, University of Eastern Finland http://www.uef.fi/fi/spectralGoogle Scholar
- Spectral Color Research Group, University of Eastern Finland (2016), SPEED database http://www.uef.fi/fi/spectral/speedGoogle Scholar
- Anthony J. Thody, Elisabeth M. Higgins, Kazumasa Wakamatsu, Shosuke Ito, Susan A. Burchill, and Janet M. Marks 1991. Pheomelanin as well as eumelanin is present in human epidermis. Journal of Investigative Dermatology 97, no. 2: 340--344.Google ScholarCross Ref
- Marc Tonsen, Xucong Zhang, Yusuke Sugano, and Andreas Bulling 2015. Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environments. arXiv preprint arXiv:1511.05768.Google Scholar
- Erroll Wood, Tadas BaltrušKaitis, Louis-Philippe Morency, Peter Robinson, and Andreas Bulling 2016. Learning an appearance-based gaze estimator from one million synthesised images. Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications, pp. 131--138. Google ScholarDigital Library
- George Zonios, Julie Bykowski, and Nikiforos Kollias 2001. Skin melanin, hemoglobin, and light scattering properties can be quantitatively assessed in vivo using diffuse reflectance spectroscopy. Journal of Investigative Dermatology 117, no. 6: 1452--1457.Google ScholarCross Ref
Index Terms
- SPEED: SPectral eye vidEo database
Recommendations
A Prism-Mask System for Multispectral Video Acquisition
This paper presents a prism-mask system for capturing multispectral videos. The system is composed of a triangular prism, a monochrome camera, and an occlusion mask. Incoming light beams from the scene are sampled by the occlusion mask, dispersed into ...
Multi-resolution analysis techniques and nonlinear PCA for hybrid pansharpening applications
Hyperspectral images have a higher spectral resolution (i.e., a larger number of bands covering the electromagnetic spectrum), but a lower spatial resolution with respect to multispectral or panchromatic acquisitions. For increasing the capabilities of ...
Super-resolution of hyperspectral image via superpixel-based sparse representation
In this paper, a novel superpixel-based sparse representation (SSR) model is proposed for hyperspectral image (HSI) super-resolution. Specifically, given a HSI with low spatial resolution and a multispectral image (MSI) with high spatial resolution, the ...
Comments