Zhi Quan Zhou
Skip Abstract Section
Abstract
Metamorphic testing can test untestable software, detecting fatal errors in autonomous vehicles' onboard computer systems.
- Baidu, Inc. Apollo Reference Hardware, Mar. 2018; http://apollo.auto/platform/hardware.htmlGoogle Scholar
- Barr, E.T., Harman, M., McMinn, P., Shahbaz, M., and Yoo, S. The oracle problem in software testing: A survey. IEEE Transactions on Software Engineering 41, 5 (May 2015), 507--525.Google ScholarDigital Library
- Brown, J., Zhou, Z.Q., and Chow, Y.-W. Metamorphic testing of navigation software: A pilot study with Google Maps. In Proceedings of the 51<sup>st</sup> Annual Hawaii International Conference on System Sciences (Big Island, HI, Jan. 3--6, 2018) 5687--5696; http://hdl.handle.net/10125/50602Google ScholarCross Ref
- Chen, T.Y., Kuo, F.-C., Liu, H., Poon, P.-L., Towey, D., Tse, T.H., and Zhou, Z.Q. Metamorphic testing: A review of challenges and opportunities. ACM Computing Surveys 51, 1 (Jan. 2018), 4:1--4:27. Google ScholarDigital Library
- Chen, T.Y., Kuo, F.-C., Ma, W., Susilo, W., Towey, D., Voas, J., and Zhou, Z.Q. Metamorphic testing for cybersecurity. Computer 49, 6 (June 2016), 48--55. Google ScholarDigital Library
- Chen, T.Y., Tse, T.H., and Zhou, Z.Q. Fault-based testing without the need of oracles. Information and Software Technology 45, 1 (2003), 1--9.Google ScholarDigital Library
- Donaldson, A.F., Evrard, H., Lascu, A., and Thomson, P. Automated testing of graphics shader compilers. Proceedings of the ACM on Programming Languages 1 (2017), 93:1--93:29. Google ScholarDigital Library
- Jarman, D.C., Zhou, Z.Q., and Chen, T.Y. Metamorphic testing for Adobe data analytics software. In Proceedings of the IEEE/ACM Second International Workshop on Metamorphic Testing, in conjunction with the 39<sup>th</sup> International Conference on Software Engineering (Buenos Aires, Argentina, May 22). IEEE, 2017. 21--27 Google ScholarDigital Library
- Kanewala, U., Pullum, L.L., Segura, S., Towey, D., and Zhou, Z.Q. Message from the workshop chairs. In Proceedings of the IEEE/ACM First International Workshop on Metamorphic Testing, in conjunction with the 38<sup>th</sup> International Conference on Software Engineering (Austin, TX, May 16). ACM Press, New York, 2016.Google Scholar
- Le, V., Afshari, M., and Su, Z. Compiler validation via equivalence modulo inputs. In Proceedings of the 35<sup>th</sup> ACM SIGPLAN Conference on Programming Language Design and Implementation (Edinburgh, U.K., June 9--11). ACM Press, New York, 2014, 216--226. Google ScholarDigital Library
- Lee, D. Sensor firm Velodyne 'baffled' by Uber self-driving death. BBC News (Mar. 23, 2018); http://www.bbc.com/news/technology-43523286Google Scholar
- Levin, S. Uber crash shows 'catastrophic failure' of self-driving technology, experts say. The Guardian (Mar. 23, 2018); https://www.theguardian.com/technology/2018/mar/22/self-driving-car-uber-death-woman-failure-fatal-crash-arizonaGoogle Scholar
- Lindvall, M., Ganesan, D., Árdal, R., and Wiegand, R.E. Metamorphic model-based testing applied on NASA DAT --- An experience report. In Proceedings of the 37<sup>th</sup> IEEE/ACM International Conference on Software Engineering (Firenze, Italy, May 16--24). IEEE, 2015, 129--138. Google ScholarDigital Library
- Lindvall, M., Porter, A., Magnusson, G., and Schulze, C. Metamorphic model-based testing of autonomous systems. In Proceedings of the Second IEEE/ACM International Workshop on Metamorphic Testing, in conjunction with the 39<sup>th</sup> International Conference on Software Engineering (Buenos Aires, Argentina, May 22). IEEE, 2017, 35--41. Google ScholarDigital Library
- Ohnsman, A. LiDAR maker Velodyne 'baffled' by self-driving Uber's failure to avoid pedestrian. Forbes (Mar. 23, 2018); https://www.forbes.com/sites/alanohnsman/2018/03/23/lidar-maker-velodyne-baffled-by-self-driving-ubers-failure-to-avoid-pedestrianGoogle Scholar
- Posky, M. LiDAR supplier defends hardware, blames Uber for fatal crash. The Truth About Cars (Mar. 23, 2018); http://www.thetruthaboutcars.com/2018/03/lidar-supplier-blames-uber/Google Scholar
- Regehr, J. Finding Compiler Bugs by Removing Dead Code. Blog, June 20, 2014; http://blog.regehr.org/archives/1161Google Scholar
- Segura, S., Fraser, G., Sanchez, A.B., and Ruiz-Cortés, A. A survey on metamorphic testing. IEEE Transactions on Software Engineering 42, 9 (Sept. 2016), 805--824.Google ScholarCross Ref
- Segura, S. and Zhou, Z.Q. Metamorphic testing: Introduction and applications. ACM SIGSOFT webinar, Sept. 27, 2017; https://event.on24.com/wcc/r/1451736/8B5B5925E82FC9807CF83C84834A6F3DGoogle Scholar
- Segura, S. and Zhou, Z.Q. Metamorphic testing 20 years later: A hands-on introduction. In Proceedings of the 40<sup>th</sup> IEEE/ACM International Conference on Software Engineering (Gothenburg, Sweden, May 27--June 3, 2018). ACM Press, New York, 2018. Google ScholarDigital Library
- Tian, Y., Pei, K., Jana, S., and Ray, B. DeepTest: Automated testing of deep neural network-driven autonomous cars. In Proceedings of the 40<sup>th</sup> IEEE/ACM International Conference on Software Engineering (Gothenburg, Sweden, May 27--June 3, 2018). ACM Press, New York, 2018. Google ScholarDigital Library
- Vassilev, A. and Celi, C. Avoiding cyberspace catastrophes through smarter testing. Computer 47, 10 (Oct. 2014), 102--106. Google ScholarDigital Library
- Velodyne, Velodyne's HDL-64E: A High-Definition LiDAR Sensor for 3-D Applications, White Paper, 2007; https://www.velodynelidar.com/Google Scholar
- Zhou, Z.Q., Towey, D., Poon, P.-L., and Tse, T.H. Introduction to the special issue on test oracles. Journal of Systems and Software 136 (Feb. 2018), 187Google ScholarCross Ref
- Zhou, Z.Q., Xiang, S., and Chen, T.Y. Metamorphic testing for software quality assessment: A study of search engines. IEEE Transactions on Software Engineering 42, 3 (Mar. 2016), 264--284.Google ScholarDigital Library
Index Terms
- Metamorphic testing of driverless cars
Recommendations
Metamorphic Testing: A Review of Challenges and Opportunities
Metamorphic testing is an approach to both test case generation and test result verification. A central element is a set of metamorphic relations, which are necessary properties of the target function or algorithm in relation to multiple inputs and ...
The ethics of driverless cars
Special Issue on EthicompThis paper critiques the idea of full autonomy, as illustrated by Oxford University's Robotcar. A fully autonomous driverless car relies on no external inputs, including GPS and solely learns from its environment using learning algorithms. These cars ...
Metamorphic Fuzz Testing of Autonomous Vehicles
ICSEW'20: Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering WorkshopsDriving simulation is the primary approach for testing the software components of autonomous vehicles. This paper presents an automated testing method, termed metamorphic fuzz testing (MFT), in the context of simulation testing of autonomous driving. ...
Comments