Abstract
Abstract
Earphones have evolved from pure audio devices to "earables" that are capable of advanced sensing. Bespoke research devices have shown the unique sensing capabilities of the earable platform; however, they are hard to replicate and require expertise to develop in the first place. In this paper, we present OpenEarable 2.0 - an open source, unified platform that integrates a larger number of sensors for conducting comprehensive earable research. OpenEarable 2.0 works as regular binaural Bluetooth earphones and features two ultrasound capable microphones (inward/outward), a 3-axis ear canal accelerometer/bone microphone, a 9-axis head inertial measurement unit, pulse oximeter, optical temperature sensor, ear canal pressure sensor, and microSD card. These capabilities allow for the detection and measurement of 30+ phenomena on the ear that can be used across a wide range of applications in health monitoring, activity tracking, human-computer-interaction and authentication. We describe the design and development of OpenEarable 2.0 which follows best open hardware practices and achieves commercial-level wearability. We provide justification for the selection and placement of integrated sensors and include in-depth descriptions of the extensible, open source firmware and hardware that are implemented using free to use tools and frameworks. For real-time sensor control and data recording we also contribute a web-based dashboard and mobile smartphone app. The wearability and ability to sense different phenomena are validated in four studies which showcases how OpenEarable 2.0 provides accurate measurements in comparison to established gold-standard measurements. We further demonstrate that OpenEarable 2.0 can be assembled by inexperienced users, and that undergraduate students can build applications using the OpenEarable platform.
AI Summary
AI-Generated Summary (Experimental)
This summary was generated using automated tools and was not authored or reviewed by the article's author(s). It is provided to support discovery, help readers assess relevance, and assist readers from adjacent research areas in understanding the work. It is intended to complement the author-supplied abstract, which remains the primary summary of the paper. The full article remains the authoritative version of record. Click here to learn more.
Click here to comment on the accuracy, clarity, and usefulness of this summary. Doing so will help inform refinements and future regenerated versions.
To view this AI-generated plain language summary, you must have Premium access.
Formats available
You can view the full content in the following formats:
References
[1]
2024. Flutter. https://flutter.dev/. Accessed: 2024-04-07.
[2]
Ashwin Ahuja, Andrea Ferlini, and Cecilia Mascolo. 2021. PilotEar: Enabling In-ear Inertial Navigation. In Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers. 139--145.
[3]
John Allen. 2007. Photoplethysmography and its application in clinical physiological measurement. Physiological measurement 28, 3 (2007), R1.
[4]
Alps Alpine. [n.d.]. SSAG Recoil Type for Single-side and Both Sides Datasheet. Mouser Electronics. https://www.mouser.de/datasheet/2/15/SSAG-1370780.pdf
[5]
Takashi Amesaka, Hiroki Watanabe, and Masanori Sugimoto. 2019. Facial expression recognition using ear canal transfer function. In Proceedings of the 2019 ACM International Symposium on Wearable Computers. 1--9.
[6]
Oliver Amft. 2010. A wearable earpad sensor for chewing monitoring. In SENSORS, 2010 IEEE. IEEE, 222--227.
[7]
Toshiyuki Ando, Yuki Kubo, Buntarou Shizuki, and Shin Takahashi. 2017. Canalsense: Face-related movement recognition system based on sensing air pressure in ear canals. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. 679--689.
[8]
Wissal Ben Arfi, Imed Ben Nasr, Galina Kondrateva, and Lubica Hikkerova. 2021. The role of trust in intention to use the IoT in eHealth: Application of the modified UTAUT in a consumer context. Technological Forecasting and Social Change 167 (2021), 120688.
[9]
Louis Atallah, Benny Lo, Rachel King, and Guang-Zhong Yang. 2011. Sensor positioning for activity recognition using wearable accelerometers. IEEE transactions on biomedical circuits and systems 5, 4 (2011), 320--329.
[10]
L Atallah, A Wiik, B Lo, JP Cobb, AA Amis, and GZ Yang. 2014. Gait asymmetry detection in older adults using a light ear-worn sensor. Physiological measurement 35, 5 (2014), N29.
[11]
Chanavit Athavipach, Setha Pan-Ngum, and Pasin Israsena. 2019. A wearable in-ear EEG device for emotion monitoring. Sensors 19, 18 (2019), 4014.
[12]
Autodesk. 2024. Fusion 360 - Overview. https://www.autodesk.de/products/fusion-360/overview Accessed: 2024-04-07.
[13]
AWARE CBW. [n.d.]. eFit. https://awarecbw.com/pages/efit. Accessed: 2024-10-30.
[14]
Ananta Narayanan Balaji, Andrea Ferlini, Fahim Kawsar, and Alessandro Montanari. 2023. Stereo-bp: Non-invasive blood pressure sensing with earables. In Proceedings of the 24th International Workshop on Mobile Computing Systems and Applications. 96--102.
[15]
Kimin Ban and Eui S Jung. 2020. Ear shape categorization for ergonomic product design. International Journal of Industrial Ergonomics 80 (2020), 102962.
[16]
Abdelkareem Bedri, Richard Li, Malcolm Haynes, Raj Prateek Kosaraju, Ishaan Grover, Temiloluwa Prioleau, Min Yan Beh, Mayank Goel, Thad Starner, and Gregory Abowd. 2017. EarBit: using wearable sensors to detect eating episodes in unconstrained environments. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 1, 3 (2017), 1--20.
[17]
André Bestbier and Pieter R Fourie. 2018. Development of a vital signs monitoring wireless ear probe. In 2018 3rd Biennial South African Biomedical Engineering Conference (SAIBMEC). IEEE, 1--5.
[18]
Bluetooth SIG. 2024. Intro to Bluetooth Generic Attribute Profile (GATT). https://www.bluetooth.com/bluetooth-resources/intro-to-bluetooth-gap-gatt/ Accessed: 2024-04-07.
[19]
Bluetooth Special Interest Group. 2023. LE Audio - The Next Generation of Bluetooth Audio. https://www.bluetooth.com/learn-about-bluetooth/recent-enhancements/le-audio/. Accessed: 2024-03-24.
[20]
Erika Bondareva, Elín Rós Hauksdóttir, and Cecilia Mascolo. 2021. Earables for detection of bruxism: a feasibility study. In Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers. 146--151.
[21]
Nathalie Bonnardel, Annie Piolat, and Ludovic Le Bigot. 2011. The impact of colour on Website appeal and users' cognitive processes. Displays 32, 2 (2011), 69--80.
[22]
Tananant Boonya-Ananta, Andres J Rodriguez, VN Du Le, Jessica C Ramella-Roman, et al. 2021. Monte Carlo analysis of optical heart rate sensors in commercial wearables: the effect of skin tone and obesity on the photoplethysmography (PPG) signal. Biomedical optics express 12, 12 (2021), 7445--7457.
[23]
Bosch Sensortec. 2020. BMP388 Digital Pressure Sensor Datasheet (1.7 ed.). Bosch Sensortec.
[24]
Heiner Brinnel and Michel Cabanac. 1989. Tympanic temperature is a core temperature in humans. Journal of Thermal Biology 14, 1 (1989), 47--53.
[25]
Clara Piris Burgos, Lea Gärtner, Miguel A González Ballester, Jérôme Noailly, Fabian Stöcker, Martin Schönfelder, Tim Adams, and Simone Tassani. 2020. In-ear accelerometer-based sensor for gait classification. IEEE Sensors Journal 20, 21 (2020), 12895--12902.
[26]
Kayla-Jade Butkow, Ting Dang, Andrea Ferlini, Dong Ma, and Cecilia Mascolo. 2023. heart: Motion-resilient heart rate monitoring with in-ear microphones. In 2023 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE, 200--209.
[27]
Soundcore by Anker. 2023. Liberty 4 True Wireless Earbuds - Soundcore Deutschland. https://de.soundcore.com/products/liberty-4-a3953g11. Accessed: 2024-03-19.
[28]
Jorge Chaglla E., Numan Celik, and Wamadeva Balachandran. 2018. Measurement of core body temperature using graphene-inked infrared thermopile sensor. Sensors (Basel) 18, 10 (Oct. 2018), 3315.
[29]
Ishan Chatterjee, Maruchi Kim, Vivek Jayaram, Shyamnath Gollakota, Ira Kemelmacher, Shwetak Patel, and Steven M Seitz. 2022. ClearBuds: wireless binaural earbuds for learning-based speech enhancement. In Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services. 384--396.
[30]
Tuochao Chen, Benjamin Steeper, Kinan Alsheikh, Songyun Tao, François Guimbretière, and Cheng Zhang. 2020. C-face: Continuously reconstructing facial expressions by deep learning contours of the face with ear-mounted miniature cameras. In Proceedings of the 33rd annual ACM symposium on user interface software and technology. 112--125.
[31]
Romit Roy Choudhury. 2021. Earable computing: A new area to think about. In Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications. 147--153.
[32]
Cosinuss GmbH. 2023. c-med° alpha - In-ear sensor. https://www.cosinuss.com/en/products/in-ear-sensors/c-med-alpha/. Accessed: 2024-03-23.
[33]
Harry J Davies, Ian Williams, Nicholas S Peters, and Danilo P Mandic. 2020. In-ear spo2: A tool for wearable, unobtrusive monitoring of core blood oxygen saturation. Sensors 20, 17 (2020), 4879.
[34]
Stefan Debener, Reiner Emkes, Maarten De Vos, and Martin Bleichner. 2015. Unobtrusive ambulatory EEG using a smartphone and flexible printed electrodes around the ear. Scientific reports 5, 1 (2015), 16743.
[35]
Analog Devices. 2020. MAXM86161: Ultra-Low-Power Optical Sensor Module for Heart-Rate and SpO Measurement. Analog Devices, Inc. https://www.analog.com/media/en/technical-documentation/data-sheets/maxm86161.pdf Accessed: 2024-10-30.
[36]
EasyEDA. 2023. EasyEDA: Online PCB Design & Circuit Simulator. https://easyeda.com/. Accessed: 2023-04-05.
[37]
Xiaoran Fan, David Pearl, Richard Howard, Longfei Shangguan, and Trausti Thormundsson. 2023. APG: Audioplethysmography for Cardiac Monitoring in Hearables. In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking. 1--15.
[38]
Antoine Favre-Félix, Carina Graversen, Torsten Dau, and Thomas Lunner. 2017. Real-time estimation of eye gaze by in-ear electrodes. In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 4086--4089.
[39]
Andrea Ferlini, Dong Ma, Robert Harle, and Cecilia Mascolo. 2021. EarGate: gait-based user identification with in-ear microphones. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 337--349.
[40]
Andrea Ferlini, Alessandro Montanari, Andreas Grammenos, Robert Harle, and Cecilia Mascolo. 2021. Enabling In-Ear Magnetic Sensing: Automatic and User Transparent Magnetometer Calibration. In 2021 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE, 1--8.
[41]
Andrea Ferlini, Alessandro Montanari, Chulhong Min, Hongwei Li, Ugo Sassi, and Fahim Kawsar. 2021. In-ear PPG for vital signs. IEEE Pervasive Computing 21, 1 (2021), 65--74.
[42]
Sabrina AL Frohn, Jeevan S Matharu, and Jamie A Ward. 2020. Towards a characterisation of emotional intent during scripted scenes using in-ear movement sensors. In Proceedings of the 2020 ACM International Symposium on Wearable Computers. 37--39.
[43]
Yang Gao, Wei Wang, Vir V Phoha, Wei Sun, and Zhanpeng Jin. 2019. EarEcho: Using ear canal echo for wearable authentication. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1--24.
[44]
Shkurta Gashi, Aaqib Saeed, Alessandra Vicini, Elena Di Lascio, and Silvia Santini. 2021. Hierarchical classification and transfer learning to recognize head gestures and facial expressions using earbuds. In Proceedings of the 2021 International Conference on Multimodal Interaction. 168--176.
[45]
Braun GmbH. [n. d.]. ThermoScan® 7 IRT6520BRAUN Healthcare | Asia Pacific. https://ap.braunhealthcare.com/product/thermoscan-7-irt6520/. (Accessed on 04/08/2024).
[46]
Saygun Guler, Ata Golparvar, Ozberk Ozturk, and Murat Kaya Yapici. 2022. Ear electrocardiography with soft graphene textiles for hearable applications. IEEE Sensors Letters 6, 9 (2022), 1--4.
[47]
Ralf E Harskamp, Luuk Bekker, Jelle CL Himmelreich, Lukas De Clercq, Evert PM Karregat, Mengalvio E Sleeswijk, and Wim AM Lucassen. 2021. Performance of popular pulse oximeters compared with simultaneous arterial oxygen saturation or clinical-grade pulse oximetry: a cross-sectional validation study in intensive care patients. BMJ open respiratory research 8, 1 (2021), e000939.
[48]
Omar Hashem, Khaled Alkiek, Moustafa Youssef, and Khaled A Harras. 2021. Leveraging earables for natural calibration-free multi-device identification in smart environments. In Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications. 92--98.
[49]
Anna Hoyle, Nick Gompertz, Tom Donnelly, Nathan Routledge, and Benjamin Metcalfe. 2023. Enhancing the control of assistive technology using voluntary tensor tympani muscle contraction; using EarSwitch® technology. In RehabWeek 2023.
[50]
Apple Inc. 2023. AirPods Pro (2nd generation) - Technical Specifications. https://www.apple.com/airpods-pro/specs/. Accessed: 2024-03-19.
[51]
Dätwyler Holding Inc. 2024. SoftPulse Products. Online. https://datwyler.com/company/innovation/softpulse/products Accessed: 2024-04-10.
[52]
D. Jarchi, C. Wong, R. M. Kwasnicki, B. Heller, G. A. Tew, and G. Yang. 2014. Gait Parameter Estimation From a Miniaturized Ear-Worn Sensor Using Singular Spectrum Analysis and Longest Common Subsequence. IEEE Transactions on Biomedical Engineering 61, 4 (April 2014), 1261--1273. https://doi.org/10.1109/TBME.2014.2299772
[53]
Delaram Jarchi, Charence Wong, Richard Mark Kwasnicki, Ben Heller, Garry A Tew, and Guang-Zhong Yang. 2014. Gait parameter estimation from a miniaturized ear-worn sensor using singular spectrum analysis and longest common subsequence. IEEE Transactions on Biomedical Engineering 61, 4 (2014), 1261--1273.
[54]
Yincheng Jin, Yang Gao, Xiaotao Guo, Jun Wen, Zhengxiong Li, and Zhanpeng Jin. 2022. Earhealth: an earphone-based acoustic otoscope for detection of multiple ear diseases in daily life. In Proceedings of the 20th annual international conference on mobile systems, applications and services. 397--408.
[55]
Yincheng Jin, Yang Gao, Yanjun Zhu, Wei Wang, Jiyang Li, Seokmin Choi, Zhangyu Li, Jagmohan Chauhan, Anind K Dey, and Zhanpeng Jin. 2021. Sonicasl: An acoustic-based sign language gesture recognizer using earphones. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 2 (2021), 1--30.
[56]
Fahim Kawsar, Chulhong Min, Akhil Mathur, and Alessandro Montanari. 2018. Earables for personal-scale behavior analytics. IEEE Pervasive Computing 17, 3 (2018), 83--89.
[57]
Prerna Khanna, Tanmay Srivastava, Shijia Pan, Shubham Jain, and Phuc Nguyen. 2021. JawSense: recognizing unvoiced sound using a low-cost ear-worn system. In Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications. 44--49.
[58]
Preben Kidmose, David Looney, Michael Ungstrup, Mike Lind Rank, and Danilo P Mandic. 2013. A study of evoked potentials from ear-EEG. IEEE Transactions on Biomedical Engineering 60, 10 (2013), 2824--2830.
[59]
Takashi Kikuchi, Yuta Sugiura, Katsutoshi Masai, Maki Sugimoto, and Bruce H Thomas. 2017. EarTouch: turning the ear into an input surface. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1--6.
[60]
Kinetic Technologies. 2020. KTD2026/KTD2027 Constant Current RGB/White LED Driver with I2C Control (revision 04h ed.). Kinetic Technologies.
[61]
Tobias King, Tobias Röddiger, David Laubenstein, and Michael Beigl. 2024. Systematic Comparison of Ear Temperature Probing Positions for Continuous Wearable Vital Sign Monitoring. In Proceedings of the 2024 ACM International Symposium on Wearable Computers. 144--147.
[62]
Michael Thomas Knierim, Max Schemmer, and Dominik Woehler. 2021. Detecting Daytime Bruxism Through Convenient and Wearable Around-the-Ear Electrodes. In Advances in Usability, User Experience, Wearable and Assistive Technology: Proceedings of the AHFE 2021 Virtual Conferences on Usability and User Experience, Human Factors and Wearable Technologies, Human Factors in Virtual Environments and Game Design, and Human Factors and Assistive Technology, July 25-29, 2021, USA. Springer, 26--33.
[63]
James F Knight and Chris Baber. 2005. A tool to assess the comfort of wearable computers. Human factors 47, 1 (2005), 77--91.
[64]
Gierad Laput, Xiang 'Anthony' Chen, and Chris Harrison. 2016. SweepSense: Ad Hoc Configuration Sensing Using Reflected Swept-Frequency Ultrasonics. In Proceedings of the 21st International Conference on Intelligent User Interfaces (Sonoma, California, USA) (IUI '16). Association for Computing Machinery, New York, NY, USA, 332--335. https://doi.org/10.1145/2856767.2856812
[65]
Steven F LeBoeuf, Michael E Aumer, William E Kraus, Johanna L Johnson, and Brian Duscha. 2014. Earbud-based sensor for the assessment of energy expenditure, heart rate, and VO2max. Medicine and science in sports and exercise 46, 5 (2014), 1046.
[66]
David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation strategies for HCI toolkit research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--17.
[67]
Jihyoung Lee, Kenta Matsumura, Ken-ichi Yamakoshi, Peter Rolfe, Shinobu Tanaka, and Takehiro Yamakoshi. 2013. Comparison between red, green and blue light reflection photoplethysmography for heart rate monitoring during motion. In 2013 35th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, 1724--1727.
[68]
Roman Lissermann, Jochen Huber, Aristotelis Hadjakos, and Max Mühlhäuser. 2013. Earput: Augmenting behind-the-ear devices for ear-based interaction. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. 1323--1328.
[69]
Yuxi Liu and Dimitrios Hatzinakos. 2014. Earprint: Transient evoked otoacoustic emission for biometrics. IEEE Transactions on Information Forensics and Security 9, 12 (2014), 2291--2301.
[70]
Markus Lueken, Xiaowei Feng, Boudewijn Venema, Berno JE Misgeld, and Steffen Leonhardt. 2017. Photoplethysmography-based in-ear sensor system for identification of increased stress arousal in everyday life. In 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN). IEEE, 83--86.
[71]
Lan Luo, Xichen She, Jiexuan Cao, Yunlong Zhang, Yijiang Li, and Peter XK Song. 2019. Detection and prediction of ovulation from body temperature measured by an in-ear wearable thermometer. IEEE transactions on biomedical engineering 67, 2 (2019), 512--522.
[72]
Gang Ma, Wenliang Zhu, Jun Zhong, Teng Tong, Jie Zhang, and Lirong Wang. 2018. Wearable ear blood oxygen saturation and pulse measurement system based on PPG. In 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI). IEEE, 111--116.
[73]
Y Maeda, M Sekine, T Tamura, A Moriya, T Suzuki, and K Kameyama. 2008. Comparison of reflected green light and infrared photoplethysmography. In 2008 30th annual international conference of the IEEE engineering in medicine and biology society. IEEE, 2270--2272.
[74]
Hiroyuki Manabe and Masaaki Fukumoto. 2006. Full-time wearable headphone-type gaze detector. In CHI'06 extended abstracts on Human factors in computing systems. 1073--1078.
[75]
Michela Masè, Alessandro Micarelli, and Giacomo Strapazzon. 2020. Hearables: new perspectives and pitfalls of in-ear devices for physiological monitoring. A scoping review. Frontiers in Physiology 11 (2020), 568886.
[76]
Michela Masè, Alessandro Micarelli, and Giacomo Strapazzon. 2020. Hearables: new perspectives and pitfalls of in-ear devices for physiological monitoring. A scoping review. Frontiers in Physiology 11 (2020), 1227.
[77]
Keiji Matsumoto, Yuksel Temiz, Hamidreza Taghavi, Elrick L Cornelius, Hiroyuki Mori, and Bruno Michel. 2019. An earbud-type wearable (A hearable) with vital parameter sensors for early detection and prevention of heat-stroke. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 7049--7055.
[78]
Kohei Matsumura, Daisuke Sakamoto, Masahiko Inami, and Takeo Igarashi. 2012. Universal earphones: earphones with automatic side and shared use detection. In Proceedings of the 2012 ACM international conference on Intelligent User Interfaces. 305--306.
[79]
Denys JC Matthies, Bernhard A Strecker, and Bodo Urban. 2017. Earfieldsensing: A novel in-ear electric field sensing to enrich wearable gesture input through facial expressions. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 1911--1922.
[80]
Melexis. 2023. MLX90632 FIR Sensor Datasheet. Melexis. https://media.melexis.com/-/media/files/documents/datasheets/mlx90632-datasheet-melexis.pdf#page19 Revision 12.
[81]
Christopher A Merck, Christina Maher, Mark Mirtchouk, Min Zheng, Yuxiao Huang, and Samantha Kleinberg. 2016. Multimodality sensing for eating recognition. In PervasiveHealth. 130--137.
[82]
Christian Metzger, Matt Anderson, and Thad Starner. 2004. Freedigiter: A contact-free device for gesture control. In Eighth International Symposium on Wearable Computers, Vol. 1. IEEE, 18--21.
[83]
Chulhong Min, Akhil Mathur, and Fahim Kawsar. 2018. Exploring Audio and Kinetic Sensing on Earable Devices. In Proceedings of the 4th ACM Workshop on Wearable Systems and Applications (Munich, Germany) (WearSys '18). Association for Computing Machinery, New York, NY, USA, 5--10. https://doi.org/10.1145/3211960.3211970
[84]
Chulhong Min, Akhil Mathur, and Fahim Kawsar. 2018. Exploring audio and kinetic sensing on earable devices. In Proceedings of the 4th ACM Workshop on Wearable Systems and Applications. 5--10.
[85]
Alessandro Montanari, Andrea Ferlini, Ananta Narayanan Balaji, Cecilia Mascolo, and Fahim Kawsar. 2023. EarSet: A Multi-Modal Dataset for Studying the Impact of Head and Facial Movements on In-Ear PPG Signals. Scientific Data 10, 1 (2023), 850.
[86]
Alessandro Montanari, Ashok Thangarajan, Khaldoon Al-Naimi, Andrea Ferlini, Yang Liu, Ananta Narayanan Balaji, and Fahim Kawsar. 2024. OmniBuds: A Sensory Earable Platform for Advanced Bio-Sensing and On-Device Machine Learning. arXiv preprint arXiv:2410.04775 (2024).
[87]
Takashi Nakamura, Valentin Goverdovsky, and Danilo P Mandic. 2017. In-ear EEG biometrics for feasible and readily collectable real-world person authentication. IEEE Transactions on Information Forensics and Security 13, 3 (2017), 648--661.
[88]
Colver Ken Howe Ne, Jameel Muzaffar, Aakash Amlani, and Manohar Bance. 2021. Hearables, in-ear sensing devices for bio-signal acquisition: a narrative review. Expert Review of Medical Devices 18, sup1 (2021), 95--128.
[89]
Colver Ken Howe Ne, Jameel Muzaffar, Aakash Amlani, and Manohar Bance. 2021. Hearables, in-ear sensing devices for bio-signal acquisition: a narrative review. Expert Review of Medical Devices 18, sup1 (2021), 95--128. https://doi.org/10.1080/17434440.2021.2014321 arXiv:https://doi.org/10.1080/17434440.2021.2014321 34904507.
[90]
Meir Nitzan, Ayal Romem, and Robert Koppel. 2014. Pulse oximetry: fundamentals and technology update. Medical Devices: Evidence and Research (2014), 231--239.
[91]
Nokia Bell Labs. 2024. OmniBuds - Sensory Earables. https://omnibuds.tech/. Accessed: 2024-03-19.
[92]
Nordic Semiconductor [n. d.]. nRF5340 Product Specification v1.3.1. Nordic Semiconductor.
[93]
Nordic Semiconductor. 2023. Capacitive Sensor Library - nRF5 SDK v15.0.0. https://infocenter.nordicsemi.com/index.jsp?topic=%2Fcom.nordic.infocenter.sdk5.v15.0.0%2Flib_csense.html Accessed: 2023-04-12.
[94]
Don Norman. 2007. Emotional design: Why we love (or hate) everyday things. Basic books.
[95]
K. Onizuka and C. G. Sodini. 2015. Head ballistocardiogram based on wireless multi-location sensors. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 1275--1278. https://doi.org/10.1109/EMBC.2015.7318600
[96]
Open Source Hardware Association. 2013. Best Practices for Open Source Hardware 1.0. https://www.oshwa.org/sharing-best-practices/. Accessed: 2024-03-2024.
[97]
Hiroki Ota, Minghan Chao, Yuji Gao, Eric Wu, Li-Chia Tai, Kevin Chen, Yasutomo Matsuoka, Kosuke Iwai, Hossain M Fahad, Wei Gao, et al. 2017. 3d printed "earable" smart devices for real-time detection of core body temperature. ACS sensors 2, 7 (2017), 990--997.
[98]
Zhenchao Ouyang, Jingfeng Hu, Jianwei Niu, and Zhiping Qi. 2017. An asymmetrical acoustic field detection system for daily tooth brushing monitoring. In GLOBECOM 2017-2017 IEEE Global Communications Conference. IEEE, 1--6.
[99]
Victor Pankratius, Michael Beigl, and Tobias Röddiger. 2023. Sensorsystem und Verfahren zum Ermitteln eines Kauverhaltens eines Anwenders. German Patent DE102021210223A1. Available at: https://patents.google.com/patent/DE102021210223A1/en.
[100]
S. Paßler and W. Fischer. 2011. Food Intake Activity Detection Using a Wearable Microphone System. In 2011 Seventh International Conference on Intelligent Environments. 298--301. https://doi.org/10.1109/IE.2011.9
[101]
Stefanie Passler, Niklas Müller, and Veit Senner. 2019. In-ear pulse rate measurement: a valid alternative to heart rate derived from electrocardiography? Sensors 19, 17 (2019), 3641.
[102]
Pervasive Systems Team at Nokia Bell Labs Cambridge. 2023. Earable Computing Research. https://esense.io/. Accessed: 2023-04-14.
[103]
PINE64. 2023. PineBuds Pro. https://wiki.pine64.org/wiki/PineBuds_Pro. Accessed: 2024-03-25.
[104]
Joseph Plazak and Marta Kersten-Oertel. 2018. A Survey on the Affordances of "Hearables". Inventions 3, 3 (2018), 48.
[105]
Raytac Corporation 2023. MDBT53-1M & MDBT53-P1M Ver.D Specification. Raytac Corporation. https://www.raytac.com/download/index.php?index_id=60
[106]
Tobias Röddiger, Michael Beigl, and Anja Exler. 2020. Design space and usability of earable prototyping. In Proceedings of the 2020 ACM International Symposium on Wearable Computers. 73--78.
[107]
Tobias Röddiger, Michael Beigl, Michael Hefenbrock, Daniel Wolffram, and Erik Pescara. 2021. Detecting episodes of increased cough using kinetic earables. In Proceedings of the Augmented Humans International Conference 2021. 111--115.
[108]
Tobias Röddiger, Christopher Clarke, Paula Breitling, Tim Schneegans, Haibin Zhao, Hans Gellersen, and Michael Beigl. 2022. Sensing with earables: A systematic literature review and taxonomy of phenomena. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1--57.
[109]
Tobias Röddiger, Christopher Clarke, Daniel Wolffram, Matthias Budde, and Michael Beigl. 2021. EarRumble: Discreet Hands-and Eyes-Free Input by Voluntary Tensor Tympani Muscle Contraction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--14.
[110]
Tobias Röddiger, Tobias King, Dylan Ray Roodt, Christopher Clarke, and Michael Beigl. 2022. Openearable: Open hardware earable sensing platform. In Adjunct Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 ACM International Symposium on Wearable Computers. 246--251.
[111]
Tobias Röddiger, Jake Stuchbury-Wass, Mathias Ciliberto, Philipp Lepold, and Michael Beigl. 2024. OpenEarable 1.4: Dual Microphones Earpiece to Capture In-Ear and Outer-Ear Audio Signals. In Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing. 930--933.
[112]
Tobias Röddiger, Daniel Wolffram, David Laubenstein, Matthias Budde, and Michael Beigl. 2019. Towards respiration rate monitoring using an in-ear headphone inertial measurement unit. In Proceedings of the 1st International Workshop on Earable Computing. 48--53.
[113]
Bosch Sensortec. 2022. BMX160:9-Axis Accelerometer, Gyroscope, and Magnetometer Datasheet. Bosch Sensortec GmbH. https://www.mouser.com/pdfdocs/BST-BMX160-DS000-11.pdf Accessed: 2024-10-30.
[114]
Bosch Sensortec. 2023. BMA580: Low Power Digital Acceleration Sensor Datasheet. Bosch Sensortec GmbH. https://www.bosch-sensortec.com/media/boschsensortec/downloads/datasheets/bst-bma580-ds000.pdf Accessed: 2024-10-30.
[115]
Dongyeol Seok, Sanghyun Lee, Minjae Kim, Jaeouk Cho, and Chul Kim. 2021. Motion artifact removal techniques for wearable EEG and PPG sensor systems. Frontiers in Electronics 2 (2021), 685513.
[116]
David Strömbäck, Sangxia Huang, and Valentin Radu. 2020. Mm-fit: Multimodal deep learning for automatic exercise logging across sensing devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1--22.
[117]
Yushi Takayama, Shun Ishii, Anna Yokokubo, and Guillaume Lopez. 2021. Detecting forward leaning posture using eSense and developing a posture improvement promoting system. In Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers. 178--179.
[118]
Karlsruhe Institute of Technology TECO. 2021. edge-ml: Machine Learning for Microcontrollers. https://edge-ml.org/. Accessed: 2024-03-24.
[119]
Texas Instruments. 2016. bq27220 Single-Cell CEDV Fuel Gauge (revision a ed.). https://www.ti.com/lit/ds/symlink/bq27220.pdf
[120]
Texas Instruments. 2018. bq25120A Low IQ Highly Integrated Battery Charge Management Solution for Wearables and IoT (revision a ed.). https://www.ti.com/lit/ds/symlink/bq25120a.pdf
[121]
Timo Tigges, Thomas Büchler, Alexandru Pielmuş, Michael Klum, Aarne Feldheiser, Oliver Hunsicker, and Reinhold Orglmeister. 2019. Assessment of in-ear photoplethysmography as a surrogate for electrocardiography in heart rate variability analysis. In World Congress on Medical Physics and Biomedical Engineering 2018: June 3-8, 2018, Prague, Czech Republic (Vol. 2). Springer, 293--297.
[122]
Hoang Truong, Alessandro Montanari, and Fahim Kawsar. [n. d.]. Blood pressure monitoring. US Patent US20240000325A1.
[123]
VARTA Microbattery GmbH. 2022. Technical Handbook CoinPower: Rechargeable Li-Ion Button Cells. Technical Handbook. VARTA Microbattery GmbH. https://www.texim-europe.com/getfile.ashx?id=130672
[124]
Boudewijn Venema, Vladimir Blazek, and Steffen Leonhardt. 2015. In-ear photoplethysmography for mobile cardiorespiratory monitoring and alarming. In 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN). IEEE, 1--5.
[125]
Boudewijn Venema, Johannes Schiefer, Vladimir Blazek, Nikolai Blanik, and Steffen Leonhardt. 2013. Evaluating innovative in-ear pulse oximetry for unobtrusive cardiovascular and pulmonary monitoring during sleep. IEEE journal of translational engineering in health and medicine 1 (2013), 2700208--2700208.
[126]
Wim Verkruysse, Lars O Svaasand, and J Stuart Nelson. 2008. Remote plethysmographic imaging using ambient light. Optics express 16, 26 (2008), 21434--21445.
[127]
Quanzeng Wang, Yangling Zhou, Pejman Ghassemi, David McBride, Jon P Casamento, and T Joshua Pfefer. 2021. Infrared thermography for measuring elevated body temperature: clinical accuracy, calibration, and evaluation. Sensors 22, 1 (2021), 215.
[128]
Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. Iskin: flexible, stretchable and visually customizable on-body touch sensors for mobile computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2991--3000.
[129]
Xuhai Xu, Haitian Shi, Xin Yi, WenJia Liu, Yukang Yan, Yuanchun Shi, Alex Mariakakis, Jennifer Mankoff, and Anind K Dey. 2020. Earbuddy: Enabling on-face interaction via wireless earbuds. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--14.
[130]
Zephyr Project. 2023. Zephyr Project: An RTOS for the Internet of Things. https://www.zephyrproject.org/. Accessed: 2024-03-24.
[131]
Haibin Zhao, Tobias Röddiger, Yufei Feng, and Michael Beigl. 2024. Fit2Ear: Generating Personalized Earplugs from Smartphone Depth Camera Images. In Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing. 679--684.