Detection of COVID-19 Through Thermal and Voice Sensing Using Smartphone

Since the end of 2019, the world has been caught in the crisis of the COVID-19 which is a serious epidemic disease. This paper seeks to come up with a fast and efficient COVID-19 detection and monitoring easy to use system which can be used in the facilities of densely populated areas, such as community centers and school clinics, to quickly identify suspected COVID-19 patients. This system could detect the probability of a person getting infected by COVID-19 using an android smartphone and thermal camera. Three types of data are collected from users: breathe sound, thermal video, and health status. Generally, the breathe audio and thermal video are preprocessed into two-time series, which indicate the breath status of the user. Then, the two series are inputted into the Bidirectional Gated Recurrent Unit (BI-GRU) neural network model separately to get the infection rates. Since the real data is difficult to get due to privacy reasons, a synthetic dataset is generated based on mathematical equations to train the model. For health status, the application requires the user to fill a questionnaire and calculates an infection rate through a medical prediction model. Finally, the two values from the machine learning model and the infection rate from the user report are added together with weight to calculate the final predictive infection rate.