AI Oximeter

In today's world, health monitoring has become more important than ever. Imagine building your very own smart oximeter that not only measures blood oxygen levels (SPO2) and heart rate but also integrates Artificial Intelligence (AI) for smarter insights, all powered by the versatile ESP32-S3 microcontroller and a vibrant 172x320 IPS display. This DIY project isn't just about assembling hardware, it's a hands-on journey into product design, embedded systems, and AI-powered analytics.

This guide is crafted for educators, students, and hobbyists who are passionate about blending technology and health innovation. You'll learn how to interface sensors, display real-time health data, and harness the power of Edge Impulse to train and deploy AI models directly on your device. Whether you're an aspiring engineer, a tech enthusiast, or someone curious about the intersection of AI and healthcare, this project is your gateway to understanding how modern health devices are designed and built.

So, let's roll up our sleeves and start building a smart oximeter that’s not only functional but also a valuable learning experience!

1x FireBeetle 2 ESP32-S3

1x Heart Rate and Oximeter Sensor

1x IPS LCD Display (1.47" 172×320)

1x Screws Kit

Tools:

My 3D Printer

My Screwdriver Kit

First, I have designed this case and cover for our project by taking all the measurements of each component and importing the components whose 3D models were available.

You can download the design file and open it in Fusion 360 to modify it according to your needs, or you can download STL files and 3D print them:

1. 1x housing.stl
2. 1x cover.stl

I have 3D printed the housing in dark gray color and the cover in a dual-color tone, dark gray and green, by using the filament change technique, pausing the print in between.

No 3D Printer? No Problem, Getting it done from PCBWAY

If you don’t have access to a 3D printer, there’s no need to worry! I highly recommend getting your 3D printing needs taken care of by PCBWay.

Why Choose PCBWay?

PCBWay is renowned for its high-quality 3D printing services, offering precision and durability that stand out compared to other providers in the market. Whether it’s prototypes or fully functional parts, their state-of-the-art technology ensures your designs are brought to life with impeccable detail.

Explore their 3D Printing Services here: PCBWay 3D Printing Services

More Than Just 3D Printing

But that’s not all PCBWay has to offer! They’re your one-stop solution for all your electronics and prototyping needs:

1. PCB Manufacturing & Assembly: Get professional-grade PCBs with options for both small-scale prototypes and mass production.
2. CNC Machining Services: Perfect for custom enclosures, mechanical parts, or any high-precision metal and plastic work.
3. Injection Molding: Ideal for producing high-quality, detailed plastic components in bulk.
4. Sheet Metal Fabrication: Tailored solutions for creating durable and precise metal parts.

No matter what your project requires, PCBWay has the tools, expertise, and services to help bring your ideas to reality

Don’t forget to check out their special New Year offers and discounts here: PCBWay New Year 2025 Special Offers

Whether you need 3D printed parts, custom PCBs, or advanced fabrication services, PCBWay has you covered!

First, I took the SPO2 heart rate sensor and mounted it on the 3D-printed cover by snapping the sensor into its designed location.

Then, I took the display module and, using two M2 screws, mounted it to the cover in its designed position. Make sure to keep the orientation in mind during assembly.

Now, let's connect the GID ribbon cable to the display and connect the sensor cable as well.

Now, take the housing and the ESP32, position the Type-C port with the designed slot on the housing, and snap it into place at the back as shown in the image.

Connect the sensor to the ESP32 using the cable we connected earlier

1. Connect the SCL pin of the sensor to SCL on the ESP32.
2. Connect the SDA pin of the sensor to SDA on the ESP32.
3. Connect VCC (sensor) to 3V on the ESP32.
4. Connect GND (sensor) to GND on the ESP32.

Solder the wires in place.

Connect the GDI connector to the corresponding connector on the ESP32.

1. Position all the cables neatly inside the housing, ensuring they are not pinched or stressed.
2. Carefully align and snap the cover onto the housing, securing it in place.

1. Go to edgeimpulse.com and log in to your account.
2. Click on "Create new project."
3. Enter a name for your project.
4. Choose whether to keep your project Private or Public.
5. Click on "Create."

Understanding the Data Acquisition Panel:

1. The Data Acquisition panel in Edge Impulse allows you to upload data, collect data from a connected device, and manage your datasets.
2. You can upload data from CSV files, use built-in tools for live data collection, or import pre-recorded datasets.

Downloading Data from Kaggle:

1. Since we have no data initially, I downloaded Health Data from kaggle.com containing SpO2, Heart Rate, Body Temperature, and a Status label.

Importing CSV Data:

1. Go to "CSV Wizard" in the Data Acquisition panel.
2. Upload the Health Data.csv file you downloaded.
3. Set "Is this time series data?" to No.
4. Choose "Status" as your Label.
5. Click on "Finish Wizard."

Splitting Data:

1. Upload the Health Data.csv again.
2. Check the box for "Automatic split between training and testing."
3. If your data is already separated, upload them manually to Training and Testing datasets.

Dataset Overview:

1. Once uploaded, you’ll see your data listed in the Dataset tab.
2. Ensure your data is split in an 80-20% ratio between Training and Testing.

The more diverse and accurate data you collect, the better your model will perform.

Accessing the EON Tuner:

1. Navigate to the EON Tuner panel within your Edge Impulse project.
2. Click on New Run, then select Use Template.
3. Choose the Motion Events template.

(This choice is based on the use case where the model needs to classify different motion patterns, such as gestures or physical activities.)

1. Finally, click Start Tuner.

The EON Tuner will begin optimizing your model's architecture to find the best balance between performance, accuracy, and resource usage. This process may take some time, as it tests multiple model configurations. Once complete, it will list the results, with the best-performing configurations displayed at the top and the less-optimal ones at the bottom.

Understanding the Results: The EON Tuner displays key metrics for each model configuration, such as latency, RAM, ROM, and overall accuracy. Below is a general explanation of the images and metrics:

1. Model Configurations: Each card represents a different model architecture.
2. For example, the three shown in the images are labeled raw-dense-872, raw-dense-605, and raw-dense-75c.
3. Performance Metrics:
4. Latency: Time taken for the model to make a prediction. In these examples, all models have a latency of 1ms, meaning they're very fast.
5. RAM: Memory required to run the model. More compact models use less RAM, as seen in the third model (1 kB).
6. ROM: Storage size of the model. Again, smaller models like the third one are more efficient, with 15 kB usage compared to 16 kB.
7. Accuracy and Confusion Matrices: Each card includes a confusion matrix to illustrate how well the model performs across different classes:
8. The diagonal values represent correct classifications.
9. Off-diagonal values represent misclassifications.
10. The darker the diagonal cells, the better the model’s performance.
11. F1 Score: Combines precision and recall into a single metric, shown for each class. Higher F1 scores indicate better performance.

Selecting the Best Model:

1. In this example, raw-dense-872 has the highest accuracy (92%), with strong performance across all metrics (e.g., F1 scores above 0.88).
2. If resource constraints (RAM or ROM) are more critical, a smaller model like raw-dense-75c (84% accuracy) might be a better choice despite lower accuracy.

Once you’ve identified the most suitable model, click on Add to integrate it into your Edge Impulse project for deployment.

Edge Impulse automatically creates the complete impulse for you, which includes the following components:

1. Raw Data Block: Configured to process your raw input data appropriately.
2. Feature Extractor/Processing Block: Optimized based on the selected model.
3. Classifier: The machine learning model itself, fine-tuned and ready for deployment.

If you don’t use the EON Tuner:

Without the EON Tuner, you would need to manually configure each step in the pipeline, including:

1. Defining the raw data processing block (e.g., windowing or filtering).
2. Choosing and tuning the feature extractor (e.g., Fourier transform, spectral analysis, etc.).
3. Selecting the classifier architecture and adjusting its hyperparameters based on your understanding of machine learning.

This manual process requires a deeper understanding of data processing and model design, and it often involves a trial-and-error approach. You can check my previous project SitSense for better understanding.

Visual Analysis: The feature explorer graph shows three clearly separated clusters (red, green, purple), suggesting good model differentiation between classes. The data appears well-distributed, with:

1. A curved green cluster at the top
2. Mixed red and green points in the middle
3. Purple points scattered along the bottom

This visualization suggests a successful segmentation of the health monitoring data (pulse, temperature, SpO2) into three distinct categories, which is promising for classification accuracy.

Performance:

1. 96.4% overall accuracy
2. Very low loss (0.17)
3. Perfect F1 score (1.00) for Class 2
4. Strong confusion matrix scores (95.3%, 93.1%, 100% diagonal)

Device Requirements:

1. Fast inference: 1ms
2. Efficient memory: 1.6K RAM
3. Compact storage: 16.5K flash

The data explorer visualization shows mostly correct classifications (green dots), with minimal misclassifications (red dots) clustered in one small area, indicating robust model performance across different health states.

These metrics suggest a reliable, deployment-ready model suitable for resource-constrained IoT health monitoring devices.

1. Go to the Deployment panel in Edge Impulse.
2. From the available deployment options, select Arduino Library.
3. Click on Build to compile the model as an Arduino library.

Installing Edge Impulse Library:

1. Once the build is complete, a ZIP file will be downloaded to your system.
2. Extract the ZIP file.
3. Copy the extracted folder and paste it into the Documents > Arduino > libraries folder on your computer.

Modify the ei_classifier_config.h File:

1. Navigate to the following path inside the extracted library folder:

1. Locate the file named ei_classifier_config.h.
2. Find the following line:

1. Change the value from 1 to 0 as shown below:

Why This Change Is Necessary:

1. The ESP-NN (Neural Network Acceleration) feature in TensorFlow Lite is designed to optimize performance on ESP32 devices.
2. However, this setting can sometimes cause compatibility issues with certain models or configurations.
3. Disabling it ensures the model runs reliably, even if it means sacrificing some performance optimization.

After making the change, save the file and close the editor.

Download and Install Libraries:

1. Download the RTU and Heart Rate Sensor libraries.
2. Open the Arduino IDE.
3. Ensure you have the ESP32 Board Manager installed.
4. If not, click here for the installation steps.
5. In the Arduino IDE, navigate to: Sketch > Include Library > Add ZIP Library.
6. Select the RTU library ZIP file to install it.
7. Repeat the process for the Heart Rate Sensor library ZIP file.
8. Download the AI_Oximeter GitHub repository.
9. Extract the ZIP file. This will include: The AI_Oximeter code, CAD files, The modified GDL Display Library.
10. Again, go to: Sketch > Include Library > Add ZIP Library.
11. Select the extracted GDL Display Library ZIP file to install it.

1. Open the Oximeter.ino file in the Arduino IDE.
2. Use a USB cable to connect your device to your PC.
3. In the Arduino IDE, go to Tools > Board and select: DFRobot FireBeetle-2 ESP32-S3.
4. Then, go to Tools > Port and select the COM port corresponding to your connected device.
5. Click on the Upload button in the Arduino IDE (the right-facing arrow icon).
6. Wait for the upload process to complete.
7. Once the upload is finished, the AI Oximeter firmware is successfully installed on your device and run.

This code is designed for an AI-powered Oximeter that measures SpO2 (oxygen saturation), heart rate, and body temperature using a MAX30102 sensor. It uses a TFT display to show the results and an Edge Impulse model to classify the user's health status based on the measured data.

MAX30102 Sensor Initialization:

TFT Display Initialization:

Feature Extraction:

This function prepares the input features (heart rate, body temperature, and SpO2) for the Edge Impulse model.

Setup Function:

1. Initializes the serial monitor, TFT display, and MAX30102 sensor.
2. Displays an error message if the sensor fails to initialize.

Loop Function:

1. Collects SpO2, heart rate, and body temperature data.
2. Displays a "No Finger Detected" message if no valid readings are obtained.
3. Runs the Edge Impulse classifier using the collected features.
4. Displays the measured values and classification result (Good, Bad, or Sick) on the TFT display.

If you change the name of your Edge Impulse project, you must update the #include <AI_Oximeter_inferencing.h> line with the new project name.

This project demonstrates the successful integration of Edge Impulse's AI capabilities with real-time sensor data to build an AI-powered oximeter. By leveraging the MAX30102 sensor, ST7789 TFT display, and a custom-trained Edge Impulse model, we have created a compact and efficient device capable of monitoring vital health parameters such as SpO2, heart rate, and body temperature. The addition of AI-based classification enhances the oximeter's functionality by providing an intuitive assessment of the user's health status (Good, Bad, or Sick) based on real-time data.

It is important to note that this device is for educational purposes only and should not be trusted for professional health monitoring or diagnosis. While it demonstrates the potential of combining machine learning and IoT, it is not a certified medical device and should not be used as a replacement for medical-grade equipment.

Thank you for joining me on this journey. If you enjoyed this project, please don’t forget to like, comment, and share your own experiences in the "I Made It" section. The future is filled with endless potential, and I’m excited to see what amazing projects you’ll create with this incredible technology.

See you next time, and happy making ;)