Beck_Moulton

Posted on Sep 7

Beyond the Wrist: Detecting Sickness Before It Hits with HRV Anomaly Detection and Scikit-learn

#machinelearning #python #datascience #webdev

Ever woke up feeling like a truck hit you, only to realize your Apple Watch had been screaming "Warning!" via your data for the last 24 hours?

Heart Rate Variability (HRV) is the "canary in the coal mine" for our bodies. It's a powerful metric that tracks the variation in time between each heartbeat, serving as a direct window into your Autonomic Nervous System. In this guide, we are going to build a real-time HRV anomaly detector using wearable data analysis, Scikit-learn, and AWS Lambda. By applying machine learning to time-series health data, we can identify physiological stress, potential infections, or overtraining before physical symptoms even manifest.

If you’ve been looking to dive into anomaly detection in time-series or want to master health data engineering, you’re in the right place!

The Architecture: From Heartbeat to Alert 🛠️

To achieve real-time monitoring, we need a pipeline that moves data from your wrist to a cloud-based inference engine. Here is the high-level flow:

graph TD
    A[Apple Watch / Wearable] -->|Sync| B(Apple HealthKit)
    B -->|Webhook/Hook| C[AWS API Gateway]
    C --> D[AWS Lambda - Inference]
    D -->|Fetch History| E[(DynamoDB / S3)]
    D -->|Isolation Forest| F{Anomaly?}
    F -->|Yes| G[Push Notification / Alert]
    F -->|No| H[Log & Silent]

Prerequisites 📋

Before we start coding, ensure you have the following:

Python 3.9+
Scikit-learn & Pandas for data crunching.
AWS Account (for Lambda deployment).
An app to push HealthKit data (like Health Auto Export or a custom Swift hook).

Step 1: Understanding the Data 📊

HRV data is tricky because it’s highly personalized. What is "low" for an athlete might be "high" for someone else. This is why we use Isolation Forest, an unsupervised learning algorithm that excels at detecting outliers in multi-dimensional datasets without needing labeled "sick" vs. "healthy" days.

Step 2: Building the Anomaly Detection Logic

Let's write the core logic using Scikit-learn. We’ll use the Isolation Forest algorithm because it doesn't assume a normal distribution of data.

import pandas as pd
from sklearn.ensemble import IsolationForest

def detect_hrv_anomalies(data: pd.DataFrame):
    """
    Expects a DataFrame with 'timestamp' and 'hrv_value'.
    """
    # 1. Feature Engineering: Rolling averages can help capture trends
    data['rolling_mean'] = data['hrv_value'].rolling(window=7).mean()
    data.fillna(method='bfill', inplace=True)

    # 2. Initialize Isolation Forest
    # contamination=0.05 means we expect 5% of data to be anomalous
    model = IsolationForest(n_estimators=100, contamination=0.05, random_state=42)

    # 3. Fit and Predict
    # We reshape because the model expects a 2D array
    inputs = data[['hrv_value', 'rolling_mean']]
    data['anomaly_score'] = model.fit_predict(inputs)

    # Note: -1 is an anomaly, 1 is normal
    anomalies = data[data['anomaly_score'] == -1]
    return anomalies

# Example Usage
# df = pd.read_csv("my_health_data.csv")
# alerts = detect_hrv_anomalies(df)
# print(f"Detected {len(alerts)} suspicious health events!")

Step 3: Deploying as a Serverless Function (AWS Lambda)

To make this "real-time," we wrap the logic in an AWS Lambda function. When your HealthKit hook triggers, it sends the latest HRV samples to this function.

import json
import pandas as pd
import joblib # To load a pre-trained scaler if needed

def lambda_handler(event, context):
    try:
        # Parse incoming HealthKit data
        body = json.loads(event['body'])
        hrv_samples = body['data']['metrics']['hrv_samples']

        df = pd.DataFrame(hrv_samples)

        # In a real scenario, you'd fetch the last 30 days 
        # of data from DynamoDB here to provide context!

        # Simple Logic: If the latest value is an outlier
        # ... (Call detect_hrv_anomalies from Step 2)

        return {
            'statusCode': 200,
            'body': json.dumps({'status': 'processed', 'anomaly_detected': False})
        }
    except Exception as e:
        return {'statusCode': 500, 'body': str(e)}

Scaling Your Health Tech Stack 🥑

While this "Beginner" setup is great for a weekend project, production-grade health monitoring requires robust data syncing, privacy compliance (HIPAA/GDPR), and more sophisticated baseline modeling.

For those looking to take this further—like integrating multi-modal sensors or building enterprise-grade health dashboards—I highly recommend checking out the advanced patterns at WellAlly Tech Blog. They have incredible deep dives on production-ready health data pipelines and biometric signal processing that go far beyond basic anomaly detection.

Step 4: Connecting the Hook 🔗

To get data out of your iPhone, you can use an app like Health Auto Export.

Set the Automation to trigger every time HRV is updated.
Point the URL Endpoint to your AWS API Gateway URL.
Set the payload format to JSON.

Now, every time your Apple Watch records an HRV reading (usually every few hours or during a "Breathe" session), your Lambda function will analyze it!

Conclusion: Data is the Best Medicine 💊

By moving our health data "beyond the wrist" and into our own analytical cloud, we transform passive tracking into proactive health management. This setup can alert you to take a rest day before you overtrain or to drink more fluids before a cold fully sets in.

What's next?

Try adding Sleep Duration as a second feature to your Isolation Forest.
Integrate Twilio to send yourself an SMS when an anomaly is detected.

Have you tried building with HealthKit before? Let me know in the comments below! 👇

DEV Community