DEV Community: Sachin Patel

Linear Regression Explained: Estimating Car Values by Mileage

Sachin Patel — Wed, 05 Aug 2026 06:41:12 +0000

Originally published at Programming Tech Lab.

Welcome to the Garage: What is Linear Regression?

Step away from the kitchen counter and step into a bustling auto garage. Imagine you are an experienced mechanic evaluating used cars brought in for trade-ins.

A customer drives in a sedan with 50,000 miles on the odometer and asks: "How much is my car worth?"

Without needing a complex computer program, your brain instantly draws a connection: as the mileage on a car goes up, its resale price goes down. If a car has 0 miles (brand new), it commands peak market price. If it has 200,000 miles, it drops significantly toward scrap value.

This straight-line relationship between two factors—where changes in one variable cause a predictable increase or decrease in another—is the core concept behind Linear Regression.

Deconstructing the Formula (Without the Headache)

In high school math, you probably saw the classic line equation:

y = mx + b

In machine learning, Linear Regression uses this exact same formula to make predictions:

Predicted Value (y) = (Slope m × Input Feature x) + Starting Point b

Let's map this directly to our mechanic's garage evaluation:

Target (y): The estimated resale price of the car ($).
Input Feature (x): The total miles on the odometer.
Starting Point / Intercept (b): The price of the car when mileage is 0 (Brand New MSRP).
Slope / Weight (m): The rate of depreciation (e.g., losing $0.10 in value for every 1 mile driven).

If a car starts at a baseline price of $30,000 and depreciates by $0.10 per mile, a car with 50,000 miles is predicted to be worth:

Predicted Price = $30,000 - ($0.10 × 50,000) = $25,000

How the Algorithm Draws the Perfect Line: Least Squares

If you plot 100 used cars on a graph where the horizontal axis (X) is Mileage and the vertical axis (Y) is Price, the dots won't form a perfectly straight laser line. Some owners took great care of their vehicles; others had minor scratches.

So how does a Linear Regression algorithm draw the single best line through that scattered cloud of dots?

Measuring the Error (The Mechanic's Ruler)

The algorithm starts by drawing a random line across the graph. Then, it measures the vertical distance between every actual car dot and the line. This distance is called the Residual (or Error).

To ensure negative errors don't cancel out positive errors, the algorithm squares every distance and adds them up (producing the Mean Squared Error). It then shifts the line repeatedly until it finds the exact position where this total error is as small as humanly possible. This method is called Ordinary Least Squares (OLS).

Simple vs. Multiple Linear Regression

In real life, a car's price isn't determined by mileage alone. A mechanic considers multiple factors simultaneously:

Simple Linear Regression: Uses 1 input factor (Mileage) to predict output (Price).
Multiple Linear Regression: Uses multiple input factors (Mileage + Age of Car + Engine Size + Number of Accidents) to predict output (Price).

Multiple Linear Regression simply adds more slope terms to our equation:

Price = (m1 × Mileage) + (m2 × Age) + (m3 × Engine Size) + Baseline

Quick Implementation (Python / Scikit-Learn)

Here is how you can train a Linear Regression model in Python:

import numpy as np
from sklearn.linear_model import LinearRegression

# Feature matrix: [Mileage (miles)]
X = np.array([[10000], [25000], [50000], [80000], [120000]])

# Target vector: Car Price ($)
y = np.array([28000, 25500, 22000, 17500, 12000])

# Initialize and fit the model
model = LinearRegression()
model.fit(X, y)

# Predict price for a car with 65,000 miles
sample_mileage = np.array([[65000]])
predicted_price = model.predict(sample_mileage)

print(f"Estimated Car Value: ${predicted_price[0]:,.2f}")

Real-World Applications

Real Estate Valuation: Zillow and property appraisal platforms use Multiple Linear Regression to estimate house prices based on square footage, number of bedrooms, neighborhood crime rates, and age of construction.
Sales & Inventory Forecasting: E-commerce retailers use linear regression to predict monthly sales volume based on ad spend, seasonal trends, and store traffic metrics.

Linear Regression in the MLOps Pipeline

From an MLOps operational perspective, Linear Regression is one of the most lightweight, blazingly fast models you can deploy. It requires minimal CPU power and virtually zero memory footprint compared to Deep Learning networks.

However, MLOps engineers must constantly monitor Linear Regression models for Concept Drift. If inflation rises sharply or supply chain shortages hit the automotive market, the original baseline intercept and slope become invalid. Automated pipeline monitors trigger retrain jobs to update the model weights when live data diverges from historic baselines.

Frequently Asked Questions (FAQ)

Q1: What happens if the relationship between factors isn't a straight line?

Answer: Standard Linear Regression assumes a straight-line relationship. If your data curves (e.g., a car loses value very fast in year 1, then flattens out), forcing a straight line results in poor predictions. In those cases, engineers use Polynomial Regression or non-linear algorithms like Decision Trees.

Q2: Why is Linear Regression still widely used if Deep Learning exists?

Answer: Linear Regression is highly interpretable. You can look directly at the equation weights and explain to stakeholders exactly why a prediction was made. In heavily regulated industries (like banking, lending, and healthcare), explainability is often mandatory by law.

Q3: What is "Outlier Sensitivity" in Linear Regression?

Answer: Because Linear Regression minimizes squared errors, a single extreme data point (e.g., a rare vintage car sold for $2,000,000 with high mileage) can aggressively pull the entire trendline out of alignment. Outliers must be cleaned or removed during data preprocessing.

This article was originally published on Programming Tech Lab.

Logistic Regression Explained: Will This Engine Fail?

Sachin Patel — Wed, 05 Aug 2026 05:03:13 +0000

Originally published at Programming Tech Lab.

Back in the Garage: From Numbers to Yes/No Choices

In standard Linear Regression, we predict continuous numeric values—such as estimating a used car's exact market price based on mileage. But as a software engineer or data analyst working on diagnostic systems, you often face a completely different question:

"Is this engine going to fail in the next 10,000 miles? (Yes or No)"

Predicting continuous dollar amounts or temperatures requires a straight line. But answering binary classification questions—Yes or No, Pass or Fail, Spam or Ham, Malignant or Benign—requires Logistic Regression.

Why Linear Regression Fails at Binary Classification

Why can’t we just fit a straight linear regression line to binary outcomes?

If you map "No Failure" to 0 and "Engine Failure" to 1 on a graph, a straight regression line will inevitably overshoot 1.0 (predicting a 150% chance of failure) or drop below 0.0 (predicting a -40% probability).

Probabilities must strictly remain bounded between 0% (0.0) and 100% (1.0).

The Sigmoid Function (S-Curve Pressure Valve)

To solve this, Logistic Regression takes the linear combination of inputs z = β0 + β1*x1 + ... and passes it through a mathematical function called the Sigmoid Function:

Sigmoid(z) = 1 / (1 + e^(-z))

Think of the Sigmoid function as a diagnostic pressure-release valve. No matter how large or small the raw input value is, it squashes the result into a smooth S-shaped curve bounded strictly between 0.0 and 1.0.

The Decision Threshold

Once the Sigmoid function outputs a probability score (e.g., "This engine has an 82% risk of failure"), how does the model make a final binary classification?

It uses a Decision Threshold (by default set at 0.5):

Probability < 0.5: Classified as 0 (Engine Safe / Pass)
Probability ≥ 0.5: Classified as 1 (Engine Danger / Fail)

Adjusting Sensitivity in Critical Systems

In real-world applications where failure consequences are high (like an automotive engine failing at high speeds), you shouldn't wait for a 50% risk threshold before taking action.

By lowering the decision threshold to 0.20 (20%), the model flags the car for inspection if even a 21% risk is detected. In machine learning, tweaking this threshold allows you to balance Precision and Recall.

Multi-Factor Diagnostics: Multiple Logistic Regression

Predicting engine failure rarely relies on a single sensor reading. Diagnostic scanners aggregate telemetry data across multiple features:

Engine Temperature: High heat increases failure probability.
Oil Pressure Drop: Low pressure increases failure probability.
Engine Vibration: Excessive rattling increases failure probability.

Logistic Regression assigns a weight to each sensor feature, sums them up, and runs the linear combination through the Sigmoid curve to output a unified probability percentage.

Quick Implementation (Python / Scikit-Learn)

Here is how you can train a Logistic Regression model for engine diagnostics:

import numpy as np
from sklearn.linear_model import LogisticRegression

# Synthetic Telemetry Data: [Temperature (°C), Oil Pressure (PSI), Vibration (mm/s)]
X = np.array([
    [85, 45, 1.2],
    [92, 40, 1.5],
    [115, 20, 4.8],
    [120, 15, 5.2],
    [88, 42, 1.1],
    [110, 22, 4.1]
])

# Labels: 0 = Normal, 1 = Failure Risk
y = np.array([0, 0, 1, 1, 0, 1])

# Train Logistic Regression Model
model = LogisticRegression()
model.fit(X, y)

# Predict probability on new sensor reading
sample_sensor_data = [[108, 25, 3.9]]
prob_failure = model.predict_proba(sample_sensor_data)[0][1]

print(f"Engine Failure Probability: {prob_failure * 100:.2f}%")

Real-World Applications

Medical Diagnostics: Risk prediction based on patient metrics (blood pressure, age, biomarkers) to classify test results as Positive or Negative.
Email Spam Detection: Analyzing subject line keywords, domain authority, and attachments to classify messages as Spam (1) or Inbox (0).
MLOps Edge Deployment: Deployed directly inside automotive ECUs or edge devices due to its light memory footprint and sub-millisecond execution times.

Frequently Asked Questions (FAQ)

Q1: Why is it called Logistic "Regression" if it's used for Classification?

Answer: Mathematically, the model performs regression on a continuous probability curve (0.0 to 1.0) before applying a decision threshold to yield discrete classes (0 or 1).

Q2: Can Logistic Regression handle more than two outcomes?

Answer: Yes. Multinomial Logistic Regression extends binary logistic regression to classify across three or more categories (e.g., Low, Medium, High risk levels).

Q3: How do you evaluate performance?

Answer: Rather than Mean Squared Error (MSE), classification models use Accuracy, Precision, Recall, F1-Score, and ROC-AUC curves.

Did you find this analogy helpful? Check out the original article on Programming Tech Lab for more guides in the Machine Learning series!