Alton Zheng

Posted on Jun 21

Building a Practical AI Assistant with Python: From Prompt to Production Thinking

#ai #python #tutorial #llm

Why Python is still one of the best choices for AI

Python is popular in AI because it has a strong ecosystem, simple syntax, and great support for data processing, APIs, automation, and machine learning.

For AI applications, Python works especially well for:

Building backend AI services
Connecting to LLM APIs
Processing documents and text
Creating automation workflows
Building RAG and chatbot systems
Integrating AI into existing products

But the important point is this:

AI is not just a model. AI is a workflow.

A good AI application usually includes input handling, prompt design, validation, error handling, logging, security, and user feedback.

A simple AI assistant in Python
Here is a basic example of an AI assistant service using Python.

import os
from openai import OpenAI

client = OpenAI(api_key=os.getenv("OPENAI_API_KEY"))

def ask_ai(user_message: str) -> str:
    if not user_message.strip():
        return "Please provide a valid question."

    response = client.chat.completions.create(
        model="gpt-4o-mini",
        messages=[
            {
                "role": "system",
                "content": "You are a helpful technical assistant. Answer clearly and professionally."
            },
            {
                "role": "user",
                "content": user_message
            }
        ],
        temperature=0.3
    )

    return response.choices[0].message.content

Usage:

question = "Explain REST API in simple terms."
answer = ask_ai(question)

print(answer)

This works, but it is still very basic.
For a real application, we need to think beyond the first response.

Improving the assistant with better structure

class AIAssistant:
    def __init__(self, client):
        self.client = client

    def build_messages(self, user_message: str):
        return [
            {
                "role": "system",
                "content": (
                    "You are a senior software engineering assistant. "
                    "Give practical, clear, and accurate answers."
                )
            },
            {
                "role": "user",
                "content": user_message
            }
        ]

    def ask(self, user_message: str) -> str:
        if not user_message or not user_message.strip():
            raise ValueError("User message cannot be empty.")

        response = self.client.chat.completions.create(
            model="gpt-4o-mini",
            messages=self.build_messages(user_message),
            temperature=0.2
        )

        return response.choices[0].message.content

This makes the code easier to test and extend.

For example, later we can add:

Conversation memory
Document search
User authentication
Logging
Prompt versioning
Rate limiting
Response validation

What makes an AI app production-ready?
Calling an LLM is easy. Building a reliable AI feature is harder.

Here are the main things I focus on:
1. Clear prompts
A vague prompt gives vague answers.

Instead of:

Answer the user.

Use:

You are a technical assistant. Give accurate, concise, and practical answers. 
If the answer is uncertain, say so clearly.

Good prompts reduce random output and make the system more predictable.

2. Lower temperature for serious tasks

For professional or technical systems, I usually prefer a lower temperature.

temperature=0.2

This makes the answer more stable and less creative.

For brainstorming or marketing content, a higher temperature may be useful.

3. Error handling

AI services can fail because of network issues, rate limits, invalid input, or API errors.

def safe_ask_ai(assistant, message: str) -> str:
    try:
        return assistant.ask(message)
    except ValueError as error:
        return f"Input error: {error}"
    except Exception:
        return "Sorry, something went wrong while processing your request."

Never expose raw system errors directly to users in production.

4. Logging and monitoring

If an AI feature is used by real users, you need visibility.

You should track:

Request count
Error rate
Response time
Token usage
Failed prompts
User feedback

This helps you understand whether the AI feature is actually useful.

5. Human feedback loop

The best AI systems improve over time.

Add simple feedback options like:

Was this answer helpful? 👍 👎

That feedback can help identify weak prompts, missing context, or confusing answers.

Simple FastAPI example

Here is how we can expose the assistant as an API.

from fastapi import FastAPI, HTTPException
from pydantic import BaseModel
from openai import OpenAI
import os

app = FastAPI()

client = OpenAI(api_key=os.getenv("OPENAI_API_KEY"))
assistant = AIAssistant(client)


class QuestionRequest(BaseModel):
    question: str


class QuestionResponse(BaseModel):
    answer: str


@app.post("/ask", response_model=QuestionResponse)
def ask_question(request: QuestionRequest):
    try:
        answer = assistant.ask(request.question)
        return QuestionResponse(answer=answer)
    except ValueError as error:
        raise HTTPException(status_code=400, detail=str(error))
    except Exception:
        raise HTTPException(status_code=500, detail="AI service failed.")

Now we have a simple AI backend endpoint.

Request:

{
  "question": "What is the difference between REST and GraphQL?"
}

Response:

{
  "answer": "REST uses multiple endpoints for resources, while GraphQL allows clients to request exactly the data they need from a single endpoint..."
}