You can easily build a personal AI chatbot that runs both online (using OpenAI GPT) and offline (using Ollama local models) right from your local machine. It’s beneficial to integrate this feature into your new/existing application effectively and quickly. both online (using OpenAI GPT) offline (using Ollama local models) Let’s go step-by-step. Let’s go step-by-step 1. Online Chatbot (Using OpenAI API) 1. Online Chatbot (Using OpenAI API) This method uses OpenAI’s GPT models (like GPT-3.5 or GPT-4) and requires internet access. OpenAI’s GPT models Step 1: Install Python Step 1: Install Python Download Python from https://www.python.org/downloads/


During installation, check “Add Python to PATH”
Verify installation :
python --version Download Python from https://www.python.org/downloads/ Download Python from https://www.python.org/downloads/ https://www.python.org/downloads/ https://www.python.org/downloads/ During installation, check “Add Python to PATH”
Verify installation :
python --version During installation, check “Add Python to PATH” check “Add Python to PATH” Verify installation : python --version python --version Step 2: Install Required Packages Step 2: Install Required Packages Run the following in CMD : CMD pip install openai colorama pyttsx3 pip install openai colorama pyttsx3 Package Summary Package Summary Package

Purpose



openai

Connects GPT models



colorama

Adds colored text in CMD



pyttsx3

Enables voice output Package

Purpose



openai

Connects GPT models



colorama

Adds colored text in CMD



pyttsx3

Enables voice output Package

Purpose Package Package Package Purpose Purpose Purpose openai

Connects GPT models openai openai Connects GPT models Connects GPT models colorama

Adds colored text in CMD colorama colorama Adds colored text in CMD Adds colored text in CMD pyttsx3

Enables voice output pyttsx3 pyttsx3 Enables voice output Enables voice output Step 3: Generate OpenAI API Key Step 3: Generate OpenAI API Key Log in at: https://platform.openai.com/api-keys
Click “Create new secret key”
Copy your key (starting with ‘sk-…’) Log in at: https://platform.openai.com/api-keys https://platform.openai.com/api-keys Click “Create new secret key” Copy your key (starting with ‘sk-…’) Step 4: Set the API Key in Windows Step 4: Set the API Key in Windows In CMD, run the following command CMD setx OPENAI_API_KEY "sk-your_api_key_here" setx OPENAI_API_KEY "sk-your_api_key_here" Close and reopen your command prompt. Step 5: Create Your Chatbot Script Step 5: Create Your Chatbot Script Create a file named chatbot_ai.py and paste the below code: chatbot_ai.py import os
from colorama import Fore, Style, init
from openai import OpenAI
import pyttsx3

# Initialize color and voice
init(autoreset=True)
engine = pyttsx3.init()

# Define model
OPENAI_MODEL = "gpt-3.5-turbo"

# Connect OpenAI API
client = OpenAI(api_key=os.getenv("OPENAI_API_KEY"))

print(Fore.CYAN + "\n🤖 AI Chatbot ready! Type 'exit' to quit.\n")
chat_history = []

def speak(text):
    engine.say(text)
    engine.runAndWait()

while True:
    user_input = input(Fore.GREEN + "You: " + Style.RESET_ALL)
    if user_input.lower() in ["exit", "quit", "bye"]:
        print(Fore.MAGENTA + "Chatbot: Goodbye! 👋")
        break

    chat_history.append({"role": "user", "content": user_input})

    try:
        response = client.chat.completions.create(
            model=OPENAI_MODEL,
            messages=chat_history
        )
        reply = response.choices[0].message.content.strip()
    except Exception as e:
        reply = f"⚠️ Error: {e}"

    print(Fore.YELLOW + "Chatbot:" + Style.RESET_ALL, reply)
    chat_history.append({"role": "assistant", "content": reply})
    speak(reply) import os
from colorama import Fore, Style, init
from openai import OpenAI
import pyttsx3

# Initialize color and voice
init(autoreset=True)
engine = pyttsx3.init()

# Define model
OPENAI_MODEL = "gpt-3.5-turbo"

# Connect OpenAI API
client = OpenAI(api_key=os.getenv("OPENAI_API_KEY"))

print(Fore.CYAN + "\n🤖 AI Chatbot ready! Type 'exit' to quit.\n")
chat_history = []

def speak(text):
    engine.say(text)
    engine.runAndWait()

while True:
    user_input = input(Fore.GREEN + "You: " + Style.RESET_ALL)
    if user_input.lower() in ["exit", "quit", "bye"]:
        print(Fore.MAGENTA + "Chatbot: Goodbye! 👋")
        break

    chat_history.append({"role": "user", "content": user_input})

    try:
        response = client.chat.completions.create(
            model=OPENAI_MODEL,
            messages=chat_history
        )
        reply = response.choices[0].message.content.strip()
    except Exception as e:
        reply = f"⚠️ Error: {e}"

    print(Fore.YELLOW + "Chatbot:" + Style.RESET_ALL, reply)
    chat_history.append({"role": "assistant", "content": reply})
    speak(reply) Step 6: Run the Chatbot Step 6: Run the Chatbot Navigate to the folder where you saved the script: cd C:\path\to\your\script

python chatbot_ai.py cd C:\path\to\your\script

python chatbot_ai.py You’ll now get responses from GPTdirectly in your terminal.Make sure yourOpenAI quota is active and not exhausted. GPT OpenAI quota is active 2. Offline Chatbot (Using Ollama Local Model) 2. Offline Chatbot (Using Ollama Local Model) Do you have a use case for running the chatbot without internet or API keys? without internet or API keys Yes, we could. I am going to explain it in detailed steps by following here. Use Ollama, a tool that runs large language models locally (like Llama 3, Mistral, Gemma). Ollama Llama 3 Mistral Gemma Step 1: Install Ollama Step 1: Install Ollama Download and install from https://ollama.com/download https://ollama.com/download https://ollama.com/download After installation, Ollama runs automatically in the background. Verify installation: Verify installation: ollama --version ollama --version Step 2: Download a Local Model Step 2: Download a Local Model Pull the Llama 3 model (recommended): Llama 3 ollama pull llama3 ollama pull llama3 You can also try others: ollama pull mistral
ollama pull gemma2 ollama pull mistral
ollama pull gemma2 Step 3: Update Your Script for Offline Mode Step 3: Update Your Script for Offline Mode Add the below changes to the same chatbot_ai.py file: chatbot_ai.py USE_OPENAI = False
OLLAMA_MODEL = "llama3"

import subprocess

try:
    result = subprocess.run(
        ["ollama", "run", OLLAMA_MODEL],
        input=user_input,
        text=True,
        capture_output=True
    )
    reply = result.stdout.strip()
except Exception as e:
    reply = f"⚠️ Ollama error: {e}" USE_OPENAI = False
OLLAMA_MODEL = "llama3"

import subprocess

try:
    result = subprocess.run(
        ["ollama", "run", OLLAMA_MODEL],
        input=user_input,
        text=True,
        capture_output=True
    )
    reply = result.stdout.strip()
except Exception as e:
    reply = f"⚠️ Ollama error: {e}" Step 4: Run Your Offline Chatbot Step 4: Run Your Offline Chatbot Change directory to your script location: cd C:\path\to\your\script cd C:\path\to\your\script Run it: python chatbot_ai.py python chatbot_ai.py You can now chat without internet — responses are generated locally from Llama 3 or your chosen model. without internet Llama 3 OUTPUT: OUTPUT: Now you have your own personal AI assistant — online or offline, right on your PC! Now you have your own personal AI assistant — online or offline, right on your PC! Quick Comparison Quick Comparison Feature

Online GPT (OpenAI)

Offline Ollama



Internet Required

Yes

No



API Key Needed

Yes

No



Model

GPT-3.5 / GPT-4

Llama 3 / Mistral / Gemma



Speed

Fast (Cloud)

Depends on your PC



Cost

Pay-per-use

Free (after install) Feature

Online GPT (OpenAI)

Offline Ollama



Internet Required

Yes

No



API Key Needed

Yes

No



Model

GPT-3.5 / GPT-4

Llama 3 / Mistral / Gemma



Speed

Fast (Cloud)

Depends on your PC



Cost

Pay-per-use

Free (after install) Feature

Online GPT (OpenAI)

Offline Ollama Feature Feature Feature Online GPT (OpenAI) Online GPT (OpenAI) Online GPT (OpenAI) Offline Ollama Offline Ollama Offline Ollama Internet Required

Yes

No Internet Required Internet Required Yes Yes No No API Key Needed

Yes

No API Key Needed API Key Needed Yes Yes No No Model

GPT-3.5 / GPT-4

Llama 3 / Mistral / Gemma Model Model GPT-3.5 / GPT-4 GPT-3.5 / GPT-4 Llama 3 / Mistral / Gemma Llama 3 / Mistral / Gemma Speed

Fast (Cloud)

Depends on your PC Speed Speed Fast (Cloud) Fast (Cloud) Depends on your PC Depends on your PC Cost

Pay-per-use

Free (after install) Cost Cost Pay-per-use Pay-per-use Free (after install) Free (after install) Summary Summary Online Mode (OpenAI) → Uses GPT-3.5 or GPT-4 with internet
Offline Mode (Ollama) → Uses local models like Llama 3 without internet
Both can run inside your local command prompt using Python Online Mode (OpenAI) → Uses GPT-3.5 or GPT-4 with internet Online Mode (OpenAI) Offline Mode (Ollama) → Uses local models like Llama 3 without internet Offline Mode (Ollama) Both can run inside your local command prompt using Python local command prompt

The code in this story is for educational purposes. The readers are solely responsible for whatever they build with it.

OpenAI

Build Your Own AI Chatbot on Your Local PC — Online and Offline

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

A Practical Guide to the Saga Pattern in Spring Boot Microservices

Beyond Correlation: How Econometric Statistics Power Real-World Decisions

The Hidden Problem With Group Rewards in Multi-Agent AI

The Noonification: Use This 7-Step McKinsey Framework to Solve Any Problem (1/10/2023)

The Noonification: A Taxonomy of Inclusiveness (1/11/2024)

The Noonification: What is the InfiniteNature-Zero AI Model? (11/19/2022)

A Practical Guide to the Saga Pattern in Spring Boot Microservices

Beyond Correlation: How Econometric Statistics Power Real-World Decisions

The Hidden Problem With Group Rewards in Multi-Agent AI

The Noonification: Use This 7-Step McKinsey Framework to Solve Any Problem (1/10/2023)

The Noonification: A Taxonomy of Inclusiveness (1/11/2024)

The Noonification: What is the InfiniteNature-Zero AI Model? (11/19/2022)

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps