Pywayne Llm Chat Ollama Gradio

👤 wangyendt 📦 v0.1.0 ⭐ 3.6 ⬇️ 1.3K 下載
💻 開發程式設計 免費

📖 技能介紹


name: pywayne-llm-chat-ollama-gradio description: Gradio-based chat interface for Ollama with multi-session management. Use when working with pywayne.llm.chat_ollama_gradio module to create a web-based chat UI that connects to Ollama models, supports multiple chat sessions, model selection, and streaming responses. Integrates with ChatManager for session management.


Pywayne Chat Ollama Gradio

This module provides a Gradio-based web chat interface for Ollama models with multi-session support.

Quick Start

from pywayne.llm.chat_ollama_gradio import OllamaChatGradio

# Create and launch chat interface
app = OllamaChatGradio(
    base_url="http://localhost:11434/v1",
    server_port=7870
)
app.launch()

Configuration

Parameter Default Description
base_url "http://localhost:11434/v1" Ollama API base URL
server_name "0.0.0.0" Server host name
server_port 7870 Server port
root_path "" Root path for reverse proxy
api_key "ollama" API key (for Ollama compatibility)

Model Discovery

Automatically discovers available Ollama models by running ollama list:

  • Excludes models with 'embed' in the name
  • Falls back to qwen2.5:0.5b if no models found

Session Management

Creating New Sessions

# UI method: Click "新建會話" button
new_chat_id, new_history, new_choices = app.create_new_chat()

Switching Sessions

# UI method: Select from "歷史會話" radio list
history = app.switch_chat(selected_chat_id)

API Reference

OllamaChatGradio

Method Description
get_ollama_models() Get list of available Ollama models
init_chat_manager() Initialize ChatManager instance
create_new_chat() Create new chat session, returns (chat_id, history, radio_update)
switch_chat(chat_id) Switch to specified chat session
format_history(history) Format history for display
chat(message, history, model_name) Process chat message with streaming
create_demo() Create Gradio interface
launch() Launch Gradio server

UI Components

7w4.net有更好的技能外掛。

Component Description
chatbot Main chat display area
msg Message input textbox
model_dropdown Model selection dropdown
chat_id_text Current session ID (read-only)
new_chat_btn Button to create new session
chat_history_list Radio list for session switching

Requirements

  • gradio - Web UI framework
  • pywayne.llm.chat_bot - ChatManager and LLMConfig
  • ollama CLI - Must be installed and accessible

Notes

  • Uses ChatManager for multi-session support
  • Streaming responses update UI in real-time
  • Session history persists in memory (not persistent)
  • Requires Ollama to be running before launching

🤖 AI 評測

這個 Skill 文件寫得不錯,但實際用不了——它只有說明文件,缺少核心程式碼,就像買了一本菜譜卻沒有配方。建議等開發者補充完整程式碼後再使用。

📊 多維度評分

適應性3.7
規範性3.8
有效性3.4
可靠性3
可信度4.7

📁 包含檔案 (2 個)

📄 SKILL.md 2.8 KB
📄 _meta.json 137 B