A (very) simple, text only chatbot using Society AI inference endpoint

Update app.py
All checks were successful
society-ai-hub-container-cache Actions Demo / build (push) Successful in 41s

This commit is contained in:
Hezi Aharon 2024-12-30 14:15:58 +00:00
parent 4c63f13b8f
commit 23d46225d5

1
app.py

@ -13,7 +13,6 @@ with gr.Blocks() as demo:
def chat(user_message, history: list): def chat(user_message, history: list):
""" """
Consolidated function that:
1) Appends the user message to the conversation history 1) Appends the user message to the conversation history
2) Sends the conversation history to the vLLM API 2) Sends the conversation history to the vLLM API
3) Streams back the assistant's response 3) Streams back the assistant's response