A (very) simple, text only chatbot using Society AI inference endpoint
Update app.py
All checks were successful
society-ai-hub-container-cache Actions Demo / build (push) Successful in 41s
All checks were successful
society-ai-hub-container-cache Actions Demo / build (push) Successful in 41s
This commit is contained in:
parent
4c63f13b8f
commit
23d46225d5
1
app.py
1
app.py
@ -13,7 +13,6 @@ with gr.Blocks() as demo:
|
|||||||
|
|
||||||
def chat(user_message, history: list):
|
def chat(user_message, history: list):
|
||||||
"""
|
"""
|
||||||
Consolidated function that:
|
|
||||||
1) Appends the user message to the conversation history
|
1) Appends the user message to the conversation history
|
||||||
2) Sends the conversation history to the vLLM API
|
2) Sends the conversation history to the vLLM API
|
||||||
3) Streams back the assistant's response
|
3) Streams back the assistant's response
|
||||||
|
Loading…
x
Reference in New Issue
Block a user