Litestar GET function blocks OpenAI

**题意:**Litestar GET 函数阻塞 OpenAI

问题背景:

When I transfer function to litestar, it suddenly stops OpenAI from returning a completion. I can print to console every declared variable except answer:

当我将函数传递给 litestar 时,它突然阻止了 OpenAI 返回完成结果。我可以打印到控制台中声明的每个变量,除了答案之外。

python 复制代码
from dotenv import load_dotenv
from litestar import Controller, Litestar, get
from litestar.types import ControllerRouterHandler

import os
import pinecone
from langchain.embeddings.openai import OpenAIEmbeddings
from langchain.vectorstores import Pinecone
from dotenv import load_dotenv
import openai


__all__ = (
    "index",
    "support",
)

load_dotenv()

embeddings = OpenAIEmbeddings()

@get("/")
async def index() -> str:
    return "Тестовый запрос выполнен. Чтобы получить ответ, воспользуйтесь командой /support/{вопрос%20вопрос}."

@get("/support/{question:str}")
async def get_answer(question: str) -> str:
    
    pinecone.init(
        api_key=os.getenv("PINECONE_API_KEY"),
        environment=os.environ.get('PINECONE_ENVIRONMENT'),
    )

    index_name = os.environ.get('PINECONE_INDEX_NAME')

    k = 2

    docsearch = Pinecone.from_existing_index(index_name, embeddings)
    res = docsearch.similarity_search_with_score(question, k=k)

    prompt = f'''
    Use text below to compile an answer:
    {[x for x in res]}
    '''

    completion = openai.Completion.create(
        model="text-davinci-003",
        prompt=prompt,
        max_tokens = 1000
    )

    answer = completion.choices[0].text
    return {"answer": answer}


routes: list[ControllerRouterHandler] = [
    get_answer
]

app = Litestar([index, get_answer])

Though bare OpenAI script works fine: 尽管纯 OpenAI 脚本工作正常

python 复制代码
import os
import pinecone
from langchain.embeddings.openai import OpenAIEmbeddings
from langchain.vectorstores import Pinecone
from dotenv import load_dotenv
import openai
    
load_dotenv()

# Подготовим эмбеддинги
embeddings = OpenAIEmbeddings()

pinecone.init(
    api_key=os.getenv("PINECONE_API_KEY"),
    environment=os.environ.get('PINECONE_ENVIRONMENT'),
)

index_name = os.environ.get('PINECONE_INDEX_NAME')

query = input("Enter your question: ")
k = 2

docsearch = Pinecone.from_existing_index(index_name, embeddings)
res = docsearch.similarity_search_with_score(query, k=k)

prompt = f'''
Use text below to compile an answer:
{[x for x in res]}
'''


completion = openai.Completion.create(
  model="text-davinci-003",
  prompt=prompt,
  max_tokens = 1000
)

print(completion.choices[0].text)

pip freeze: pip freeze 命令得到的结果

python 复制代码
litestar==2.2.1
openai==0.27.8
pinecone-client==2.2.2

Litestar keeps showing 500 Internal Server Error without details. index() works fine. What can I do to resolve this issue?

Litestar 一直显示 500 内部服务器错误但没有详细信息。index() 函数工作正常。我该如何解决这个问题?

问题解决:

Here is a minimal example using Litestar that has the same problem you would face.

这是一个使用 Litestar 的最小示例,它会遇到与你相同的问题。

python 复制代码
from litestar import Litestar, get

@get()
async def get_answer() -> str:
    return {'hello': 'world'}

app = Litestar([get_answer])

Making a GET request to localhost:8000 returns

向 localhost:8000 发送 GET 请求返回...

python 复制代码
{"status_code":500,"detail":"Internal Server Error"}

If you turn on debug mode like so app = Litestar([get_answer], debug=True) the following error is shown when you make the same request.

如果你像这样开启调试模式 app = Litestar([get_answer], debug=True),当你发送相同的请求时,会显示以下错误。

python 复制代码
500: Unable to serialize response content

This is because you have mentioned the return type as str in async def get_answer(question: str) -> str: but in your actual code you are returning a dict. Litestar uses the return type of the function to serialize the data. Converting a str to dict fails.

这是因为你在 async def get_answer(question: str) -> str: 中将返回类型指定为 str,但在你的实际代码中你却返回了一个 dict。Litestar 使用函数的返回类型来序列化数据。将 str 转换为 dict 失败了。

In your example index works fine because the return type and the actual return value are the same str.

在你的例子中,index 函数工作正常,因为返回类型和实际返回值都是相同的 str(字符串)。

The fix is to use the correct return type for get_answer. dict[str, str] or even plain dict is enough.

修复方法是使用正确的返回类型给 get_answer。使用 dict[str, str] 或者简单的 dict 就足够了

python 复制代码
from litestar import Litestar, get

@get()
async def get_answer() -> dict[str, str]:
    return {'hello': 'world'}

app = Litestar([get_answer])

If you are on 3.8, you can use typing.Dict instead of dict.

如果你使用的是 Python 3.8 或更高版本,你可以使用 typing.Dict 而不是 dict 来明确指定字典的键和值的类型

python 复制代码
from typing import Dict
from litestar import Litestar, get

@get()
async def get_answer() -> Dict:
    return {'hello': 'world'}

app = Litestar([get_answer])

PS:

Though bare OpenAI script works fine: 尽管直接使用 OpenAI 的脚本也能正常工作

This is why I removed the OpenAI parts and only focused on the litestar ones. If you have an error in that you would still get a 500 error, you will have to fix that separately.

这就是为什么我去掉了 OpenAI 的部分,只专注于 litestar 的部分。如果你在那里有错误,你仍然会得到一个 500 错误,你需要单独修复它。

相关推荐
screenCui1 小时前
macOS运行python程序遇libiomp5.dylib库冲突错误解决方案
开发语言·python·macos
小眼睛羊羊1 小时前
pyinstaller打包paddleocr
python
java1234_小锋1 小时前
基于Python的旅游推荐协同过滤算法系统(去哪儿网数据分析及可视化(Django+echarts))
python·数据分析·旅游
蓝婷儿1 小时前
Python 机器学习核心入门与实战进阶 Day 4 - 支持向量机(SVM)原理与分类实战
python·机器学习·支持向量机
%d%d22 小时前
python 在运行时没有加载修改后的版本
java·服务器·python
amazinging3 小时前
北京-4年功能测试2年空窗-报培训班学测开-第四十七天
python·学习·selenium
Freak嵌入式3 小时前
一文速通 Python 并行计算:13 Python 异步编程-基本概念与事件循环和回调机制
开发语言·python·嵌入式·协程·硬件·异步编程
一个天蝎座 白勺 程序猿3 小时前
Python练习(1)Python基础类型操作语法实战:20道实战题解与案例分析(上)
开发语言·python·学习
巨人张3 小时前
信息素养Python编程题
开发语言·python
站大爷IP3 小时前
Python爬虫动态IP代理报错全解析:从问题定位到实战优化
python