快捷導(dǎo)航

Python使用Flask結(jié)合DeepSeek開發(fā)(實(shí)現(xiàn)代碼)

更新時(shí)間：2025年02月15日 13:45:57 作者：程序員Rocky

文章介紹了如何使用ollama部署DeepSeek大模型,并通過(guò)Python Flask和SSE技術(shù)實(shí)現(xiàn)一個(gè)簡(jiǎn)單的對(duì)話應(yīng)用,代碼實(shí)現(xiàn)了模型的調(diào)用和結(jié)果展示,并討論了SSE不支持POST請(qǐng)求的問(wèn)題及解決方案,感興趣的朋友一起看看吧

一、背景

我之前關(guān)于DeepSeek使用ollama部署的文章大家可以把DeepSeek大模型部署起來(lái)。那么ollama還提供了可以調(diào)用對(duì)應(yīng)部署模型的API接口。我們可以基于這些接口，做自己的二次開發(fā)。使用python+flask+ollama就可以進(jìn)行模型對(duì)話調(diào)用。并且前端采用SSE的技術(shù)，后端向前端推送推理結(jié)果進(jìn)行展示，可以實(shí)現(xiàn)屬于自己的大模型對(duì)話產(chǎn)品。

二、代碼實(shí)現(xiàn)

1、ollama運(yùn)行deepseek-r1:1.5b模型

docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
docker exec -it ollama ollama run deepseek-r1:1.5b

2、python+flask代碼

import json
from flask import Flask, request, Response
from ollama import Client
app = Flask(__name__)
# ollama客戶端
ollma_url = "http://localhost:11434"   # localhost可以換成你部署ollama主機(jī)的ip、遠(yuǎn)程ip
ollama_client = Client(host=ollma_url )
# 模型名稱
model_name = "deepseek-r1:1.5b"
@app.route('/stream', methods=['POST', 'GET'])
def post_example():
    def generate():
        try:
            # 調(diào)用ollama客戶端，傳入模型名稱、提問(wèn)信息
            response_generator = ollama_client.generate(model_name, prompt=question, stream=True)
            for part in response_generator:
                response_text = part.response
                # 按照 SSE 規(guī)范格式化數(shù)據(jù)
                data = f"data: {json.dumps({'response': response_text})}\n\n"
                print(data)
                yield data
        except Exception as e:
            error_data = f"data: {json.dumps({'error': str(e)})}\n\n"
            yield error_data
    # 接收問(wèn)題, 調(diào)用模型, 使用SSE推送推理結(jié)果給前端
    question = request.args.get('question')
    resp = Response(generate(), mimetype='text/event-stream')
    # 設(shè)置響應(yīng)頭
    resp.headers['Cache-Control'] = 'no-cache'
    resp.headers['Connection'] = 'keep-alive'
    resp.headers['Access-Control-Allow-Origin'] = '*'
    return resp
if __name__ == '__main__':
    app.run(debug=True, port=8080)

3、前端代碼

<!DOCTYPE html>
<html lang="en">
<head>
    <meta charset="UTF-8">
    <meta name="viewport" content="width=device-width, initial-scale=1.0">
    <title>Ask Ollama via SSE</title>
</head>
<body>
    <input type="text" id="questionInput" placeholder="請(qǐng)輸入你的問(wèn)題">
    <button id="askButton">提問(wèn)</button>
    <pre id="answerContainer"></p>
    <script>
        const questionInput = document.getElementById('questionInput');
        const askButton = document.getElementById('askButton');
        const answerContainer = document.getElementById('answerContainer');
        askButton.addEventListener('click', async () => {
            const question = questionInput.value;
            if (!question) {
                alert('請(qǐng)輸入問(wèn)題');
                return;
            }
            const eventSource = new EventSource(`http://localhost:8080/stream?question=${encodeURIComponent(question)}`);
            eventSource.onmessage = function (event) {
                const data = JSON.parse(event.data);
                const response = data.response;
                if (response) {
                    const p = document.createElement('span');
                    p.textContent = response;
                    answerContainer.appendChild(p);
                }
            };
            eventSource.onerror = function (error) {
                console.error('EventSource failed:', error);
                eventSource.close();
            };
        });
    </script>
</body>
</html>