Upstash Redis 支持的聊天记忆

因为 Upstash Redis 通过 REST API 工作，你可以将其与 Vercel Edge, Cloudflare Workers 和其他 Serverless 环境一起使用。基于 Redis 支持的聊天记忆。

为了在聊天会话之间实现更长期的持久性，你可以将默认的内存 chatHistory 替换为 Upstash Redis 实例，它支持像 BufferMemory 这样的聊天记忆类。

设置

你需要在你的项目中安装 @upstash/redis

提示

请参阅此章节，获取关于安装集成包的通用指南。

npm

npm install @langchain/openai @langchain/community @langchain/core @upstash/redis

Yarn

yarn add @langchain/openai @langchain/community @langchain/core @upstash/redis

pnpm

pnpm add @langchain/openai @langchain/community @langchain/core @upstash/redis

你还需要一个 Upstash 账户和一个 Redis 数据库来连接。请参阅 Upstash 文档，了解如何创建 HTTP 客户端的说明。

用法

存储在 Redis 中的每个聊天历史会话都必须有一个唯一的 ID。你可以提供一个可选的 sessionTTL 来设置会话在给定的秒数后过期。config 参数直接传递到 @upstash/redis 的 new Redis() 构造函数中，并接受所有相同的参数。

import { BufferMemory } from "langchain/memory";
import { UpstashRedisChatMessageHistory } from "@langchain/community/stores/message/upstash_redis";
import { ChatOpenAI } from "@langchain/openai";
import { ConversationChain } from "langchain/chains";

const memory = new BufferMemory({
  chatHistory: new UpstashRedisChatMessageHistory({
    sessionId: new Date().toISOString(), // Or some other unique identifier for the conversation
    sessionTTL: 300, // 5 minutes, omit this parameter to make sessions never expire
    config: {
      url: "https://ADD_YOURS_HERE.upstash.io", // Override with your own instance's URL
      token: "********", // Override with your own instance's token
    },
  }),
});

const model = new ChatOpenAI({
  model: "gpt-3.5-turbo",
  temperature: 0,
});

const chain = new ConversationChain({ llm: model, memory });

const res1 = await chain.invoke({ input: "Hi! I'm Jim." });
console.log({ res1 });
/*
{
  res1: {
    text: "Hello Jim! It's nice to meet you. My name is AI. How may I assist you today?"
  }
}
*/

const res2 = await chain.invoke({ input: "What did I just say my name was?" });
console.log({ res2 });

/*
{
  res1: {
    text: "You said your name was Jim."
  }
}
*/

API 参考

• BufferMemory 来自 langchain/memory
• UpstashRedisChatMessageHistory 来自 @langchain/community/stores/message/upstash_redis
• ChatOpenAI 来自 @langchain/openai
• ConversationChain 来自 langchain/chains

高级用法

你也可以直接传入一个之前创建的 @upstash/redis 客户端实例

import { Redis } from "@upstash/redis";
import { BufferMemory } from "langchain/memory";
import { UpstashRedisChatMessageHistory } from "@langchain/community/stores/message/upstash_redis";
import { ChatOpenAI } from "@langchain/openai";
import { ConversationChain } from "langchain/chains";

// Create your own Redis client
const client = new Redis({
  url: "https://ADD_YOURS_HERE.upstash.io",
  token: "********",
});

const memory = new BufferMemory({
  chatHistory: new UpstashRedisChatMessageHistory({
    sessionId: new Date().toISOString(),
    sessionTTL: 300,
    client, // You can reuse your existing Redis client
  }),
});

const model = new ChatOpenAI({
  model: "gpt-3.5-turbo",
  temperature: 0,
});

const chain = new ConversationChain({ llm: model, memory });

const res1 = await chain.invoke({ input: "Hi! I'm Jim." });
console.log({ res1 });
/*
{
  res1: {
    text: "Hello Jim! It's nice to meet you. My name is AI. How may I assist you today?"
  }
}
*/

const res2 = await chain.invoke({ input: "What did I just say my name was?" });
console.log({ res2 });

/*
{
  res1: {
    text: "You said your name was Jim."
  }
}
*/

API 参考

• BufferMemory 来自 langchain/memory
• UpstashRedisChatMessageHistory 来自 @langchain/community/stores/message/upstash_redis
• ChatOpenAI 来自 @langchain/openai
• ConversationChain 来自 langchain/chains