Arcjet Redact

Arcjet redact 集成允许您在将敏感用户信息发送到 LLM 之前从提示中编辑掉这些信息。

Arcjet Redact 完全在您自己的机器上运行，绝不会将数据发送到任何其他地方，从而确保一流的隐私和性能。

Arcjet Redact 对象本身不是 LLM，而是包装了一个 LLM。它编辑输入到其中的文本，然后在返回之前取消编辑包装的 LLM 的输出。

概述

集成详情

类	包	本地	可序列化	PY 支持	包下载	最新包
Arcjet	@langchain/community	❌	✅	❌

安装

安装 Arcjet Redaction 库

提示

请参阅此部分以获取有关安装集成包的通用说明。

npm

npm i @arcjet/redact

yarn

yarn add @arcjet/redact

pnpm

pnpm add @arcjet/redact

并安装 LangChain Community

提示

请参阅此部分以获取有关安装集成包的通用说明。

npm

npm i @langchain/community @langchain/core

yarn

yarn add @langchain/community @langchain/core

pnpm

pnpm add @langchain/community @langchain/core

现在您可以开始使用 Arcjet Redaction 保护您的 LLM 调用了！

用法

import {
  ArcjetRedact,
  ArcjetSensitiveInfoType,
} from "@langchain/community/llms/arcjet";
import { OpenAI } from "@langchain/openai";

// Create an instance of another LLM for Arcjet to wrap
const openai = new OpenAI({
  modelName: "gpt-3.5-turbo-instruct",
  openAIApiKey: process.env.OPENAI_API_KEY,
});

const arcjetRedactOptions = {
  // Specify a LLM that Arcjet Redact will call once it has redacted the input.
  llm: openai,

  // Specify the list of entities that should be redacted.
  // If this isn't specified then all entities will be redacted.
  entities: [
    "email",
    "phone-number",
    "ip-address",
    "credit-card",
  ] as ArcjetSensitiveInfoType[],

  // You can provide a custom detect function to detect entities that we don't support yet.
  // It takes a list of tokens and you return a list of identified types or undefined.
  // The undefined types that you return should be added to the entities list if used.
  detect: (tokens: string[]) => {
    return tokens.map((t) =>
      t === "some-sensitive-info" ? "custom-entity" : undefined
    );
  },

  // The number of tokens to provide to the custom detect function. This defaults to 1.
  // It can be used to provide additional context when detecting custom entity types.
  contextWindowSize: 1,

  // This allows you to provide custom replacements when redacting. Please ensure
  // that the replacements are unique so that unredaction works as expected.
  replace: (identifiedType: string) => {
    return identifiedType === "email" ? "redacted@example.com" : undefined;
  },
};

const arcjetRedact = new ArcjetRedact(arcjetRedactOptions);
const response = await arcjetRedact.invoke(
  "My email address is test@example.com, here is some-sensitive-info"
);

相关

• LLM 概念指南
• LLM 操作指南