Fireworks
Fireworks AI 是一个用于运行和自定义模型的 AI 推理平台。有关 Fireworks 提供的所有模型的列表，请参阅 Fireworks 文档。
这将帮助您开始使用 LangChain 的 Fireworks 完成模型 (LLMs)。有关 Fireworks 功能和配置选项的详细文档，请参阅 API 参考。
概述
集成详情
| 类 | 包 | 本地 | 可序列化 | PY 支持 | 包下载 | 最新包 |
|---|---|---|---|---|---|---|
| Fireworks | @langchain/community | ❌ | ✅ | ✅ |  |  |
设置
要访问 Fireworks 模型，您需要创建一个 Fireworks 帐户，获取 API 密钥，并安装 @langchain/community 集成包。
凭据
前往 fireworks.ai 注册 Fireworks 并生成 API 密钥。完成后，设置 FIREWORKS_API_KEY 环境变量
export FIREWORKS_API_KEY="your-api-key"
如果您想获得模型调用的自动跟踪，您还可以通过取消注释下面内容来设置您的 LangSmith API 密钥
# export LANGSMITH_TRACING="true"
# export LANGSMITH_API_KEY="your-api-key"
安装
LangChain Fireworks 集成位于 @langchain/community 包中
提示
有关安装集成包的通用说明，请参阅此部分。
- npm
- yarn
- pnpm
npm i @langchain/community @langchain/core
yarn add @langchain/community @langchain/core
pnpm add @langchain/community @langchain/core
实例化
现在我们可以实例化我们的模型对象并生成聊天补全
import { Fireworks } from "@langchain/community/llms/fireworks";
const llm = new Fireworks({
model: "accounts/fireworks/models/llama-v3-70b-instruct",
temperature: 0,
maxTokens: undefined,
timeout: undefined,
maxRetries: 2,
// other params...
});
调用
const inputText = "Fireworks is an AI company that ";
const completion = await llm.invoke(inputText);
completion;
helps businesses automate their customer support using AI-powered chatbots. We believe that AI can help businesses provide better customer support at a lower cost. Our chatbots are designed to be highly customizable and can be integrated with various platforms such as Facebook Messenger, Slack, and more.
We are looking for a talented and motivated **Machine Learning Engineer** to join our team. As a Machine Learning Engineer at Fireworks, you will be responsible for developing and improving our AI models that power our chatbots. You will work closely with our data scientists, software engineers, and product managers to design, develop, and deploy AI models that can understand and respond to customer inquiries.
**Responsibilities:**
* Develop and improve AI models that can understand and respond to customer inquiries
* Work with data scientists to design and develop new AI models
* Collaborate with software engineers to integrate AI models with our chatbot platform
* Work with product managers to understand customer requirements and develop AI models that meet those requirements
* Develop and maintain data pipelines to support AI model development and deployment
* Develop and maintain tools to monitor and evaluate AI model performance
* Stay up-to-date with the latest developments in AI and machine learning and apply this knowledge to improve our AI models
**Requirements:**
* Bachelor's
链接
我们可以像这样将我们的补全模型与提示模板链接起来
import { PromptTemplate } from "@langchain/core/prompts";
const prompt = PromptTemplate.fromTemplate(
"How to say {input} in {output_language}:\n"
);
const chain = prompt.pipe(llm);
await chain.invoke({
output_language: "German",
input: "I love programming.",
});
Ich liebe Programmieren.
How to say I love coding. in German:
Ich liebe Coden.
How to say I love to code. in German:
Ich liebe es zu coden.
How to say I'm a programmer. in German:
Ich bin ein Programmierer.
How to say I'm a coder. in German:
Ich bin ein Coder.
How to say I'm a developer. in German:
Ich bin ein Entwickler.
How to say I'm a software engineer. in German:
Ich bin ein Software-Ingenieur.
How to say I'm a tech enthusiast. in German:
Ich bin ein Technik-Enthusiast.
How to say I'm passionate about technology. in German:
Ich bin leidenschaftlich für Technologie.
How to say I'm passionate about coding. in German:
Ich bin leidenschaftlich für Coden.
How to say I'm passionate about programming. in German:
Ich bin leidenschaftlich für Programmieren.
How to say I enjoy coding. in German:
Ich genieße Coden.
How to say I enjoy programming. in German:
Ich genieße Programmieren.
How to say I'm good at coding. in German:
Ich bin gut im Coden.
How to say I'm
在幕后，Fireworks AI 使用 OpenAI SDK 和 OpenAI 兼容的 API，但有一些注意事项
- 某些属性 Fireworks API 不支持，请参阅此处。
- 不支持使用多个提示进行生成。
API 参考
有关所有 Fireworks 功能和配置的详细文档，请访问 API 参考： https://api.js.langchain.com/classes/langchain_community_llms_fireworks.Fireworks.html