如何加载 CSV 数据

逗号分隔值 (CSV) 文件是一种分隔文本文件，它使用逗号分隔值。文件的每一行都是一个数据记录。每个记录由一个或多个字段组成，字段之间用逗号分隔。

加载每个文档单行的 CSV 数据。

设置

npm

npm install d3-dsv@2

Yarn

yarn add d3-dsv@2

pnpm

pnpm add d3-dsv@2

用法，提取所有列

示例 CSV 文件

id,text
1,This is a sentence.
2,This is another sentence.

示例代码

import { CSVLoader } from "@langchain/community/document_loaders/fs/csv";

const loader = new CSVLoader("src/document_loaders/example_data/example.csv");

const docs = await loader.load();
/*
[
  Document {
    "metadata": {
      "line": 1,
      "source": "src/document_loaders/example_data/example.csv",
    },
    "pageContent": "id: 1
text: This is a sentence.",
  },
  Document {
    "metadata": {
      "line": 2,
      "source": "src/document_loaders/example_data/example.csv",
    },
    "pageContent": "id: 2
text: This is another sentence.",
  },
]
*/

用法，提取单列

示例 CSV 文件

id,text
1,This is a sentence.
2,This is another sentence.

示例代码

import { CSVLoader } from "@langchain/community/document_loaders/fs/csv";

const loader = new CSVLoader(
  "src/document_loaders/example_data/example.csv",
  "text"
);

const docs = await loader.load();
/*
[
  Document {
    "metadata": {
      "line": 1,
      "source": "src/document_loaders/example_data/example.csv",
    },
    "pageContent": "This is a sentence.",
  },
  Document {
    "metadata": {
      "line": 2,
      "source": "src/document_loaders/example_data/example.csv",
    },
    "pageContent": "This is another sentence.",
  },
]
*/