HuggingFaceEmbedding

Defined in: packages/providers/huggingface/src/embedding.ts:37

Uses feature extraction from '@xenova/transformers' to generate embeddings. Per default the model XENOVA_ALL_MINILM_L6_V2 is used.

Can be changed by setting the modelType parameter in the constructor, e.g.:

new HuggingFaceEmbedding({
    modelType: HuggingFaceEmbeddingModelType.XENOVA_ALL_MPNET_BASE_V2,
});

Extends

• BaseEmbedding

HuggingFaceEmbedding<Options>(nodes, options?): Promise

Defined in: packages/providers/huggingface/src/embedding.ts:37

Uses feature extraction from '@xenova/transformers' to generate embeddings. Per default the model XENOVA_ALL_MINILM_L6_V2 is used.

Can be changed by setting the modelType parameter in the constructor, e.g.:

new HuggingFaceEmbedding({
    modelType: HuggingFaceEmbeddingModelType.XENOVA_ALL_MPNET_BASE_V2,
});

Type Parameters

Options

Options extends Record<string, unknown>

Parameters

nodes

BaseNode<Metadata>[]

options?

Options

Returns

Promise

Constructors

Constructor

new HuggingFaceEmbedding(params): HuggingFaceEmbedding

Defined in: packages/providers/huggingface/src/embedding.ts:43

Parameters

params

HuggingFaceEmbeddingParams = {}

Returns

HuggingFaceEmbedding

Overrides

BaseEmbedding.constructor

Properties

modelType

modelType: string = HuggingFaceEmbeddingModelType.XENOVA_ALL_MINILM_L6_V2

Defined in: packages/providers/huggingface/src/embedding.ts:38

modelOptions

modelOptions: undefined | PretrainedModelOptions = {}

Defined in: packages/providers/huggingface/src/embedding.ts:39

Methods

getExtractor()

getExtractor(): Promise<FeatureExtractionPipeline>

Defined in: packages/providers/huggingface/src/embedding.ts:53

Returns

Promise<FeatureExtractionPipeline>

getTextEmbedding()

getTextEmbedding(text): Promise<number[]>

Defined in: packages/providers/huggingface/src/embedding.ts:73

Parameters

text

string

Returns

Promise<number[]>

Overrides

BaseEmbedding.getTextEmbedding