--- license: mit language: - en license_link: https://github.com/FlagOpen/FlagEmbedding/blob/master/LICENSE base_model: - BAAI/bge-base-en-v1.5 --- # bge-base-en-v1.5-fp16-ov * Model creator: [BAAI](https://huggingface.co/BAAI) * Original model: [bge-base-en-v1.5](https://huggingface.co/BAAI/bge-base-en-v1.5) ## Description This is [bge-base-en-v1.5](https://huggingface.co/BAAI/bge-base-en-v1.5) model converted to the [OpenVINO™ IR](https://docs.openvino.ai/2025/documentation/openvino-ir-format.html) (Intermediate Representation) format with weights compressed to FP16. **Disclaimer**: Model is provided as a preview and may be update in the future. ## Compatibility The provided OpenVINO™ IR model is compatible with: * OpenVINO version 2025.1.0 and higher * Optimum Intel 1.24.0 and higher ## Running Model Inference with [Optimum Intel](https://huggingface.co/docs/optimum/intel/index) 1. Install packages required for using [Optimum Intel](https://huggingface.co/docs/optimum/intel/index) integration with the OpenVINO backend: ``` pip install "langchain-community>=0.2.15" optimum[openvino] huggingface_hub ``` 2. Run model inference: ``` from langchain_community.embeddings import OpenVINOBgeEmbeddings embedding_model_name = 'OpenVINO/bge-base-en-v1.5-fp16-ov' embedding_model_kwargs = {"device": "CPU", "compile": False} encode_kwargs = { "mean_pooling": False, "normalize_embeddings": True, "batch_size": 4, } embedding = OpenVINOBgeEmbeddings( model_name_or_path=embedding_model_name, model_kwargs=embedding_model_kwargs, encode_kwargs=encode_kwargs, ) embedding.ov_model.compile() text = "This is a test document." embedding_result = embedding.embed_query(text) embedding_result[:3] ``` For more examples and possible optimizations, refer to the [Inference with Optimum Intel](https://docs.openvino.ai/2025/openvino-workflow-generative/inference-with-optimum-intel.html). You can find more detailed usage examples in OpenVINO Notebooks: - [RAG text generation](https://openvinotoolkit.github.io/openvino_notebooks/?search=RAG+system) ## Limitations Check the original [model card](https://huggingface.co/BAAI/bge-base-en-v1.5) for limitations. ## Legal information The original model is distributed under [MIT](https://github.com/FlagOpen/FlagEmbedding/blob/master/LICENSE) license. More details can be found in [bge-base-en-v1.5](https://huggingface.co/BAAI/bge-base-en-v1.5). ## Disclaimer Intel is committed to respecting human rights and avoiding causing or contributing to adverse impacts on human rights. See [Intel’s Global Human Rights Principles](https://www.intel.com/content/dam/www/central-libraries/us/en/documents/policy-human-rights.pdf). Intel’s products and software are intended only to be used in applications that do not cause or contribute to adverse impacts on human rights.