向量数据库Milvus在Linux环境下的在线+离线安装
- 1.千问简介
- 2.在线安装
- 2.离线安装
1.千问简介
Milvus 是一款专为处理高维向量数据设计的开源云原生数据库，旨在满足海量向量数据的实时召回需求。它由 Zilliz 公司开发并维护，基于Apache许可证2.0版本发布。Milvus的核心能力在于其高可用性、高性能及易拓展性，特别优化了对由深度神经网络和其他机器学习模型生成的嵌入（embedding）向量的管理、搜索和操作。
该数据库底层集成了诸如 FAISS、Annoy、HNSW 等高效的向量搜索库，用以解决稠密向量的相似度检索问题。通过支持数据分片、数据持久化、增量数据摄取、标量与向量混合查询以及时间旅行查询（time travel）等功能，Milvus能够应对复杂多变的向量检索场景，并且显著提升向量检索性能。
Milvus广泛应用于需要高效处理非结构化数据检索的领域，如推荐系统、图像检索、语音识别、自然语言处理、语义搜索等人工智能应用场景。为了实现最佳的可用性和弹性，通常建议通过Kubernetes来部署Milvus。其采用的共享存储架构将存储与计算分离，进一步增强了系统的灵活性和扩展性。
- 安装文档：https://milvus.io/docs/v2.1.x/install_standalone-aptyum.md
- 下载地址：https://github.com/milvus-io/milvus/releases
2.在线安装
[root@tcloud milvus]# yum install ./milvus-2.1.4-1.el7.x86_64.rpm
安装日志：
Loaded plugins: fastestmirror, langpacks
Examining ./milvus-2.1.4-1.el7.x86_64.rpm: milvus-2.1.4-1.el7.x86_64
Marking ./milvus-2.1.4-1.el7.x86_64.rpm to be installed
Resolving Dependencies
--> Running transaction check
---> Package milvus.x86_64 0:2.1.4-1.el7 will be installed
--> Processing Dependency: libquadmath.so.0(QUADMATH_1.0)(64bit) for package: milvus-2.1.4-1.el7.x86_64
Loading mirror speeds from cached hostfile
epel | 4.7 kB 00:00:00
extras | 2.9 kB 00:00:00
os | 3.6 kB 00:00:00
updates | 2.9 kB 00:00:00
--> Processing Dependency: tbb-devel for package: milvus-2.1.4-1.el7.x86_64
--> Processing Dependency: libquadmath.so.0()(64bit) for package: milvus-2.1.4-1.el7.x86_64
--> Running transaction check
---> Package libquadmath.x86_64 0:4.8.5-44.el7 will be installed
---> Package tbb-devel.x86_64 0:4.1-9.20130314.el7 will be installed
--> Processing Dependency: tbb(x86-64) = 4.1-9.20130314.el7 for package: tbb-devel-4.1-9.20130314.el7.x86_64
--> Processing Dependency: libtbbmalloc_proxy.so.2()(64bit) for package: tbb-devel-4.1-9.20130314.el7.x86_64
--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: tbb-devel-4.1-9.20130314.el7.x86_64
--> Processing Dependency: libtbb.so.2()(64bit) for package: tbb-devel-4.1-9.20130314.el7.x86_64
--> Running transaction check
---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed
--> Finished Dependency ResolutionDependencies Resolved================================================================================================================================================================Package Arch Version Repository Size
================================================================================================================================================================
Installing:milvus x86_64 2.1.4-1.el7 /milvus-2.1.4-1.el7.x86_64 388 M
Installing for dependencies:libquadmath x86_64 4.8.5-44.el7 os 190 ktbb x86_64 4.1-9.20130314.el7 os 124 ktbb-devel x86_64 4.1-9.20130314.el7 os 218 kTransaction Summary
================================================================================================================================================================
Install 1 Package (+3 Dependent packages)Total size: 389 M
Total download size: 532 k
Installed size: 390 M
Is this ok [y/d/N]: y
Downloading packages:
(1/3): libquadmath-4.8.5-44.el7.x86_64.rpm | 190 kB 00:00:00
(2/3): tbb-4.1-9.20130314.el7.x86_64.rpm | 124 kB 00:00:00
(3/3): tbb-devel-4.1-9.20130314.el7.x86_64.rpm | 218 kB 00:00:00
----------------------------------------------------------------------------------------------------------------------------------------------------------------
Total 1.2 MB/s | 532 kB 00:00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transactionInstalling : tbb-4.1-9.20130314.el7.x86_64 1/4Installing : tbb-devel-4.1-9.20130314.el7.x86_64 2/4Installing : libquadmath-4.8.5-44.el7.x86_64 3/4Installing : milvus-2.1.4-1.el7.x86_64 4/4Verifying : milvus-2.1.4-1.el7.x86_64 1/4Verifying : tbb-devel-4.1-9.20130314.el7.x86_64 2/4Verifying : libquadmath-4.8.5-44.el7.x86_64 3/4Verifying : tbb-4.1-9.20130314.el7.x86_64 4/4Installed:milvus.x86_64 0:2.1.4-1.el7Dependency Installed:libquadmath.x86_64 0:4.8.5-44.el7 tbb.x86_64 0:4.1-9.20130314.el7 tbb-devel.x86_64 0:4.1-9.20130314.el7Complete!
安装了3个依赖，让yum缓存下来，离线安装时可以使用，yum开启缓存及查找缓存文件地址：
[main]
cachedir=/var/cache/yum/$basearch/$releasever
keepcache=1
安装成功后查看状态：
systemctl start milvus-etcd
systemctl start milvus-minio
systemctl start milvus
查看服务状态：
# systemctl status milvus-etcd
● milvus-etcd.service - Etcd of Milvus Standalone ServerLoaded: loaded (/etc/systemd/system/milvus-etcd.service; disabled; vendor preset: disabled)Active: active (running) since Thu 2024-06-13 09:09:54 CST; 19s agoMain PID: 18846 (milvus-etcd)CGroup: /system.slice/milvus-etcd.service└─18846 /usr/bin/milvus-etcd --data-dir /var/lib/milvus/etcd-data# systemctl status milvus-minio
● milvus-minio.service - MinIO of Milvus Standalone ServerLoaded: loaded (/etc/systemd/system/milvus-minio.service; disabled; vendor preset: disabled)Active: active (running) since Thu 2024-06-13 09:10:05 CST; 1min 3s agoMain PID: 18961 (milvus-minio)CGroup: /system.slice/milvus-minio.service└─18961 /usr/bin/milvus-minio server /var/lib/milvus/minio-data# systemctl status milvus
● milvus.service - Milvus Standalone ServerLoaded: loaded (/etc/systemd/system/milvus.service; disabled; vendor preset: disabled)Active: active (running) since Thu 2024-06-13 09:10:12 CST; 1s agoMain PID: 19058 (milvus-server)CGroup: /system.slice/milvus.service└─19058 /usr/bin/milvus-server run standalone
# milvus安装的文件
[root@tcloud ~]# rpm -ql milvus
/etc/ld.so.conf.d/milvus.conf
/etc/milvus/configs/advanced/etcd.yaml
/etc/milvus/configs/milvus.yaml
/etc/systemd/system/milvus-etcd.service
/etc/systemd/system/milvus-minio.service
/etc/systemd/system/milvus.service
/lib64/milvus/libgfortran.so.4
/lib64/milvus/libknowhere.so
/lib64/milvus/libmarisa.a
/lib64/milvus/libmarisa.la
/lib64/milvus/libmarisa.so
/lib64/milvus/libmarisa.so.0
/lib64/milvus/libmilvus_common.so
/lib64/milvus/libmilvus_index.so
/lib64/milvus/libmilvus_indexbuilder.so
/lib64/milvus/libmilvus_segcore.so
/lib64/milvus/libopenblas.so.0
/usr/bin/milvus
/usr/bin/milvus-etcd
/usr/bin/milvus-minio
/usr/bin/milvus-server
缓存的依赖包：
2.离线安装
离线安装要使用在线安装缓存的依赖文件：
# 安装
rpm -ivh libquadmath-4.8.5-44.el7.x86_64.rpm
rpm -ivh tbb-4.1-9.20130314.el7.x86_64.rpm
rpm -ivh tbb-devel-4.1-9.20130314.el7.x86_64.rpm
rpm -ivh milvus-2.1.4-1.el7.x86_64.rpm
# 启动
systemctl start milvus-etcd
systemctl start milvus-minio
systemctl start milvus
