操作流程1、下载安装2、配置3、测试下载安装PGVector:向量数据库扩展pipinstallpyarrow24.0.0 pipinstallpyarrow[all]24.0.0sudoaptupdatesudoaptinstall-y-Vca-certificates lsb-releasewgetwgethttps://apache.jfrog.io/artifactory/arrow/$(lsb_release--id--short|trA-Za-z)/apache-arrow-apt-source-latest-$(lsb_release--codename--short).debsudoaptinstall-y-V./apache-arrow-apt-source-latest-$(lsb_release--codename--short).debsudoaptupdatesudoaptinstall-y-Vlibarrow-dev# 升级gccsudoapt-get-yinstallgcc-15 g-15 gcc-15sudoupdate-alternatives--install/usr/bin/gcc gcc /usr/bin/gcc-15# 选择15的那项sudoupdate-alternatives--configgcc update-alternatives--install/usr/bin/gcc gcc /usr/bin/gcc-15150update-alternatives--setgcc /usr/bin/gcc-15ls-la/usr/bin/gccgcc--version|head-1;update-alternatives--displaygcc2/dev/null|head-8;ls-la/etc/alternatives/gcc;ls/usr/bin/gcc-* /usr/bin/gcc2/dev/nullcd/usr/local/softwaregitclone https://github.com/heterodb/pg-strom.gitcd/usr/local/software/pg-strom/srcmake-j$(nproc)PG_CONFIG/usr/local/software/postgresql/data/pgsql/bin/pg_configmakeinstall-j$(nproc)PG_CONFIG/usr/local/software/postgresql/data/pgsql/bin/pg_configchmod0777-R/usr/local/software/pg-stromchown$USER:$USER-R/usr/local/software/pg-strom配置修改数据库配置# shared_preload_libraries vector,pg_stromgedit /usr/local/software/postgresql/data/pgdata/postgresql.conf# 重启数据库sudo-upostgres /usr/local/software/postgresql/data/pgsql/bin/pg_ctl restart-D/usr/local/software/postgresql/data/pgdata-l/usr/local/software/postgresql/data/pglog/logfile连接数据库# 用户anythingllm 连接数据库 密码QwE123*~*psql-h127.0.0.1-Uanythingllm-p5432-dvector_db-W数据库操作-- 安装扩展vectorCREATEEXTENSIONIFNOTEXISTSpg_strom;-- 表级设置持久生效2 是测试起点altertableanythingllm_vectorsset(parallel_workers8);-- 更新统计信息ANALYZEanythingllm_vectors;BEGIN;setpg_strom.enabledon;SETpg_strom.enable_gpuscanon;SETpg_strom.enable_gpujoinon;SETpg_strom.enable_gpupreaggon;SETpg_strom.gpudirect_enabledoff;setmax_parallel_workers_per_gather2;COMMIT;配置环境变量cat/etc/profileEOF #set pg_strom environment PGSTROM/usr/local/software/pg_strom PATH$PGSTROM:$PGSTROM/src:$PATH: export PGSTROM PATH EOFsource/etc/profile测试数据库操作-- 查看效果EXPLAIN(ANALYZE,timing,BUFFERS,costs,VERBOSE)SELECTcount(*)FROManythingllm_vectors;
01.02.03.PostgreSQL：环境搭建篇（插件 PG-Storm GPU加速插件）
操作流程1、下载安装2、配置3、测试下载安装PGVector:向量数据库扩展pipinstallpyarrow24.0.0 pipinstallpyarrow[all]24.0.0sudoaptupdatesudoaptinstall-y-Vca-certificates lsb-releasewgetwgethttps://apache.jfrog.io/artifactory/arrow/$(lsb_release--id--short|trA-Za-z)/apache-arrow-apt-source-latest-$(lsb_release--codename--short).debsudoaptinstall-y-V./apache-arrow-apt-source-latest-$(lsb_release--codename--short).debsudoaptupdatesudoaptinstall-y-Vlibarrow-dev# 升级gccsudoapt-get-yinstallgcc-15 g-15 gcc-15sudoupdate-alternatives--install/usr/bin/gcc gcc /usr/bin/gcc-15# 选择15的那项sudoupdate-alternatives--configgcc update-alternatives--install/usr/bin/gcc gcc /usr/bin/gcc-15150update-alternatives--setgcc /usr/bin/gcc-15ls-la/usr/bin/gccgcc--version|head-1;update-alternatives--displaygcc2/dev/null|head-8;ls-la/etc/alternatives/gcc;ls/usr/bin/gcc-* /usr/bin/gcc2/dev/nullcd/usr/local/softwaregitclone https://github.com/heterodb/pg-strom.gitcd/usr/local/software/pg-strom/srcmake-j$(nproc)PG_CONFIG/usr/local/software/postgresql/data/pgsql/bin/pg_configmakeinstall-j$(nproc)PG_CONFIG/usr/local/software/postgresql/data/pgsql/bin/pg_configchmod0777-R/usr/local/software/pg-stromchown$USER:$USER-R/usr/local/software/pg-strom配置修改数据库配置# shared_preload_libraries vector,pg_stromgedit /usr/local/software/postgresql/data/pgdata/postgresql.conf# 重启数据库sudo-upostgres /usr/local/software/postgresql/data/pgsql/bin/pg_ctl restart-D/usr/local/software/postgresql/data/pgdata-l/usr/local/software/postgresql/data/pglog/logfile连接数据库# 用户anythingllm 连接数据库 密码QwE123*~*psql-h127.0.0.1-Uanythingllm-p5432-dvector_db-W数据库操作-- 安装扩展vectorCREATEEXTENSIONIFNOTEXISTSpg_strom;-- 表级设置持久生效2 是测试起点altertableanythingllm_vectorsset(parallel_workers8);-- 更新统计信息ANALYZEanythingllm_vectors;BEGIN;setpg_strom.enabledon;SETpg_strom.enable_gpuscanon;SETpg_strom.enable_gpujoinon;SETpg_strom.enable_gpupreaggon;SETpg_strom.gpudirect_enabledoff;setmax_parallel_workers_per_gather2;COMMIT;配置环境变量cat/etc/profileEOF #set pg_strom environment PGSTROM/usr/local/software/pg_strom PATH$PGSTROM:$PGSTROM/src:$PATH: export PGSTROM PATH EOFsource/etc/profile测试数据库操作-- 查看效果EXPLAIN(ANALYZE,timing,BUFFERS,costs,VERBOSE)SELECTcount(*)FROManythingllm_vectors;
