深度学习 Geek

【深度学习】基于 LLM 构建中文场景检索式对话：Llama2+NeMo

Posted by ShawnD on November 12, 2023

安装 NeMo (mac)

Note: 需要 python 3.10 以上，否则部分代码会报错

1
2
3
4
5
6
7
8
9
10
11
12
13
14

# [optional] install mecab using Homebrew, to use sacrebleu for NLP collection
# you can install Homebrew here: https://brew.sh
brew install mecab

# [optional] install pynini using Conda, to use text normalization
conda install -c conda-forge pynini

# install Cython manually
pip install cython

# clone the repo and install in development mode
git clone https://github.com/NVIDIA/NeMo
cd NeMo
./reinstall.sh

1

 pip install opencc-python-reimplemented==0.1.4

安装 Llama index

1

pip install llama-index

1

pip install accelerate

1

pip install -i https://test.pypi.org/simple/ bitsandbytes

1

pip install pypdf

Reference

  1. https://github.com/NVIDIA/NeMo
  2. OSError: dlopen(libopencc.so.1, 6): image not found
  3. ImportError: Using low_cpu_mem_usage=True or a device_map requires Accelerate: pip install accelerate
  4. 使用HuggingFace的Accelerate库加载和运行超大模型
CATALOG
    FEATURED TAGS
    mark 深度学习 机器学习 HSI Detection d2l Geek GAN 课业笔记 Diffusion CVPR 2023 Research & Writing low-level CV CVPR 2022 ICCV 2023 Scene Graph CV ECCV 2022 NLP MMML Backbone Arxiv 2022 NIPS 2022 CVPR 2020 NIPS 2021 Segmentation GNN & GCN 计算方法 CVPR 2018 CVPR 2021 ECCV 2020 ICCV 2019 强化学习 FastAI arXiv 2023 凸优化 操作系统 数据结构 矩阵论 离散数学 计算机网络 Arxiv 2021 CVPR 2019 ICCV 2021 OpenCV VAE Arxiv 2020 Arxiv 2023 CVPR 2017 ICCV 2017 ICLR 2021 Life TPAMI 2023 学会理财 嵌入式 生活 算法 计算智能 CVPR 2016 CVPRW 2022 CVPRW 2023 Docker ICLR 2022 MMLab Python Research & Competition TGRS 2023 TIP 2013 TIP 2021 TMM 2023 TPAMI 2017 TPAMI 2019 TPAMI 2022 WACV 2024
    FRIENDS