Skip to content

Conda packages for llm work

Here is a list of Conda packages related to large language models, including a brief description of each and the installation commands.

Conda Packages for Large Language Models

Llm

  • A CLI utility and Python library for interacting with large language models, including OpenAI, PaLM, and local models.
conda install conda-forge::llm

MLC LLM

  • A package for building and deploying large language models with support for various hardware backends.
conda activate your-environment
python -m pip install --pre -U -f https://mlc.ai/wheels mlc-llm-nightly-cu122 mlc-ai-nightly-cu122

Llama Index LLMs OpenAI

  • A package that integrates Llama Index with OpenAI's large language models, designed for data scientists.
conda install conda-forge::llama-index-llms-openai

These packages provide essential tools for working with large language models in Python environments managed by Conda.

The above text was generated by a large language model (LLM) and its accuracy has not been validated. This page is part of 'LLMs-on-LLMs,' a Github repository by Daniel Rosehill which explores how curious humans can use LLMs to better their understanding of LLMs and AI. However, the information should not be regarded as authoritative and given the fast pace of evolution in LLM technology will eventually become deprecated. This footer was added at 16-Nov-2024.