Leebra python
login register

Python Bindings for llama.cpp

2 years ago by (des)mosthenes to c/python

save

share

report

Python bindings for llama.cpp. Contribute to abetlen/llama-cpp-python development by creating an account on GitHub.

Simple Python bindings for @ggerganov's llama.cpp library. This package provides:

Low-level access to C API via ctypes interface.
High-level Python API for text completion
    OpenAI-like API
    LangChain compatibility
    LlamaIndex compatibility
OpenAI compatible web server
    Local Copilot replacement
    Function Calling support
    Vision API support
    Multiple Models

Documentation is available at https://llama-cpp-python.readthedocs.io/en/latest.

danielquinn 1 point 2 years ago

I always appreciate it when people build friendly Python wrappers around C code, but I suggest that if you're going to share an example in the documentation, the answer the LLM gives should at least be correct:

Q: Name the planets in the solar system? A: Mercury, Venus, Earth, Mars, Jupiter, Saturn, Uranus, Neptune and Pluto.

save

path: 0 14335253, hotness: undefined, score: 1, children: 0
python
python

@sh.itjust.works

login for more options
2303
28
1

A community for talking about the Python programming language.

go to feed...