local-llm-function-calling

by rizerphe · Agent Tool · ★ 437

About local-llm-function-calling

Local LLM function calling Overview The project is designed to constrain the generation of Hugging Face text generation models by enforcing a JSON schema and facilitating the formulation of prompts for function calls, similar to OpenAI's function calling feature, but actually enforcing the schema unlike OpenAI. The project provides a class that allows users to easily generate text while ensuring compliance with the provided prompt and JSON schema. By utilizing the library, users can conveniently control the output of text generation models.

chatgpt-functionshuggingface-transformersjson-schemallmllm-inferenceopenai-function-callopenai-functions

Quick Facts

Stars437
Forks41
LanguagePython
CategoryAgent Tool
LicenseMIT
Quality Score75.1401802041233/100
Open Issues6
Last Updated2024-03-12
Created2023-06-27
Platformspython
Est. Tokens~11k

Compatible Skills

These tools work well together with local-llm-function-calling for enhanced workflows:

  • vllm-cli — semantic(0.16)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)
  • ToolRegistry — semantic(0.19)+complementary+same_lang+similar_pop+shared_platform (52%)
  • SimpleLLMFunc — semantic(0.16)+complementary+same_lang+similar_pop+shared_platform (51%)
  • snippy — semantic(0.16)+complementary+same_lang+similar_pop+shared_platform (51%)
  • mirascope — semantic(0.16)+complementary+same_lang+similar_pop+shared_platform (50%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is local-llm-function-calling?

local-llm-function-calling is A tool for generating function arguments and choosing what function to call with local LLMs. It is categorized as a Agent Tool with 437 GitHub stars.

What programming language is local-llm-function-calling written in?

local-llm-function-calling is primarily written in Python. It covers topics such as chatgpt-functions, huggingface-transformers, json-schema.

How do I install or use local-llm-function-calling?

You can find installation instructions and usage details in the local-llm-function-calling GitHub repository at github.com/rizerphe/local-llm-function-calling. The project has 437 stars and 41 forks, indicating an active community.

What license does local-llm-function-calling use?

local-llm-function-calling is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools