# Quaynor

> Local, offline LLM inference with streaming, tool calling, and embeddings.
> Python, Flutter, React Native, and Swift bindings over Llama.cpp.

## Docs

- [Home](https://www.quaynor.site/index.html.md): Project overview and local LLM inference APIs.
- [LLM Basics](https://www.quaynor.site/llm-basics/index.html.md): Core LLM concepts needed to use Quaynor effectively.
- [Model Selection](https://www.quaynor.site/model-selection/index.html.md): Choose and run GGUF models with the library.

## Rust

- [Getting started with Rust](https://www.quaynor.site/rust/index.html.md): Getting started with Rust - Quaynor documentation.

## Python

- [Getting started with Python](https://www.quaynor.site/python/index.html.md): Install and configure the Python bindings.
- [Chat](https://www.quaynor.site/python/chat/index.html.md): Synchronous and chat session APIs in Python.
- [Tool Calling](https://www.quaynor.site/python/tool-calling/index.html.md): Grammar-based tool calling from Python.
- [Vision & Hearing](https://www.quaynor.site/python/vision/index.html.md): Vision and audio modalities in Python.
- [Sampling](https://www.quaynor.site/python/sampling/index.html.md): Temperature, top-p, and sampler settings.
- [Streaming & Async API](https://www.quaynor.site/python/streaming-and-async-api/index.html.md): Streaming tokens and async chat.
- [Embeddings & RAG](https://www.quaynor.site/python/embeddings-and-rag/index.html.md): Embeddings and retrieval workflows.
- [Logging](https://www.quaynor.site/python/logging-and-troubleshooting/index.html.md): Logging and debugging.

## React Native

- [Getting started with React Native](https://www.quaynor.site/react-native/index.html.md): Install and use the React Native package.
- [Chat](https://www.quaynor.site/react-native/chat/index.html.md): Chat APIs on React Native.
- [Tool Calling](https://www.quaynor.site/react-native/tool-calling/index.html.md): Tool calling from React Native.
- [Vision](https://www.quaynor.site/react-native/vision/index.html.md): Vision inputs on React Native.
- [Sampling](https://www.quaynor.site/react-native/sampling/index.html.md): Sampling configuration.
- [Embeddings & RAG](https://www.quaynor.site/react-native/embeddings-and-rag/index.html.md): Embeddings and RAG.

## Flutter

- [Getting started with Flutter](https://www.quaynor.site/flutter/index.html.md): Flutter app integration and FFI setup.
- [Chat](https://www.quaynor.site/flutter/chat/index.html.md): Chat API from Flutter.
- [Tool Calling](https://www.quaynor.site/flutter/tool-calling/index.html.md): Tool calling in Flutter.
- [Vision & Hearing](https://www.quaynor.site/flutter/vision/index.html.md): Vision and audio in Flutter.
- [Sampling](https://www.quaynor.site/flutter/sampling/index.html.md): Sampler options.
- [Embeddings & RAG](https://www.quaynor.site/flutter/embeddings-and-rag/index.html.md): Embeddings and RAG in Flutter.

## Swift

- [Getting started with Swift](https://www.quaynor.site/swift/index.html.md): Install and configure the Swift package.
- [Chat](https://www.quaynor.site/swift/chat/index.html.md): Chat sessions and token streaming in Swift.
- [Tool Calling](https://www.quaynor.site/swift/tool-calling/index.html.md): Tool calling from Swift.
- [Vision & Hearing](https://www.quaynor.site/swift/vision/index.html.md): Vision and audio prompts in Swift.
- [Sampling](https://www.quaynor.site/swift/sampling/index.html.md): Sampler presets and configuration in Swift.
- [Embeddings & RAG](https://www.quaynor.site/swift/embeddings-and-rag/index.html.md): Embeddings, reranking, and RAG in Swift.

## Kotlin

- [Getting started with Kotlin](https://www.quaynor.site/kotlin/index.html.md): Install and configure the Kotlin package for Android.
- [Chat](https://www.quaynor.site/kotlin/chat/index.html.md): Chat sessions and Flow-based streaming in Kotlin.
- [Tool Calling](https://www.quaynor.site/kotlin/tool-calling/index.html.md): Tool calling from Kotlin function references.
- [Vision & Hearing](https://www.quaynor.site/kotlin/vision/index.html.md): Vision and audio prompts in Kotlin.
- [Sampling](https://www.quaynor.site/kotlin/sampling/index.html.md): Sampler presets and the buildSampler DSL in Kotlin.
- [Embeddings & RAG](https://www.quaynor.site/kotlin/embeddings-and-rag/index.html.md): Embeddings, reranking, and RAG in Kotlin.
- [Logging & Troubleshooting](https://www.quaynor.site/kotlin/logging-and-troubleshooting/index.html.md): Logcat output and common Kotlin failures.

## Optional

- [iBz-04/quaynor](https://github.com/iBz-04/quaynor): Quaynor source and issues.

## Sitemaps

- [sitemap.xml](https://www.quaynor.site/sitemap.xml): Documentation URLs for search engines.