README.md

Learning AI

This repository contains notes and code examples related to AI.

In-progress

• Parakeet: supporting Parakeet in whisper.cpp
• Kimi-Linear
• CUDA FA exploration

Topics

• GGML
• Llama.cpp
• Architectures
• Position Embeddings
• Tokenization
• Speculative Decoding
• GPUs
• Vector Databases
• Vision

Examples/Exploration code

• GGML GGML C library exploration code
• Llama.cpp Llama.cpp library exploration code
• GPU CUDA, Kompute, Metal, OpenCL, ROCm, and Vulkan exploration code
• Embeddings Word embeddings examples in Rust and Python
• Huggingface API Huggingface API example written in Python
• Qdrant Vector Database Examples in Python and Rust
• LanceDB Vector Database Examples in Python and Rust