1. LLM / Agent infrastructure
Tools and frameworks for running, orchestrating, and operating LLM/agents — the base layer for applications on large models.
| Name | Link | Short |
|---|---|---|
| LocalAI | github.com/mudler/LocalAI | Self-hosted LLM infrastructure, drop-in replacement for cloud APIs. |
| Litgpt | github.com/Lightning-AI/litgpt | Collection of tools and examples for working with LLMs. |
| Letta (MemGPT) | github.com/letta-ai/letta | Framework for LLM services with memory support. |
| OpenAI Realtime Agents | github.com/openai/openai-realtime-agents | Demonstration of agents over Realtime API. |
| Golf-mcp | github.com/golf-mcp/golf | MCP (Model Context Protocol) server framework for agents. |
| Excel MCP Server | github.com/haris-musa/excel-mcp-server | MCP server for Excel integration (LLM ↔ Excel). |
| Plandex-AI | github.com/plandex-ai/plandex | Open source AI coding agent. |
| Agent Zero AI framework | github.com/agent0ai/agent-zero | Framework for creating autonomous AI agents. |
| 12-factor-agents | github.com/humanlayer/12-factor-agents | Principles for building production-ready LLM applications. |
| Memary | github.com/kingjulio8238/Memary | Open memory layer for autonomous agents. |
2. Speech & Audio LLMs
Libraries and UIs for STT/TTS, real-time transcription, voice LLMs, and diarization.
| Name | Link | Short |
|---|---|---|
| OpenAI Whisper | github.com/openai/whisper | Original speech recognition model from OpenAI. |
| whisper.cpp | github.com/ggml-org/whisper.cpp | C/C++ optimization of Whisper — runs on CPU. |
| Faster Whisper | github.com/SYSTRAN/faster-whisper | Faster than original (CTranslate2). |
| WhisperX | github.com/m-bain/whisperX | Whisper + alignment + diarization for video/podcasts. |
| RealtimeSTT | github.com/KoljaB/RealtimeSTT | Low-latency transcription with VAD, wakeword, and instant transcription. |
| Ichigo | github.com/homebrewltd/ichigo | Local voice AI (voice assistants). |
| VOSK | github.com/alphacep/vosk | Lightweight offline STT library (many platforms). |
| Voice-Pro: Gradio WebUI | github.com/abus-aikorea/voice-pro | Gradio UI for Whisper/Faster-Whisper and TTS/translation. |
| Step-Audio2 | github.com/stepfun-ai/Step-Audio2 | End-to-end audio LLM for deep audio understanding. |
| CosyVoice | github.com/FunAudioLLM/CosyVoice | Multilingual neural voice generator. |
| LibreTranslate | github.com/LibreTranslate/LibreTranslate | Open-source machine translation API. |
| Spotube | github.com/KRTirtho/spotube | Cross-platform client for Spotify / YouTube / Piped.video. |
3. Vision / Video / NVR
Projects for detection, streaming, video processing, NVR, and CV research.
| Name | Link | Short |
|---|---|---|
| Frigate (NVR) | github.com/blakeblackshear/frigate | NVR with object detection for cameras. |
| Go2RTC | github.com/AlexxIT/go2rtc | Tool for streaming and forwarding camera streams. |
| Superstreamer | github.com/matvp91/superstreamer | Real-time video processing and streaming. |
| PaperVision | github.com/deltacv/PaperVision | OpenCV adaptations and CV algorithms. |
| Claude Vision Object Detection | github.com/Doriandarko/Claude-Vision-Object-Detection | Object detection (Claude Vision examples). |
| Deep-Live-Cam | github.com/hacksider/Deep-Live-Cam | Real-time face swap / deepfake tools. |
| DeepFace | github.com/serengil/deepface | Lightweight face recognition and attributes library. |
| Roboflow - notebooks | github.com/roboflow/notebooks | State-of-the-art CV models tutorials (YOLO, SAM, etc.). |
| Wifi-3d-fusion | github.com/MaliosDark/wifi-3d-fusion | Research project: WiFi+CV for 3D pose. |
| LLAMA OCR (npm) | www.npmjs.com/package/llama-ocr | OCR package (npm). |
| OHIF Medical Imaging Viewer | github.com/OHIF/Viewers | Medical image viewer (DICOM). |
| FaceFusion | github.com/facefusion/facefusion | Platform for face manipulations / face fusion. |
| MagicQuill | github.com/magic-quill/MagicQuill | AI-powered image editing system. |
| PromptFix | github.com/yeates/PromptFix | Tool for “fixing”/improving prompts (useful for image→LLM workflows). |
4. Web / Frontend / Full-Stack Frameworks
Tools for web interfaces, frontend frameworks, and full-stack templates.
| Name | Link | Short |
|---|---|---|
| Svelte | github.com/sveltejs/svelte | Modern frontend framework. |
| Reflex | github.com/reflex-dev/reflex | Python framework for web apps (React-like). |
| Full-stack-fastapi-template | github.com/fastapi/full-stack-fastapi-template | Template for full FastAPI frontend + backend. |
| Rio: WebApps | github.com/rio-labs/rio | WebApps in Python without JS/HTML. |
| Dioxus | github.com/DioxusLabs/dioxus | Fullstack framework (Rust). |
| Webstudio | github.com/webstudio-is/webstudio | Visual build tool for websites. |
| PyUIBuilder | github.com/PaulleDemon/PyUIBuilder | GUI builder for Tkinter/CustomTkinter and others. |
| 9ui | github.com/borabaloglu/9ui | Beautiful UI components set (Tailwind + Base UI). |
| MidsceneJS | github.com/web-infra-dev/midscene | Page automation SDK with JSON output. |
| Homepage (gethomepage) | github.com/gethomepage/homepage | Customizable homepage / dashboard. |
5. Data, ETL, Databases and Analytics
Tools for data integration, visualization, semantic search, and analytics.
| Name | Link | Short |
|---|---|---|
| Airbyte | github.com/airbytehq/airbyte | Platform for ETL/ELT integrations. |
| Apache Superset | github.com/apache/superset | BI and dashboards with extensive visualization capabilities. |
| SurrealDB | github.com/surrealdb/surrealdb | Document-graph distributed DB for realtime. |
| TXTAI / txtai | github.com/neuml/txtai | Semantic search database and RAG layer. |
| Pandas-AI | github.com/Sinaptik-AI/pandas-ai | Conversational data analysis (Pandas + LLM). |
| LLM Graph Builder | github.com/neo4j-labs/llm-graph-builder | Building graphs from unstructured data. |
| Timelinize | github.com/timelinize/timelinize | Data aggregator from various accounts into timeline. |
6. Infrastructure, orchestration, DevOps & PaaS
Service mesh, PaaS, background jobs, self-hosted platforms, and deploy tools.
| Name | Link | Short |
|---|---|---|
| Istio | github.com/istio/istio | Service Mesh (connect, secure, observe services). |
| Zane-Ops | github.com/zane-ops/zane-ops | Self-hosted PaaS for app deployment. |
| Trigger.dev | github.com/triggerdotdev/trigger.dev | Background tasks platform. |
| Steel-browser | github.com/steel-dev/steel-browser | Browser/tool for automation (dev tool). |
| Browser Use | github.com/browser-use/browser-use | Browser automation tools. |
| CasaOS | github.com/IceWhaleTech/CasaOS | Personal cloud dashboard (self-host). |
| WatchYourLAN | github.com/aceberg/WatchYourLAN | Lightweight network scanner with notifications. |
| Local File Organizer | github.com/QiuYannnn/Local-File-Organizer | Utility for organizing files locally. |
| Docker Windows (dockur) | github.com/dockur/windows | Windows in Docker (dev/sandbox). |
| Lightpanda-io/browser | github.com/lightpanda-io/browser | Browser project (automation). |
| Webpilot (Webpilot-AI) | github.com/webpilot-ai/Webpilot | Open “Copilot for Web” for automation/parsing. |
| Nanobrowser | github.com/nanobrowser/nanobrowser | Extension for AI web automation. |
7. Developer tools and AI tools
CLI utilities, editors, UI builders, JSON tools, and useful dev workflow helpers.
| Name | Link | Short |
|---|---|---|
| JSON Crack (Editor) | github.com/AykutSarac/jsoncrack.com | Visual JSON editor and visualizer. |
| Just | github.com/casey/just | ”Make” alternative — command runner (justfile). |
| AutomaApp | github.com/AutomaApp/automa | Browser automation (extension). |
| Nanobrowser | github.com/nanobrowser/nanobrowser | Extension for AI web automation. |
| MarkitDown / MarkPDFDown | github.com/microsoft/markitdown | Tools for Markdown conversion / PDF→MD. |
| MarkPDFDown (alt) | github.com/MarkPDFdown/markpdfdown | PDF→Markdown + LLM visualization. |
| Awesome AI Web Search | github.com/felladrin/awesome-ai-web-search | Collection of AI tools for web search. |
8. Documentation, tutorials (Guides & Books)
Knowledge collections, learning roadmaps, and tutorials on CS, ML, and system design.
| Name | Link | Short |
|---|---|---|
| build-your-own-x | github.com/codecrafters-io/build-your-own-x | ”Build your own…” guides for engineers. |
| System-design-101 | github.com/ByteByteGoHq/system-design-101 | Materials on system design. |
| The Book Of Secret Knowledge | github.com/trimstray/the-book-of-secret-knowledge | Collection of tricks, one-liners, and utilities. |
| Roboflow notebooks | github.com/roboflow/notebooks | CV tutorials and practices. |
| Math (ossu) | github.com/ossu/math | Path to self-education in mathematics. |
| Roadmap.sh | github.com/kamranahmedse/developer-roadmap | Community roadmaps and resources for developers. |
9. Documents, PDF and text
Tools for PDF, documents, notes, and resumes.
| Name | Link | Short |
|---|---|---|
| MarkitDown / MarkPDFDown | github.com/microsoft/markitdown github.com/MarkPDFdown/markpdfdown | Document-to-Markdown conversion, LLM assistance. |
| Stirling-PDF | github.com/Stirling-Tools/Stirling-PDF | PDF working tools. |
| Reactive-Resume | github.com/AmruthPillai/Reactive-Resume | Resume template/app. |
| Wallabag | github.com/wallabag/wallabag | Self-hosted “Save for later” for articles. |
| Harper (Automattic / harper) | github.com/Automattic/harper | Offline grammar checker (Rust). |
10. Products, applications and no-code / low-code
Finished apps, form builders, CMS alternatives, and no-code platforms.
| Name | Link | Short |
|---|---|---|
| Typebot | github.com/baptisteArno/typebot.io | Chatbot builder (no-code). |
| Appsmith | github.com/appsmithorg/appsmith | Low-code internal apps builder. |
| HeyForm | github.com/heyform/heyform | Form builder. |
| Formbricks | github.com/formbricks/formbricks | Open-source Qualtrics alternative. |
| Spree | github.com/spree/spree | Open-source eCommerce platform. |
| PocketBase | github.com/pocketbase/pocketbase | Lightweight backend (auth, db, files). |
| Focalboard | github.com/mattermost-community/focalboard | Self-hosted Trello/Notion alternative. |
| Plane | github.com/makeplane/plane | Project management tool. |
| Webstudio | github.com/webstudio-is/webstudio | Visual website builder. |
| Maxun | github.com/getmaxun/maxun | No-code web data extraction. |
| GDevelop | github.com/4ian/GDevelop | Game engine. |
11. ERP, applications and Fintech
Systems and platforms for business, ERP, MES, trading, and integration.
| Name | Link | Short |
|---|---|---|
| ERPNext | github.com/frappe/erpnext | Open-source ERP. |
| Carbon | github.com/crbnos/carbon | Production management platform — includes ERP (Enterprise Resource Planning), MES (Manufacturing Execution System), QMS (Quality Management System). |
| Airbyte | github.com/airbytehq/airbyte | ETL for business integrations. |
| Spree (eCommerce) | github.com/spree/spree | eCommerce platform. |
| Freqtrade | github.com/freqtrade/freqtrade | Open-source crypto trading bot (algo trading). |
12. Experimental / Research & ML-platforms
Research, numerical computation acceleration, models, and infrastructure for experts.
| Name | Link | Short |
|---|---|---|
| Cupy | github.com/cupy/cupy | NumPy on GPU. |
| Qwen3-Coder | github.com/QwenLM/Qwen3-Coder | Code version of Qwen3 (LLM). |
| NovaSky / SkyThought | github.com/NovaSky-AI/SkyThought | Train your own preview model (O1). |
| TransformerLab App | github.com/transformerlab/transformerlab-app | Interface for training/evaluating LLM+diffusion locally. |
| Julep | github.com/julep-ai/julep | Serverless AI workflows. |
| Google genai-toolbox | github.com/googleapis/genai-toolbox | MCP toolbox / AI infra from Google. |
| microsoft/BitNet | github.com/microsoft/BitNet | 1-bit inference framework (quant inference). |
| OpenCoder-llm | github.com/OpenCoder-llm/OpenCoder-llm | Cookbook for code LLMs. |
Others
- OpenAI Gradio App — github.com/gradio-app/openai-gradio — UI for quick demos and interfaces to models.
- Open Canvas (langchain) — github.com/langchain-ai/open-canvas — Visual canvas environment for RAG/LLM workflows.
- OpenAI Java API Library — github.com/openai/openai-java — Official Java library from OpenAI.
- Google Gemini — Starter Applets — github.com/google-gemini/starter-applets — Starter applets / examples for Google AI Studio.
- ArchiveBox — github.com/ArchiveBox/ArchiveBox — Autonomous webpage archiver (self-hosted).
- Awesome LLM Apps — github.com/Shubhamsaboo/awesome-llm-apps — Collection of LLM applications and RAG examples.
- Awesome-World-Models — Important works on world modeling.
- Hugging Face Agents Course — Course from Hugging Face on creating AI agents.
- System Prompts — Large collection of system prompts and model configurations.
- Frappe Builder — Visual “low-code” website builder.
- Cyberdesk — Open-source virtual desktops for AI agents.
- Skyfall-GS — Extracts 3D city scenes from satellite imagery.
- Agent-S — Framework for autonomous computer interaction by AI agents.
- Android Code Studio — IDE for Android devices.
- BrowserOS — Chromium fork with AI agent integration.
- ViMax — Agentic video generation (Director, Screenwriter, Producer all-in-one).
- Microsoft Agent Lightning — Training and optimization of existing AI agents.
- Context7 — MCP server for up-to-date documentation.
- OpenHealth — AI health assistant.
- ART: Agent Reinforcement Trainer — Learning from experience for LLM agents.
- Bitwarden Clients — Client apps for Bitwarden Password Manager.
- simstudioai/sim — Visual agentic workflow building.
- InfiniteTalk — Generation of “talking” character videos.