温嘉琪 / BUILDING SOMETHING FUN

在用户的手机上离线运行大语言模型/LLM + edge

aaa.001.jpeg

1

https://github.com/upscayl/upscayl

🆙 Upscayl - Free and Open Source AI Image Upscaler for Linux, MacOS and Windows built with Linux-First philosophy.

场景:扩图

tag:离线,AGPL-3.0 license

2

https://github.com/LlamaEdge/LlamaEdge

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

3

https://github.com/psychic-api/rag-stack

🤖 Deploy a private ChatGPT alternative hosted within your VPC. 🔮 Connect it to your organization’s knowledge base and use it as a corporate oracle. Supports open-source LLMs like Llama 2, Falcon, and GPT4All.

4

https://github.com/mazzzystar/Queryable

Run OpenAI’s CLIP model on iOS to search photos.

特性:iOS应用

中文名是寻隐(已上线App Store)

5

https://github.com/ggerganov/whisper.cpp

Port of OpenAI’s Whisper model in C/C++

特性:支持iOS

6

https://github.com/ggerganov/llama.cpp

LLM inference in C/C++

特性:支持macOS