Daily Edition · Page 7

THE DAILY INDEX

Technology, AI, software, security, crypto and business

Repositories, courses and useful tools

Resources & Tools

LLM

llm is a Rust ecosystem made of libraries that help in performing inference on large language models. It is based on llama.cpp. llm includes a wrapper around llm-base and supported models and a CLI application that offers a user-friendly interface for running inference on the supported models. Inference can currently only be done on CPU, but the ecosystem aims to also include GPU inference in the future. llm supports GPT-2, GPT-J, LLaMA, GPT-NeoX, StableLM, Dolly v2, and BLOOMZ.

OP VAULT

OP Vault uses the OP Stack (OpenAI + Pinecone Vector Database) to enable users to upload their own custom knowledge base files and ask questions about their content. With quick setup, devs can launch their own version of this Golang server along with a user-friendly React frontend that allows users to ask OpenAI questions about the specific knowledge base provided. The primary focus is on human-readable content like books, letters, and other documents, making it a practical and valuable tool for knowledge extraction and question-answering. You can upload an entire library's worth of books and documents and receive pointed answers along with the name of the file and specific section within the file that the answer is based on.

TLDR IndexPage 7