Search the archive

PEARLS CONTEXTUAL BANDIT TUTORIAL

Pearls is an RL framework maintained by Meta. This tutorial walks through a bandit-based learning problem with the software.

AI’S LABOR MARKET IMPACTS ARE SLOWER THAN EXPECTED

The working paper "Beyond AI Exposure: Which Tasks are Cost-Effective to Automate with Computer Vision?" by researchers from MIT and IBM examines the economic viability of automating vision-based tasks. It found only 23% are cost-effective for automation. The paper predicts a gradual labor market impact over years, contrasting with more disruptive forecasts.

A NEW BENCHMARK IN TEXT EMBEDDING MODELS

Nomic-Embed-Text-V1 sets a new standard as an open-source, fully reproducible text embedding model. It excels in both short and long-context tasks. Unique in its transparency, Nomic-Embed-Text-V1 offers complete access to its training code, model weights, and a vast dataset of 235 million text pairs.

MATRICES (PRODUCT LAUNCH)

Matrices is an AI-native spreadsheet that creates itself and fills itself with whatever information you need. It can be extended with just natural language.

HOW AI IS HELPING US LEARN ABOUT BIRDS

BirdCast, a collaboration between the Cornell Lab of Ornithology, Colorado State University, and UMass Amherst, uses machine learning and radar data to predict bird migrations. The project demonstrates AI's potential to revolutionize ornithology by enhancing understanding of ecosystem health and migration patterns.

ROBLOX RELEASES REAL-TIME AI CHAT TRANSLATOR

Roblox has developed an AI model capable of translating text chats in real-time across 16 languages to enhance user engagement by breaking down language barriers. It utilizes a transformer-based large language model within a Mixture-of-Experts architecture for efficient resource use while maintaining their privacy and safety processes.

YOUR REFERRAL LINK - https://tldr.tech/ai?ref=2613930

SAKANA AWARDED JAPANESE GOVERNMENT SUPERCOMPUTING GRANT

The Japanese-based AI startup has been chosen to access the NEDO-funded supercomputer.

HUGGING FACE LAUNCHES OPEN SOURCE AI ASSISTANT MAKER TO RIVAL CUSTOM GPTS

Hugging Face has introduced customizable Hugging Chat Assistants. This allows for the free creation of AI chatbots using a selection of open-source LLMs and contrasts with OpenAI's subscription-based model.

ARC IS BUILDING AN AI AGENT THAT BROWSES ON YOUR BEHALF

The Browser Company is developing AI technology for its Arc Browser to autonomously surf the web and present relevant information to users, unlike traditional search engines.

GOOD ACTOR, BAD ACTOR: LLMS FOR FAKE NEWS DETECTION

A fine-tuned BERT model is better than an off-the-shelf LLM like GPT-3.5-turbo at fake news detection.

EFFICIENT RECOMMENDATION SYSTEMS

PAP-REC has introduced a method to automatically create personalized prompts for Recommendation Language Models, enhancing their efficiency and effectiveness.

AUDIO QUALITY ASSESSMENT WITH AI

PAM is a tool that uses Audio-Language Models to assess audio quality without reference tracks or specialized training.

scalable data infrastructure. Tune in live 🎧

PYGMALION INFERENCE ENGINE

The Aphrodite engine can be used to reduce VRAM requirements while boosting throughput for AI inference workloads.

OPEN ALTERNATIVE TO GITHUB COPILOT

ChatLLM for VS Code is an open alternative for AI-assisted autocomplete. It now supports any Ollama models in addition to using closed API-based models.

DIFFUSERS 0.26

Diffusers from Hugging Face has a number of interesting additions like video pipelines and multi-IP adapter usage, which allows conditioning on more than one image for generation.

OLLAMA VISION MODELS

Ollama recently released support for vision models. Llava 1.6 features updated support and includes vision functionality in both Python and JavaScript packages.

IMAGE TO MUSIC V2

You can create a compelling image-to-music pipeline by translating images to text, text to prompt, and prompt to music.

HIGH-FIDELITY VIDEO GENERATION

AnimateLCM is a new approach for quickly creating high-quality videos and improving existing video diffusion models by splitting the learning process into two parts.

strategies to eliminate bias. Download free from Gem

BANANA SUNSETTING SERVERLESS GPU BUSINESS

Banana is winding down operations of its serverless GPU business. It has provided a transition plan and assistance for off-boarding.

3D TOPIA GENERATIVE MODEL

Powerful text to 3D generative model that uses a two-stage process to generate candidates and then refine those chosen.

SELLSCALE (PRODUCT)

Get instant feedback on your sales emails.

YOUR REFERRAL LINK - https://tldr.tech/ai?ref=2613930

NOUS RESEARCH RELEASES HERMES DATASET

OpenHermes-2.5 data has been used to train some of the best open models out there. The dataset contains 1M+ examples of high-quality data points. It has now been released.

BARD CAN GENERATE IMAGES

Bard has now expanded its service to more languages and launched an image generation service.

THE AMERICAN DYNAMISM 50: AI

a16z put together this list of 50 startups tackling some of America’s most pressing problems around defense, energy, transportation, and manufacturing. All of them are using AI in some form to accelerate their efforts. If you’re curious about real-world applications of AI, this is a great insight.

OLMO: OPEN LANGUAGE MODEL

AI2 released a fully open language model training framework. The models come with comprehensive resources including full training data, model weights, training and evaluation code, over 500 checkpoints for each model, and future plans for fine-tuning code, all released under the Apache 2.0 License. These resources are provided by AI2’s Dolma and WIMBD. They include evaluation frameworks Catwalk and Paloma and support for analysis and fine-tuning through Weights & Biases logs and HuggingFace revisions. The models are competitive with the best in class.

MOBILEDIFFUSION

Google has showcased a latent consistency diffusion model with some architectural changes that it trained to run on mobile devices with sub-second generation times.

ENHANCED VIDEO-TEXT LEARNING

Shared Network Pre-training (SNP) improves learning of video and text together. This method is more efficient and versatile than previous models and includes a unique strategy called Significant Semantic Strengthening (S3) for better understanding of key words in sentences.

product team. Join live on Feb 05

NEW STATE OF THE ART IN OPEN EMBEDDING MODEL (HUGGINGFACE HUB)

The BGE-M3 project introduces a versatile embedding model that excels in Multi-Functionality (dense, multi-vector, and sparse retrieval), Multi-Linguality (supporting over 100 languages), and Multi-Granularity (handling inputs from short sentences to documents up to 8192 tokens). It uses a hybrid retrieval pipeline that combines different methods and re-ranking for higher accuracy and generalization, leveraging its ability to perform embedding and sparse retrieval simultaneously.

HIERARCHICAL TEXT SEGMENTATION

The Segment Anything Model (SAM) has been enhanced to create Hi-SAM, a model specializing in hierarchical text segmentation. Hi-SAM excels in segmenting text across multiple levels - from strokes to paragraphs - and even performs layout analysis.

RAGS

RAGs is a Streamlit app that lets users create RAG pipelines from data sources using natural language. Users just have to describe the tasks and parameters they want from their RAG systems. The RAG can be queried and it will answer questions over the data.

BLOCKCHAIN-POWERED SOLUTION TO HELP IMPROVE TRANSPARENCY AND AUDITABILITY FOR GENERATIVE AI SYSTEMS

IBM Consulting and Casper Labs are working together to build a pioneering AI governance tool powered by blockchain. Built leveraging IBM’s watsonx.governance platform, it will introduce AI version control, advanced monitoring, permissioning, and access controls to AI models for enterprise use. This could be essential for businesses looking to de-risk AI and harness its true potential while adhering to internal or external guidelines and regulations.

YOU ARE NOT LATE TO ARTIFICIAL INTELLIGENCE

Just as the early days of the internet offered immense opportunities, today's AI landscape holds similar potential. The key is to shift perception to see the possibilities in existing technologies like AI and follow passion and joy to explore various paths.

AMAZON DEBUTS ‘RUFUS’, AN AI SHOPPING ASSISTANT IN ITS MOBILE APP

Amazon has launched Rufus, an AI-powered shopping assistant in its mobile app that helps with product searches and recommendations by using Amazon's catalog and external web data, for a subset of U.S. customers.

GPTNEWSPAPER

6 agents that work together to build a newspaper by doing research, writing, and formatting in concert.

AI CLIENT FINDER (PRODUCT)

Find your potential clients' accurate contact data with AI.

YOUR REFERRAL LINK - https://tldr.tech/ai?ref=2613930

⚒️ Start building ⚒️

MISTRAL CEO CONFIRMS ‘LEAK’ OF NEW OPEN SOURCE AI MODEL NEARING GPT-4 PERFORMANCE

The AI community is abuzz with a leaked large language model called "miqu-1-70b" that was shared on HuggingFace and 4chan. The model shows performance rivaling OpenAI's GPT-4 and is linked to Mistral's Mixtral 8x7b. This incident, acknowledged by Mistral's CEO as a leak by an enthusiastic customer, highlights the growing capabilities of open source AI.

MICROSOFT LASERS AWAY LLM INACCURACIES

Dipendra Misra presented Layer-Selective Rank Reduction (LASER), a technique that improves large language model (LLM) accuracy by replacing a weight matrix with a smaller approximation, at the January Microsoft Research Forum.

LLAVA 1.6

The newest version of Llava, a vision language model, has improved OCR, reasoning, and world knowledge. It matches Gemini on some tasks. The Llava team plans to release data, code, and the model.

WEAVER: FOUNDATION MODEL FOR STORY TELLING

Weaver is a series of models specifically trained to tell stories. The largest model (34B params) outperforms GPT-4 on a storytelling benchmark.