The Daily Index — Thursday, February 29, 2024 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

MODAL ADDS WEBSOCKETS

Most serverless GPU offerings require one POST request per model inference. However, this is a challenge in cases where you want to stream model outputs. Websockets make streaming possible.

modal.com · 5 min

TLDR AI

TIM COOK SAYS APPLE WILL ‘BREAK NEW GROUND’ IN GENERATIVE AI

Apple CEO Tim Cook announced at the company's annual shareholders meeting that the company plans to break new ground in generative AI in 2024, promising transformative opportunities for users.

macrumors.com · 1 min

TLDR AI

VIDEO AS THE NEW LANGUAGE FOR REAL-WORLD DECISION MAKING

An amazing paper that frames video as a potentially better way for AI to interact with human users. It shows how video models can be used as planners, agents, compute engines, and environment simulators.

arxiv.org · 26 min

TLDR AI

1BIT LLMS

Most language models use 16 or more bits to represent a parameter in a model. This results in powerful models that can be expensive to run. This work proposes a method that uses 1.58 bits per parameter - each parameter is in {-1, 0, 1}. This method matches performance exactly up to 3B parameters. No code or models have been released yet.

arxiv.org · 14 min

TLDR AI

ENHANCING VISUAL PERCEPTION IN AI MODELS

This research focuses on advancing multi-modality foundation models like GPT-4V in low-level visual perception tasks. The large-scale experiment gathered feedback on 18,973 images from 58,000 humans and created the Q-Pathway dataset to analyze clarity, color, and brightness.

arxiv.org · 14 min

TLDR AI

LLMS HANDLE 100K TOKENS WITH DUAL CHUNK ATTENTION

Dual Chunk Attention (DCA) extends the capabilities of large language models like Llama2 70B, allowing them to handle over 100k tokens without additional training. It breaks down attention computation into chunks, enhancing the model's understanding of both short and long-range context.

github.com · 14 min

TLDR AI

STARCODER V2

The Big Code project has released another version of its flagship coding model. The model has a 16k context window and was trained on 4T tokens. Its performance is strong, but still under that of DeepSeek coder.

huggingface.co · 4 min

TLDR AI

LEARNING FROM HETEROGENEOUS GRAPHS

HiGPT is an approach to learning across diverse heterogeneous graphs without the need for fine-tuning. Its integration with a novel graph tokenizer and a vast corpus of graph instructions allows it to excel in adapting to various data distributions.

higpt-hku.github.io · 4 min

TLDR AI

ONLINE SHOPPING WITH MULTI-MODAL KNOWLEDGE DISTILLATION

PromptMM improves recommendation systems on platforms like Amazon and TikTok by using Multi-modal Knowledge Distillation. It addresses inaccuracies in user preferences and simplifies systems by distilling important features from various content types (visual, textual, or acoustic) to prevent overfitting.

arxiv.org · 16 min

TLDR AI

DPO TO ENCOURAGE DESCRIPTIVENESS (GITHUB GIST)

A minimal code set up with TRL to tune a model to be more descriptive.

gist.github.com

TLDR AI

SHAPE SUFFIXES FOR ML CODING

A coding style at Character AI dramatically improves the readability of shapes in tensors.

medium.com · 2 min

TLDR AI

ADOBE GENERATIVE AI DOCUMENT & PDF TOOL (PRODUCT)

Adobe Acrobat's new AI Assistant can query documents for answers with attribution, create document summaries, offer a list of suggested questions for deeper insights, assist in drafting content for various communication needs, and provide outlines and key points so users can swiftly navigate essential document information.

adobe.com

TLDR AI

YOUR REFERRAL LINK - https://tldr.tech/ai?ref=2613930

Summary unavailable

tldr.tech