TLDR AI

TLDR AI 2024-04-08

6 sections19 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

STYLE FROM SIMPLE TEXT PROMPTS AND 1 SELFIE

Higgsfield’s new foundational model and app [3] change the game for video AI — allowing any creator to instantly bring their vision to life with unparalleled control: ➡️ Starting from just 1 selfie [4], create highly personalized and realistic human characters that can be dropped into almost any scene.

higgsfield.aiSponsor

02HEADLINES & LAUNCHES

AMD TO OPEN SOURCE MES FIRMWARE

AMD has agreed to open source the firmware for its Radeon GPUs. This means the community can quickly improve AI frameworks and potentially AMD adoption.

theregister.com6 min read

XAI LOOKING TO RAISE $3B

Elon Musk's xAI is in talks with investors to raise $3B in a funding round that would value the artificial intelligence startup at $18B.

economictimes.indiatimes.com1 min read

INTRODUCING COMMAND R+: A SCALABLE LLM BUILT FOR BUSINESS

Cohere has introduced Command R+, a powerful, scalable LLM designed for enterprise use cases, featuring advanced retrieval augmented generation with citation, multilingual coverage in 10 key languages, and tool use capabilities.

txt.cohere.com4 min read

03RESEARCH & INNOVATION

QWEN1.5-32B

The Qwen team has trained and released a 32B parameter model that achieves strong performance. It can be fit in more modest memory systems.

qwenlm.github.io18 min read

PROTECTING IMAGES FROM UNAUTHORIZED SEGMENTATION

"Anything Unsegmentable" is a new approach designed to shield digital images from being segmented by powerful AI models, addressing potential copyright and privacy issues.

arxiv.org20 min read

A BENCHMARK FOR DETECTING LLM ERRORS

Researchers have launched ReaLMistake, a benchmark aimed at systematically detecting errors in large language model responses.

arxiv.org18 min read

04ENGINEERING & RESOURCES

SWE-AGENT

SWE-agent turns LLMs (e.g. GPT-4) into software engineering agents that can fix bugs and issues in real GitHub repositories. SWE-agent sets the state-of-the-art performance on the full SWE-bench benchmark, resolving 12.29% of issues.

swe-agent.com3 min read

SCHEDULE FREE OPTIMIZATION

Researchers from Meta have been teasing a new optimizer on X. They have now released the code along with various integrations. The optimizer has no LR schedule, which means you don’t need to know the full number of training steps beforehand. It has been shown empirically to work on a wide variety of problems including language models.

github.comGitHub repository

REPRESENTATION FINE-TUNING

ReFT is a new parameter-efficient method for fine-tuning language models. It is substantially cheaper than even PeFT while achieving strong performance.

github.comGitHub repository

05MISCELLANEOUS

FOUR TAKEAWAYS ON THE RACE TO AMASS DATA FOR AI

The development of artificial intelligence heavily relies on vast amounts of data, which is being rapidly consumed by tech companies faster than it is being produced, leading to predictions that high-quality digital data may be exhausted by 2026. In response, companies like OpenAI, Google, and Meta are exploring new methods to obtain more data, including using YouTube video transcripts, revising privacy policies, considering the purchase of major publishers, and investigating the use of "synthetic" data generated by AI models, despite the risk of compounding errors.

nytimes.com5 min read

SPEED TESTS FOR LLAMA 2, STABLE DIFFUSION

MLPerf has updated its inferencing benchmarks to include large language models like Llama 2 70B and Stable Diffusion XL, reflecting the industry's shift to massive generative AI. In the latest tests, Nvidia's systems, particularly those equipped with the H200 processor, outperformed competitors from Intel and Qualcomm in both speed and efficiency. The benchmarks highlight the importance of high-bandwidth memory in handling large AI models, with Intel's Gaudi 2 and Qualcomm's Cloud AI 100 Ultra also showcasing significant performances in the generative AI space.

spectrum.ieee.org6 min read

RABBIT PARTNERS WITH ELEVENLABS TO POWER VOICE COMMANDS ON ITS DEVICE

Rabbit partners with ElevenLabs to incorporate voice command technology into its upcoming r1 devices, enhancing human-device interaction with low latency models for a more natural experience. The first batch of r1 devices, which feature functionalities like chatbot interaction and bi-directional translation, is set to ship by March 31. ElevenLabs has recently raised $80 million, despite facing challenges with misuse of its voice cloning technology.

techcrunch.com2 min read