OPENAI'S SHIFT FROM MICROSOFT TO SOFTBANK
OpenAI plans to source most of its computing power from SoftBank's Stargate project by 2030, marking a significant departure from its reliance on Microsoft.
Parse notes
OpenAI plans to source most of its computing power from SoftBank's Stargate project by 2030, marking a significant departure from its reliance on Microsoft.
Orakl Oncology uses Meta's DINOv2 model to accelerate cancer drug discovery, improving efficiency by quickly analyzing organoid images to predict patient treatment responses.
Chinese AI lab DeepSeek plans to open source portions of its online services' code as part of an “open source week” event.
SigLIP was an immensely popular joint image and text encoder model. It has now been improved in a number of axes. Most notable is the substantially improved zero-shot classification performance, which was the hallmark result of the original CLIP work.
STeCa is a novel framework designed to improve LLM agents in long-horizon tasks by automatically identifying and correcting suboptimal actions.
With modern post-training techniques, this 2B model trained on Gemma achieves state-of-the-art translation performance between 28 different languages.
This is the first (public) large scale model trained with the Muon optimizer. It was trained for 5.7T tokens and is a very similar architecture to DeepSeek v3.
The DeepSeek NSA paper made waves last week for its scalable and efficient long context attention algorithm. However, there was no code available. This work is a Triton replication that can be slotted into any PyTorch codebase.
OmniServe offers a unified framework for efficient large-scale LLM deployment, combining innovations in low-bit quantization and sparse attention to enhance both speed and cost-effectiveness.
A great introduction to CUDA programming for those familiar with Python programming.
This article explores the potential impacts of funding cuts to the US AI Safety Institute, including implications for national security, AI research, and international competition.
Microsoft is preparing to host OpenAI's GPT-4.5 model as early as next week, with a more significant GPT-5 release anticipated by late May. The GPT-5 system will integrate OpenAI's new o3 reasoning model, aiming to create a unified AI functionality. Both releases align with key tech events, such as Microsoft Build and Google I/O, underscoring Microsoft's strategic positioning in the AI space.
Various novel strategies to parallelize the up-and-coming Muon optimizer.
ChatGPT has reached 400 million weekly active users, doubling its count since August 2024.
Google has enhanced its Gemini 2.0 LLM to generate scientific hypotheses significantly faster than human researchers.