TLDR AI

TLDR AI 2024-05-23

6 sections16 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

WANT TO REACH TLDR'S AUDIENCE?

Fortune 50 companies like AWS and Google Cloud and fast growing startups like Vercel and Secureframe work with TLDR to reach our audience of over 4 million tech-savvy decision makers with highly customized campaigns (like this one!).

advertise.tldr.techSponsor

02HEADLINES & LAUNCHES

OPENAI PARTNERS WITH NEWS CORP

OpenAI and News Corp (which includes WSJ, NYP, The Times, and other publishers) agreed to bring its news content to OpenAI's platform, which they claim will increase the usability and accuracy of generations.

links.tldrnewsletter.com2 min read

STANFORD HAI RELEASES UPDATED FOUNDATION MODEL TRANSPARENCY INDEX

Stanford HAI released the latest version of its Foundation Model Transparency Index, which evaluates the transparency of 14 major AI developers, including OpenAI and Google. These companies disclosed new information previously unavailable to the public, marking a significant improvement and willingness to open up the discourse about their models. Despite this progress, the average transparency score was just 58 out of 100, highlighting significant gaps in areas like data access, model trustworthiness, and downstream impact.

crfm.stanford.edu7 min read

MICROSOFT RELEASES PHI-SILICA

Microsoft has announced the general availability of its Phi-3 models and introduced Phi-3-Silica, a small language model optimized for Neural Processing Units in Copilot+ PCs. Phi-3-Silica, with 3.3 billion parameters, offers fast local inferencing with low power consumption, marking a significant step in integrating advanced AI directly into Windows devices to enhance productivity and accessibility. It will be available in June.

links.tldrnewsletter.com1 min read

03RESEARCH & INNOVATION

AURORA ATMOSPHERIC PREDICTION MODEL

Microsoft has trained a foundation model for atmospheric predictions which has set a new state-of-the-art on 5 and 10 day global weather prediction tests.

microsoft.com12 min read

A FASTER NEURAL NETWORK ARCHITECTURE

Researchers have developed Wav-KAN, a neural network framework that uses wavelet functions to improve interpretability and performance. Unlike traditional models, Wav-KAN captures both high and low-frequency data components, leading to faster training and increased robustness.

arxiv.org20 min read

04ENGINEERING & RESOURCES

DO WE REALLY NEED MAMBA FOR VISION

Mamba is a strong Transformer alternative that has been gaining steam for its ability to use fewer FLOPs while maintaining performance. However, it may not be necessary for some applications. This work shows that a well-tuned CNN baseline outperforms Mamba on a set of vision tasks.

github.comGitHub repository

POWERFUL VISION MODELS ON YOUR PHONE

MiniCMP-V has a new version trained on top of Llama 3. This 8B model outperforms many closed proprietary models on a wide variety of tasks. It can handle 30 different languages and excels at OCR and visual question answering.

github.comGitHub repository

IMPROVING MEDICAL AI ACCURACY

MedLFQA is a new benchmark dataset designed to improve the factual accuracy of long-form responses from large language models in the medical field. OLAPH is a framework that trains LLMs to reduce inaccuracies by using automatic evaluations and preference optimization.

github.com3 min read

05MISCELLANEOUS

TARSIER

Reworkd has released Tarsier, a new tool to enhance LLMs for web interaction tasks by visually tagging elements on webpages using brackets and IDs. Tarsier allows an LLM without vision to understand a webpage's structure via OCR-generated text representations outperforming vision-language models in benchmarks.

github.comGitHub repository

THE OLD-FASHIONED LIBRARY AT THE HEART OF THE A.I. BOOM

OpenAI's headquarters, a renovated mayonnaise factory with a library-themed design, is emblematic of the company's language-focused success with ChatGPT. The office contrastingly serves as a reminder of the ongoing legal debates over the use of copyrighted material in AI training. Despite these disputes, OpenAI staff view the library as a space for inspiration, reinforcing their belief in the synergy between human and AI-driven creativity.

nytimes.com4 min read

CHAOS AND TENSION AT OPENAI

Ilya Sutskever has departed from OpenAI amidst concerns over the company's commitment to AI safety, signaling a potentially worrying trend as three other key personnel have also recently resigned. These departures raise questions about the impact on the company's safety-focused mission and its nonprofit status as it pursues commercialization. These events may also reverberate through legal and regulatory landscapes, prompting scrutiny from stakeholders in Washington.

garymarcus.substack.com2 min read