TLDR AI 2024-12-31

DEEPSEEK-V3, ULTRA-LARGE OPEN-SOURCE AI, OUTPERFORMS LLAMA AND QWEN ON LAUNCH

Chinese AI startup DeepSeek has released DeepSeek-V3, a 671B parameter model employing a mixture-of-experts architecture, available on Hugging Face. DeepSeek-V3 has outperformed leading models like Meta's Llama 3.1 and rivals closed models such as OpenAI's GPT-4o. The model emphasizes efficient performance with innovations like multi-token prediction, offering substantial training cost savings.

MICROSOFT AND OPENAI HAVE A FINANCIAL DEFINITION OF AGI

Microsoft and OpenAI define AGI as AI systems generating $100 billion in profits, which OpenAI is far from achieving. OpenAI is reportedly losing billions and doesn't expect profitability until 2029, affecting how long Microsoft will have access to its technology. Speculation on OpenAI declaring AGI sooner is countered by these financial metrics.

OPENAI ‘CONSIDERED' BUILDING A HUMANOID ROBOT

OpenAI is considering building its own humanoid robot, leveraging previous investments in robotics firms like Figure and 1X. The company disbanded its robotics division in 2021 and would face challenges re-entering this competitive market.

META-LEARNED OPTIMIZER BOOSTS CONTINUAL LEARNING

MULTI-SCALE SUPER-RESOLUTION

This paper introduces a new approach to Super-Resolution (SR) that challenges the conventional method of training separate models for each scale.

TEXT-TO-3D GENERATION OF COMPLEX INDOOR SCENES

SceneCraft introduces a method for creating detailed 3D indoor scenes based on user-provided text descriptions and layout preferences.

ANNOTATION IN MEDICAL IMAGING

Label Critic is an innovative tool designed to streamline medical dataset annotation by using AI-generated labels instead of starting from scratch.

A NEW METRIC FOR BETTER CELL TRACKING

CHOTA metric (Cell-specific Higher Order Tracking Accuracy) improves the evaluation of cell tracking methods in biomedical research. Unlike current metrics, which focus on local accuracy, CHOTA unifies the assessment of cell detections, global coherence, and lineage tracking, making it more effective for high-level biological analysis.

LIST OF FOUNDATION MODELS FOR MUSIC

This repository, along with the companion paper, contains a list of services, models, datasets, and systems used to generate music.

CHAIN OF CONTINUOUS THOUGHTS

Meta's COCONUT is a novel approach that allows LLMs to reason in continuous latent space rather than discrete language tokens by encoding reasoning steps in continuous vectors. The method improves reasoning abilities but sacrifices interpretability. It could be a valuable addition to future LLMs despite the trade-off.

TENSTORRENT AND THE STATE OF AI HARDWARE STARTUPS

Tenstorrent's open-source AI hardware approach offers a promising alternative to Nvidia's dominance by using a unique CPU and AI core integration strategy. The company is leveraging Samsung Foundry's cost-effective SF4X process and aims to tackle latency issues for scaling out AI workload efficiently. Tenstorrent's recent $2B valuation highlights its potential, especially as an option for high-performance RISC-V IP amidst ARM's pricing pitfalls.

WAYMO VERSUS UBER

Waymo's self-driving ride-hailing service has expanded to Los Angeles, joining San Francisco and Phoenix. Riders appreciate the smoother and more private experience compared to traditional rideshares. However, while ridership is increasing, Waymo's profitability remains uncertain.

CHATGPT SEARCH CAN BE TRICKED INTO MISLEADING USERS

ChatGPT Search, a new AI-powered search engine, can be tricked into generating misleading summaries by hiding text in websites.

META IS ROLLING OUT LIVE AI AND SHAZAM INTEGRATION TO ITS SMART GLASSES

Meta's Ray-Ban Smart Glasses now feature live AI assistance, language translation, and Shazam music identification.

AI HELPS ID PAINT CHEMISTRY OF BERLIN WALL MURALS

SAPNet is a neural network developed by Italian scientists to enhance spectral data analysis from handheld Raman spectroscopy devices.