The Daily Index — Tuesday, September 19, 2023 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

GLOOM

Databricks has secured over $500 million in a Series I round, boosting its valuation to $43 billion. Noteworthy investors include T. Rowe Price, Morgan Stanley, and Nvidia. Despite wider market funding slowdowns, Databricks' strong revenue growth and run rate suggest an eventual IPO could exceed its current valuation.

techcrunch.com · 3 min

TLDR AI

NEW LANGUAGE MODEL OBJECTIVE TRAINS FASTER WITH TIED EMBEDDINGS

Typically with language models, the input and output embedding layers are tied together. However, if you tie the input embedding to other embeddings within the model, and use a contrastive loss, you can get dramatically improved performance both in wall clock and final benchmark accuracy.

arxiv.org · 27 min

TLDR AI

FINE-TUNING VISION TRANSFORMERS MORE EFFICIENTLY

Fine-tuning pre-trained vision models for specific tasks often requires a lot of extra computing power. Researchers have come up with a method called "Salient Channel Tuning" (SCT) that smartly picks which parts of a model to fine-tune, using way fewer extra settings and still outperforming other methods in almost all tested tasks.

arxiv.org · 29 min

TLDR AI

WHEN LLMS MEET EXTERNAL INFO

Large language models like GPT-3 are smart because they learn from a ton of data, but how do they react when new information conflicts with what they already know? Researchers have found that these models can get confused and give wrong answers, especially when they face conflicting or distracting info, raising concerns about how reliable they can be.

arxiv.org · 23 min

TLDR AI

WHY OPEN SOURCE AI WILL WIN

Open source AI models have significant advantages over proprietary models. For most AI applications, controllability, customizability, transparency, and trust are more important than advanced reasoning abilities. AI-native companies should focus on owning their core models rather than outsourcing their intelligence layer to external providers.

varunshenoy.substack.com · 5 min

TLDR AI

BLENDING 2D AND 3D FOR IMAGE CREATION

Researchers have found a way to make 2D and 3D technologies work together seamlessly for better and more flexible designs.

obukhov.ai · 3 min

TLDR AI

ROBUST E-NERF: BETTER 3D MODELS

Event cameras have some cool benefits like low power use and quick response times, but they struggle with creating detailed 3D models of scenes. Researchers have introduced Robust e-NeRF, a new method that makes these cameras much better at building 3D models, even in challenging conditions like fast motion or varying light.

wengflow.github.io · 4 min

TLDR AI

IT’S TOO EARLY TO REGULATE AI

This article makes the argument that we should wait to regulate AI, as regulation frequently results in reduced competition and production, economic benefits moving overseas, and a government-centric instead of a user-centric industry.

blog.eladgil.com · 10 min

TLDR AI

WHY AI CAN’T MAKE HUMAN CREATIVITY OBSOLETE

Despite concerns that AI would render human creativity obsolete, we continue to appreciate human endeavors, like chess, even when AI performs better. This paradox arises because humans value imperfection, surprises, and shared experiences, which AI, with its constant optimization, cannot replicate.

thealgorithmicbridge.substack.com · 6 min

TLDR AI

GE IS WORKING ON AI-POWERED ULTRASOUNDS

GE Health is set to create an AI-assisted ultrasound imaging tool designed for easy use by healthcare providers without specialized training. The device aims to improve medical imaging and will primarily focus on maternal, fetal, and pediatric lung health to address preventable maternal and child mortality.

engadget.com · 1 min