The Daily Index — Thursday, November 30, 2023 · TLDR Index

HEADLINES & LAUNCHES

TLDR AI

TLDR AI

AMAZON LAUNCHES Q GENERATIVE ASSISTANT

Amazon trained a generative model to assist users of the AWS platform. It will also be used for generic business assistance. The model is a private system that answers user queries about various aspects of Amazon's backend tooling.

aws.amazon.com · 3 min

TLDR AI

VOLTAGE PARK LAUNCHED H100 MEGA CLUSTER

Powering workflows for customers like Character AI, Voltage Park is a new cloud provider with a 24k H100 mega cluster. Its pricing seems to be industry-leading at less than $2/hour per GPU.

blog.voltagepark.com · 1 min

TLDR AI

IMPROVED VIDEO MOMENT RETRIEVAL AND HIGHLIGHT DETECTION

UVCOM is a new framework that better handles the distinct requirements of Video Moment Retrieval (MR) and Highlight Detection (HD).

arxiv.org · 16 min

TLDR AI

DEEPSEEK LLM EVALUATION

Deepseek coder was an amazing model that reached amazing code synthesis performance. It now has a 67B parameter chat LLM that dramatically outperforms Llama 2 70B.

github.com · 4 min

TLDR AI

NEW LIGHT-BASED CHIPS OFFER 3X MORE COMPUTER PER WATT THAN GPUS

This recent paper published in Nature details a CNN trained for classification that processes each frame in just 72ns and uses far fewer watts than traditional computer systems. With the recipe of AI continuing towards more FLOPs, more data, and larger models - these chips might be necessary to reach future levels of performance.

nature.com · 35 min

TLDR AI

LLAMAFILE, BUILD ONCE RUN ANYWHERE

llamafile is a combination of llama.cpp and Cosmopolitan libc. This means that you can target essentially any CPU on any OS and bundle your model in a single executable file.

github.com · 4 min

TLDR AI

GETTING STARTED WITH LLAMA

This is a blog post from Meta outlining how to use its llama language model. The guide includes fine-tuning and deployment advice.

ai.meta.com · 12 min

TLDR AI

PREDICTING DRIVING SCENARIOS IN 3D

OccWorld, a self-supervised AI model, is designed to predict future driving scenarios by understanding and forecasting the movements of surrounding agents and map elements in 3D.

wzzheng.net · 4 min

TLDR AI

CHATGPT’S TRAINING DATA CAN BE EXPOSED VIA A “DIVERGENCE ATTACK”

Research reveals that large language models, including ChatGPT, can memorize and inadvertently reveal specific training data, highlighting privacy concerns, particularly in larger models.

stackdiary.com · 7 min

TLDR AI

WHAT YOU’RE FEELING IS SHINY OBJECT SYNDROME

The hype around OpenAI's rumored AI breakthrough, Q*, highlights the tech community's tendency to rapidly shift focus and speculate on the next big advancement in AI, often with limited information, exemplifying the "Shiny Object Syndrome."

thealgorithmicbridge.substack.com · 10 min

TLDR AI

IN THE AGE OF AI, GOOGLE EXPERIMENTS WITH BOLD CHANGE TO SEARCH

Google Search is being upended by AI and it can only blame itself for sitting on tech it has had for years. That aside, integrations with the next generation of AI tooling are springing up across Google’s suite of tools and are set to make a significant impact.

bigtechnology.com · 2 min

TLDR AI

DATAIKU ANNOUNCES DATABRICKS AS LATEST LLM MESH PARTNER

Dataiku and Databricks are collaborating to further the reach and capability of Dataiku's LLM Mesh Partner Program. The partnership aims to create a simpler way to achieve generative AI-driven business transformations while allowing the enterprise to capitalize on the immense potential of LLMs.

dataiku.com · 3 min

TLDR AI

WINN.AI (PRODUCT)

Winn.AI handles all of your sales busywork so you can type less and win more.

winn.ai

TLDR AI

AI TRANSLATION TOOLS HELP SINGERS BREAK DOWN BORDERS

YouTube, Mr. Beast, and a South Korean label are using AI to dub video content into various languages, though the cost is seen as high by some creators.

semafor.com · 2 min