TLDR AI 2023-11-30

TOGETHER AI RAISES $102M SERIES A

Led by Kleiner Perkins, this round will help boost the training and inference products that have seen massive adoption since Together’s launch in June.

AMAZON LAUNCHES Q GENERATIVE ASSISTANT

Amazon trained a generative model to assist users of the AWS platform. It will also be used for generic business assistance. The model is a private system that answers user queries about various aspects of Amazon's backend tooling.

VOLTAGE PARK LAUNCHED H100 MEGA CLUSTER

Powering workflows for customers like Character AI, Voltage Park is a new cloud provider with a 24k H100 mega cluster. Its pricing seems to be industry-leading at less than $2/hour per GPU.

IMPROVED VIDEO MOMENT RETRIEVAL AND HIGHLIGHT DETECTION

UVCOM is a new framework that better handles the distinct requirements of Video Moment Retrieval (MR) and Highlight Detection (HD).

DEEPSEEK LLM EVALUATION

Deepseek coder was an amazing model that reached amazing code synthesis performance. It now has a 67B parameter chat LLM that dramatically outperforms Llama 2 70B.

NEW LIGHT-BASED CHIPS OFFER 3X MORE COMPUTER PER WATT THAN GPUS

This recent paper published in Nature details a CNN trained for classification that processes each frame in just 72ns and uses far fewer watts than traditional computer systems. With the recipe of AI continuing towards more FLOPs, more data, and larger models - these chips might be necessary to reach future levels of performance.

➡️_YOU CAN SIGN UP FOR FREE HERE…_

LLAMAFILE, BUILD ONCE RUN ANYWHERE

llamafile is a combination of llama.cpp and Cosmopolitan libc. This means that you can target essentially any CPU on any OS and bundle your model in a single executable file.

GETTING STARTED WITH LLAMA

This is a blog post from Meta outlining how to use its llama language model. The guide includes fine-tuning and deployment advice.

PREDICTING DRIVING SCENARIOS IN 3D

OccWorld, a self-supervised AI model, is designed to predict future driving scenarios by understanding and forecasting the movements of surrounding agents and map elements in 3D.

CHATGPT’S TRAINING DATA CAN BE EXPOSED VIA A “DIVERGENCE ATTACK”

Research reveals that large language models, including ChatGPT, can memorize and inadvertently reveal specific training data, highlighting privacy concerns, particularly in larger models.

WHAT YOU’RE FEELING IS SHINY OBJECT SYNDROME

The hype around OpenAI's rumored AI breakthrough, Q*, highlights the tech community's tendency to rapidly shift focus and speculate on the next big advancement in AI, often with limited information, exemplifying the "Shiny Object Syndrome."

IN THE AGE OF AI, GOOGLE EXPERIMENTS WITH BOLD CHANGE TO SEARCH

Google Search is being upended by AI and it can only blame itself for sitting on tech it has had for years. That aside, integrations with the next generation of AI tooling are springing up across Google’s suite of tools and are set to make a significant impact.

DATAIKU ANNOUNCES DATABRICKS AS LATEST LLM MESH PARTNER

Dataiku and Databricks are collaborating to further the reach and capability of Dataiku's LLM Mesh Partner Program. The partnership aims to create a simpler way to achieve generative AI-driven business transformations while allowing the enterprise to capitalize on the immense potential of LLMs.

WINN.AI (PRODUCT)

Winn.AI handles all of your sales busywork so you can type less and win more.

AI TRANSLATION TOOLS HELP SINGERS BREAK DOWN BORDERS

YouTube, Mr. Beast, and a South Korean label are using AI to dub video content into various languages, though the cost is seen as high by some creators.