TLDR AI

TLDR AI 2023-11-14

6 sections20 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

AND SO CAN YOU

Anyscale [5] is the company behind the open-source framework called Ray, used by the world’s leading AI teams.

anyscale.comSponsor

02HEADLINES & LAUNCHES

NVIDIA IS LAUNCHING A NEW MUST-HAVE AI-CHIP

Nvidia is launching the HGX H200, an advanced AI chip with significantly more memory bandwidth and capacity than its predecessor, the H100. Availability remains uncertain as Nvidia works with partners for its 2024 release.

theverge.com2 min read

XBOX PARTNERS WITH INWORLD AI TO BUILD GENERATIVE AI TOOLS FOR GAME DEVELOPMENT

Xbox and Inworld AI are collaborating to create AI-powered tools to help enrich the narrative and character creation elements in game development. The partnership will develop an AI design copilot to assist game designers and an AI character runtime engine for an immersive gaming experience. They anticipate these tools will foster limitless creativity, enhance immersion, and expedite game production.

inworld.ai4 min read

03RESEARCH & INNOVATION

GENERALIZED BIOMOLECULAR MODELING AND DESIGN WITH ROSETTAFOLD ALL-ATOM

Advances in AI, including AlphaFold, have significantly increased the rate of progress in science. This study presents RoseTTAFold All-Atom, a neural network that can model a wide range of molecules beyond proteins including drugs, vitamins, DNA, and sugars. The authors validate their architecture by fine-tuning it into a diffusion model and experimentally validating new-to-nature molecules designed from minimal prompts across many applications.

biorxiv.org45 min read

TRAINING LANGUAGE MODELS ON LOW RESOURCE LANGUAGES

This paper introduces FinGPT, a language model trained on Finnish. The researchers who created it found that data repetition with some tricks produced extremely smooth loss curves. This may serve as an easy fix for underrepresented languages on the internet.

arxiv.org22 min read

04ENGINEERING & RESOURCES

OPENGPTS

An open-source project building upon LangChain, LangServe, and LangSmith that offers customizable language models, prompts, tools, vector databases, retrieval algorithms, and chat history databases. It features a sandbox environment, custom actions, and analytics for enhanced user control similar to OpenAI's GPTs.

github.comGitHub repository

ENHANCEMENTS TO LLAMA WITH TAMIL TOKENS

The enhanced LLaMA model now includes 16,000 Tamil tokens, leveraging the LoRA methodology for efficient training. This update, along with new Tamil versions of Alpaca and OpenOrca datasets, has notably improved Tamil text processing, paving the way for future advancements in Indian language AI.

github.comGitHub repository

05MISCELLANEOUS

NVIDIA AND MIT RESEARCHERS IMPROVE HOW HARDWARE HANDLES SPARSITY

Sparse tensors occur when some values of the neural network are zeros. These values can efficiently be skipped. Researchers developed a way to quickly find when values are zero and overload hardware to fit more non-zero values onto a chip at a time.

news.mit.edu8 min read

AI AND OPEN SOURCE IN 2023

A comprehensive review of the major developments in the AI research, industry, and open-source space that happened in 2023.

magazine.sebastianraschka.com15 min read