TLDR AI

TLDR AI 2023-12-06

5 sections17 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01HEADLINES & LAUNCHES

AI ALLIANCE LAUNCHES AS AN INTERNATIONAL COMMUNITY FOR SAFE AND OPEN AI

The AI Alliance, led by IBM and Meta, unites over 50 global organizations to foster open, responsible AI development. It focuses on setting AI standards, advancing hardware, and promoting AI education and skills. Members include major tech firms, universities, and research institutions. The Alliance emphasizes safety, diversity, and equitable access to AI innovation.

ai.meta.com5 min read

GOOGLE’S NEW AI EXPERIMENT COMPOSES ABSTRACT MUSICAL CLIPS INSPIRED BY INSTRUMENTS

Google's Instrument Playground allows users to create unique music pieces inspired by over 100 global instruments using MusicLM. Users can input an instrument name with an adjective for style and the AI generates a 20-second audio clip, which can be further customized with options like "Ambient," "Beat," and "Pitch" in a sequencer, allowing the creation and download of personalized musical compositions.

engadget.com2 min read

02RESEARCH & INNOVATION

LANGUAGE MODEL SELF-TEACHING FOR DOMAIN ADAPTATION

When trying to use language models in domains that require niche knowledge, you can either fine-tune or use some retrieval techniques. Both have drawbacks. This novel method uses self-generated synthetic data to better learn the information at test time. It shows marked improvements in standard adaptation benchmarks over both fine-tuning and RAG.

morph.so14 min read

TRACKING WITH 3D GAUSSIAN SPLATTING

Gaussian Splatting is an amazing method for 3D reconstruction. In this case, the scientists are working to remove COLMAP from their visual mapping and tracking systems. The results are compelling, though there is still some heavy computation that needs to happen.

spla-tam.github.io8 min read

03ENGINEERING & RESOURCES

DIFFUSION VISION TRANSFORMERS FOR HIGH-RESOLUTION IMAGE GENERATION

This project explores the effectiveness of vision transformers in diffusion-based generative learning, unveiling the Diffusion Vision Transformers (DiffiT). This model combines a U-shaped encoder-decoder architecture with a novel time-dependent self-attention module.

github.comGitHub repository

3D-CONSISTENT IMAGES FROM A SINGLE VIEW WITH DIFFUSION MODELS

This project presents Zero123++, a model that generates consistent multi-view images from just one input image using diffusion principles. By utilizing pretrained 2D models, Zero123++ addresses challenges like texture quality and alignment issues.

github.comGitHub repository

04MISCELLANEOUS

STYLE ALIGNED TEXT TO IMAGE GENERATION

Really stunning work by Google built on SDXL that shares attention for generations to maintain consistent styles. This method crucially doesn't require any fine-tuning.

style-aligned-gen.github.io7 min read

RESPONSIBLE INNOVATION LABS LAUNCHES FIRST PRO-INNOVATION RESPONSIBLE AI PROTOCOL FOR STARTUPS

Nonprofit Responsible Innovation Labs (RIL) has launched a voluntary industry-driven protocol for responsible AI, particularly for startups and their investors. The protocol, supported by 35 leading venture capital funds, is designed to ensure startups integrate responsible AI practices as they scale. This move aligns with the Biden Administration's vision for responsible AI.

rilabs.org4 min read

TWO TITANS ON THE FUTURE OF AI (WITH REID HOFFMAN AND VINOD KHOSLA)

A good recap of the 45+ minute talks between Reid Hoffman and Vinod Khosla with each diving into a variety of topics from AI to “techno-optimist” manifestos. Both titans have great perspectives on things to come and how the tech industry should be regulated.

newcomer.co4 min read