TLDR AI 2023-12-13

LLM.

In this recorded demo [5], you’ll hear from Gretel Co-Founder and Chief Product Officer, Alex Watson, and the rest of the product leadership team. Watch now to learn:

→ Gretel’s vision for the future of multi-modal synthetic data

→ Product demos including the new Model Playground and Tabular LLM

Register for free, on-demand access ↗️

PHI 2 AVAILABLE IN AZURE MODEL STUDIO

Phi 2 is the next generation in the series of tiny language models from Azure trained primarily on synthetic data. The 2.7B parameter model matches the performance of 13B parameter models. The challenge here is detecting and mitigating “test set rephrasing”, but in either case, the model is quite powerful.

OPENAI LEADERS WARNED OF ABUSIVE BEHAVIOR BEFORE SAM ALTMAN’S OUSTER

A group of senior leaders at OpenAI raising concerns to the board about Sam Altman's allegedly psychologically abusive behavior, which included creating chaos and pitting employees against each other, along with accusations of Altman's dishonesty in board communications, led to his brief firing. Altman's reinstatement followed overwhelming employee support and threats of mass resignations, but the incident has left uncertainties within the company and questions about its future direction.

MISTRAL PLATFORM

Mistral now has an API with new models, an embedding, and instruction-tuned models. It has an unreleased medium-sized model that outperforms GPT-3.5.

VISION-LANGUAGE MODELING WITH REDUCED GPU USAGE

Researchers have introduced Compound Text-Guided Prompt Tuning (TGP-T), a new method for Vision-Language Models like CLIP. TGP-T reduces GPU memory usage significantly while improving performance. It achieves this by optimizing prompts with text supervision, allowing more flexibility and efficiency in handling a variety of categories.

ENHANCING NERF TRAINING WITH IMAGE CORRESPONDENCE PRIORS

CorresNeRF introduces a novel approach to improve Neural Radiance Fields (NeRFs) performance, especially in scenarios with limited input views. By utilizing image correspondence priors for supervision, this method refines NeRF training, resulting in enhanced photometric and geometric accuracy.

ANOMALY DETECTION USING DIFFUSION MODELS

DiAD leverages the power of diffusion models to detect anomalies. It uniquely combines a pixel-space autoencoder, a Semantic-Guided (SG) network, and a feature-space extractor to accurately detect and localize anomalies in multi-class settings.

MAKING 3D EDITING EASIER WITH 2D IMAGE PROCESSING

AGAP is a new method that simplifies 3D editing. By using a 2D image, called a canonical image, AGAP allows users to easily edit 3D scenes without re-optimizing for each change.

ENHANCING TEXT-PROMPTED 3D CONTENT CREATION

Sherpa3D is a groundbreaking framework that improves 3D content creation from text prompts. It combines the strengths of 2D and 3D diffusion models, using coarse 3D knowledge to guide the creation process. This results in high-quality, diverse, and geometrically consistent 3D assets, overcoming the limitations of existing methods.

ACCELERATING NEURAL VOLUMETRIC VIDEO RESEARCH

EasyVolcap is a PyTorch library for accelerating neural volumetric video research, particularly in areas of volumetric video capturing, reconstruction, and rendering.

INTEROPERABLE AUTHENTICATION PROTOCOL

Coordinating communication between language models and users is key given how fast model capabilities are advancing. The Interoperable Authorization Protocol (IAP) aims to address this by establishing secure, adaptable communication channels and a consent management system. This open-source approach encourages collaboration in the AI community to align AI operations with diverse human values and goals.

MIT GROUP RELEASES WHITE PAPER ON GOVERNANCE OF AI

A committee of MIT leaders and scholars has released policy briefs providing a framework for U.S. AI governance, advocating the extension of existing regulatory and liability approaches to oversee AI effectively. Their proposal aims to enhance U.S. leadership in AI, minimize potential harms, and encourage beneficial AI applications, emphasizing the need for a clear purpose and intent definition in AI tools and suggesting possible new oversight structures.

ON PLATFORM SHIFTS AND AI

In the 2022 TCV Engage Summit, the conversation highlighted that while AI represents a technological shift, it lacks a new distribution channel, which is crucial for creating significant consumer opportunities. Current AI innovations must rely on traditional distribution methods, favoring established companies or innovative startups, but the potential for new distribution platforms remains uncertain.

GOOGLE WEIGHS GEMINI AI PROJECT TO TELL PEOPLE THEIR LIFE STORY USING PHONE DATA, PHOTOS

Google's "Project Ellmann" proposes using AI to analyze mobile data like photographs and searches, creating a detailed "bird's-eye" narrative of users' lives, although its integration into existing products like Google Photos remains uncertain.

OLLAMA MULTIMODAL PRE-RELEASE (GITHUB RELEASE)

Ollama is an amazingly simple way to use modern language models. It is adding multimodal support with models like Llava.

RESPELL (PRODUCT)

Automate knowledge work using AI workflows and agents.

YOUR REFERRAL LINK - https://tldr.tech/ai?ref=2613930