Probabilistic Language-Image Pre-training (ProLIP) is a vision-language model (VLM) that learns from image-text pairs probabilistically. Unlike traditional models that assume a strict one-to-one match, ProLIP captures the many-to-many relationships in real-world data.
Meta has launched an open-source multimodal language model designed to integrate text and speech inputs and outputs with expressive, natural-sounding speech capabilities. Meta Spirit LM aims to outperform existing voice AI by using phonetic, pitch, and tone tokens to enhance emotional expression and maintain natural expressiveness in tasks like ASR, TTS, and speech classification.
This article outlines a 14-day learning roadmap to understanding LLM fundamentals that covers topics like self-attention, hallucination, and advanced techniques like Mixture of Experts. It includes resources on building an LLM from scratch, various literature, and online materials, all compiled in a GitHub repository. The article emphasizes a personalized learning approach and highlights the importance of foundational math, programming, and deep learning concepts.
IBM is expanding its enterprise AI offerings with the new Granite 3.0 LLMs, focusing on open-source solutions and performance. These models, available on multiple platforms, include safety features and are tailored for various enterprise use cases. IBM emphasizes the importance of real open-source licensing with Apache 2.0 to enable flexible enterprise adoption and innovation.
Microsoft is launching autonomous AI agents to enhance productivity, allowing businesses to build custom bots for tasks like customer service and supply chain management.
Join Professor Hannah Fry as she interviews some of the leading voices in artificial intelligence. From recent Nobel winner, Demis Hassabis, to the legendary Jeff Dean, this series covers everything you're curious about, including the early days of Google, recent breakthroughs in GenAI, Astra, and AlphaFold, or more pressing questions like _how human should an AI assistant be?_
One of the best efforts at multilingual language model training, the Aya project has grown substantially since its launch earlier this year. Most of the gains in performance have come from strong post training recipes. It also processes audio input and can generate images all from non-English input.
Jacob Collier, a Grammy-winning musician, has teamed up with Google DeepMind and Google Labs to create MusicFX DJ, an AI-powered music tool. The interface has been redesigned to encourage creativity and help users easily enter a "flow state" of artistic inspiration. MusicFX DJ is available now, offering intuitive controls for all skill levels.
Meta has quantized its 1B and 3B language models to be 2-4x faster at minimal loss of quality while being 50%+ smaller. This was enabled by its quantization-aware training setup, which allows for models to adjust to the small precision.
QA Wolf (4.8 ⭐ on G2) [13] brings AI-level scale and efficiency to testing, with unlimited parallel test runs on their cloud infrastructure and a zero-flake guarantee.
ExecuTorch enables on-device inference on mobile and edge devices including wearables, embedded devices, and microcontrollers. It also enables efficient deployment of PyTorch models to edge devices. ExecuTorch is compatible with a wide variety of computing platforms and it can fully utilize hardware capabilities such as CPUs, NPUs, and DSPs. Step-by-step tutorials on how to use ExecuTorch are available.
Federated Transformer (FeT) is a new framework designed to improve the performance and privacy of Vertical Federated Learning (VFL) across multiple parties.
This author used a simple feedforward DNN model to track and predict weight loss on a ketogenic diet. The model captured the non-linear weight loss pattern, fit a function to the data, and visualized calorie metrics. The Harris-Benedict Equation was used to compare calorie needs to real weight loss for better insights.
Google Gemini's AI Studio can successfully extract numerical data from a video screen recording of emails. The process involves using the inexpensive Gemini 1.5 Flash model and incurs almost no cost. This novel "video scraping" approach offers a practical alternative to traditional data extraction methods.
The AI boom is driving significant US investment in data centers, computing infrastructure, and advanced hardware, with data center construction reaching a record-high $28.6 billion annually. This surge is fueled by the growing demand for powerful computing resources necessary for training and deploying advanced AI models. While revenue rebounds in the tech sector, job growth remains concentrated in semiconductor manufacturing and infrastructure, diverting focus from traditional programming roles.
The world's smartest companies use Redis as the foundation of their AI infrastructure. Find out how they're building with Redis for AI and more at Redis Released: Worldwide—a virtual event [4] for anyone building the fast apps our world runs on.
OpenAI has released some work discussing improvements to consistency models (which generate in two steps as opposed to 1,000 for diffusion). They still rely on distillation from an existing diffusion model, but this work aims to improve and stabilize them as they scale.
SynthID is a way to statistically watermark generated text. It uses a pseudorandom function after top-k and top-p in the sampling process to mark text. Then you can use a probabilistic bayesian method to detect if text has been watermarked - meaning it was generated by a language model.
Transformers JS is a JavaScript library for running models. It now uses WebGPU, which is up to 1,000x faster in some cases. The new version has 1,200+ models ready to use for edge and browser-based applications.
Salesforce's new method uses a novel encoder for video that requires substantially fewer tokens for proper representation. This has been tried a number of times in the past with minimal success, the key seems to be an explicit temporal encoder along with a spatial encoder.
Ever find yourself thinking “I wish I could turn this prompt into an automation”? Now, anyone on your team can: Bardeen is an AI agent [11] that helps companies like Deel, Miro, and Slack stay on top by fully automating sales prospecting, marketing ops, demand generation, and much more. All it takes is a single prompt. Book an exploratory
TALoS is a method that improves scene completion for autonomous vehicles by using observations made at different moments as supervision for predictions.
Anthropic's Alignment Science team developed evaluations to test AI models' potential for sabotage, including human decision sabotage, code sabotage, sandbagging, and undermining oversight. These evaluations aim to identify dangerous capabilities in future AI systems and inform necessary safety mitigations. Their findings suggest minimal risks with current models but highlight the need for more robust evaluations and safeguards as AI capabilities advance.
Microsoft's research paper on AI robustness prompted the company to invest billions in AI infrastructure, catalyzing breakthroughs with partners like OpenAI. This investment has significantly boosted Microsoft's growth in AI-driven products, exemplified by GitHub Copilot's success. Despite challenges from competition and sustainability goals, Microsoft continues to prioritize AI, with record capital spending on its AI and cloud infrastructure.
In this article, Cloudflare CEO Matthew Prince discusses AI's impact on internet infrastructure, highlighting the need for AI-capable edge computing and local inference to reduce network latency. He emphasizes the importance of regionalization in AI services due to regulatory complexities and outlines Cloudflare's approach to building a connectivity-focused network. Cloudflare aims to make internet connectivity faster, more secure, and more efficient, aligning closely with AI advancements.