Search the archive

STYLETTS 2

StyleTTS 2 is a text-to-speech model designed to achieve human-level speech synthesis by combining style diffusion and adversarial training with large speech language models.

NEURAL-CHERCHE

Neural-Cherche is a library designed to fine-tune neural search models such as Splade, ColBERT, and SparseEmbed on a specific dataset.

A LIST OF RESOURCES FOR DATA ENGINEERS

This repo has resources that you may need as a data engineer.

OPENAI’S IDENTITY CRISIS AND THE BATTLE FOR AI’S FUTURE

From governance matters to public safety, leadership changes at OpenAI prompt a lot of questions. This blog post breaks down some of the core elements we should be thinking about.

A DATA-DRIVEN LOOK AT THE RISE OF AI

Former Atlassian CTO and current managing director of Coatue Ventures Sri Viswanath delivered a deep look at the state of artificial intelligence. It’s a 117-page document, but this blog nicely summarizes the highlights.

AI: THE COMING REVOLUTION

Sri Viswanath and the team at Coatue studied how AI is beginning to impact the tech ecosystem, the modern tech stack, and our broader economy. This paper highlights four key considerations: AI has the potential to break through the hype and meaningfully improve our world, open source is the heartbeat of AI, builders and investors need to understand the new AI-centric tech stack, and the best of AI is yet to come.

TENSORLI

Minimalistic interpretation of a GPT-like transformer using only Numpy.

DISCORD IS SHUTTING DOWN ITS AI CHATBOT

Discord is shutting down Clyde, its experimental AI chatbot.

OPENAI PAUSES CHATGPT PLUS SIGNUPS

OpenAI is pausing ChatGPT Plus sign-ups due to a surge in demand.

REGISTER FOR THE FREE WEBINAR TO LEARN MORE

DEEPMIND AND YOUTUBE PARTNER ON MUSIC SYNTHESIS

DeepMind has been working on music synthesis for a number of years and now just announced a powerful new system. Interestingly, much of the boost came from a data partnership with revenue sharing. Meaning it trained on artists’ music for a better performing model while ensuring that the artists were compensated. The model will be available in a number of forms, one of which is via YouTube Shorts Studio.

META ANNOUNCES VIDEO EDITING AND CREATION MODELS

Oftentimes when you generate an output image with a generative model, it isn’t quite what you were looking for. However, editing that image with the same model is extremely challenging. Meta had a key insight that treating all generations as instructions allows editing capabilities to emerge. This, coupled with the new simplicity of the model architecture, is quite a nice step forward.

MICROSOFT LAUNCHES A DEEPFAKE CREATOR

Microsoft launched Azure AI Speech text-to-speech avatar at the Microsoft Ignite 2023 event, allowing users to create photorealistic avatars that can speak scripted text in various languages using text-to-speech technology.

SENTENCE ALIGNMENT FOR LARGE DOCUMENTS

SentAlign is a new tool for aligning sentences in large parallel documents, capable of handling thousands to tens of thousands of sentences efficiently.

IMPROVING VIDEO QUESTION ANSWERING WITH A NEW METHOD

Researchers found that Large Language Models sometimes make errors in Video Question Answering (VideoQA) by depending too much on the language and ignoring the actual video content. To solve this, researchers introduced a new approach called Flipped-VQA, which makes these models better understand the relationship between videos, questions, and answers, leading to more accurate results.

A DATASET TO UNDERSTAND STUDENT BEHAVIOR

Researchers have expanded the SCB-ST-Dataset4, which captures activities like hand-raising, reading, and writing to better understand and detect students' classroom behaviors using deep learning.

the free sandbox

tools. Packages? Credits? Tokens? Whichever model you choose, Orb

makes it as easy as can be to implement — just choose your pricing model and billable [12] metric and you’re done! Track consumption, prevent fraud, and align pricing to value (including GPU runtime). Try

DEEP DIVE: DEVELOPER’S GUIDE TO PRODUCTION LLMS

Building tools with language models is an emerging engineering discipline that spans high performance computing, GPU orchestration, and monitoring.

ACCELERATING SEGMENT ANYTHING WITH PURE PYTORCH

AI EXPLOITS

A collection of real-world AI/ML exploits for responsibly disclosed vulnerabilities.

MUSIC CONTROLNET

ControlNet was a novel way to give fine-grained control to image synthetics models. Now there is a somewhat analogous model for music generation that lets you control a number of features like speech and pitch.

THERE’S A MODEL FOR DEMOCRATIZING AI

OpenAI's call for proposals on implementing democratic processes in AI decision-making appears restrictive and seems to prefer handling sensitive political issues without taking responsibility, potentially limiting the scope and effectiveness of democracy in AI governance.

COPILOT IS AN INCUMBENT BUSINESS MODEL

The Copilot AI business model enhances existing workflows for efficiency without creating new markets or disrupting lower ends, but its true disruptive potential lies in reimagining workflows, a challenge that could unlock significantly larger market opportunities.

GOOGLE IS EMBEDDING INAUDIBLE WATERMARKS RIGHT INTO ITS AI GENERATED MUSIC

Google DeepMind's AI Lyria model will use SynthID to watermark audio tracks generated using its technology, making them identifiable as AI-created without affecting the listening experience, even after compression or other modifications.

GPT-4 TURBO NOTE TAKER (PRODUCT)

Let AI automate your meeting notes using GPT-4 Turbo.

YOUTUBE WILL SHOW LABELS ON VIDEOS THAT USE AI

YouTube is implementing new guidelines requiring creators to disclose the use of AI in their videos, including both AI-altered and entirely synthetic content.

performance at masterworks.com/cd

waitlist to join with this exclusive link.

Investing involves risk and past performance is not indicative of future returns. See important Reg A disclosures and aggregate advisory

MICROSOFT IS MAKING CUSTOM AI CHIPS

Microsoft has developed its own custom AI chip, Azure Maia AI, and an Arm-based CPU for Azure data centers, Azure Cobalt, aiming to reduce reliance on Nvidia and prepare for an AI-driven future. The chips are set to launch in 2024.

GOOGLE’S GENERATIVE SEARCH ROLLED OUT TO 120 MORE COUNTRIES

Google’s Search Generative Experience (SGE) is slowly being made available to more countries in many languages after debuting earlier this year. The company is taking a slow and measured pace to this release as it touches many of its key search systems.

GOOGLE'S AI-POWERED SEARCH FEATURE GOES GLOBAL

GitHub's Copilot X revolutionizes software development by embedding AI in every stage. The new Copilot Chat, powered by GPT-4, enables natural language coding. It arrives in December 2023. Copilot Enterprise, tailored for organizational codebases, will launch in February 2024. Enhanced AI security features and the expanding Copilot Partner Program further enrich GitHub's offerings.

DIRECT PREFERENCE OPTIMIZATION IMPROVES MODEL FACTUALITY

Optimizing models according to preferences was one of the breakthroughs that enabled the widespread adoption of ChatGPT. Similar technologies can also be used to improve the correctness and factuality of models, reducing errors in medical recall by over 50%.

OBJECT DETECTION ON SMART GLASSES

This team created a new RISC-V hardware designed for vision and trained an ultra-small YOLO computer vision model which enables real-time object detection at low power and extremely low latency.

Read the blog [12] or use MockGPT for free

DEEPMIND WEATHER FORECASTING MODEL WITH WEIGHTS

DeepMind has been working on weather forecasting for a few years now. Its most recent model, built on graph neural networks, is extremely accurate for 10-day forecasts. DeepMind released code and weights so you can run it locally (if you have satellite data).

QWEN AUDIO

Qwen is a series of models from Alibaba Cloud. This installment is a general-purpose audio-to-language model. It can perform a number of tasks for music, speech, and more.

VIDEO FRAME INTERPOLATION WITH DISTANCE INDEXING

RUNNING LLMS ON A RASPBERRY PI

Someone recently put Mistral’s 7B model into a stuffed parrot and it made the rounds online. This post dives into the basic ideas they used to get it working.

THE FUTURE OF MUSIC: HOW GENERATIVE AI IS TRANSFORMING THE MUSIC INDUSTRY

AI-generated music could be the future of what we consume or what helps us shape our listening habits - this could potentially be music’s “Midjourney moment”.

AI DOOMERS ARE FINALLY GETTING SOME LONG OVERDUE BLOWBACK

Those who said AI would doom us all are now having to revisit their positions. “AI doom” really only helped the big guys, and opportunities abound for the open source movements happening in AI.

VOCAI CHATBOT (PRODUCT)

Resolve 80% of your customer support questions with no code.

DEEPMIND’S ANIMATION GALLERY

Google’s deepmind research group has released a number of animations and art to build an understanding of different AI systems. The animations are somewhat odd but aesthetically beautiful.

LLM SHERPA

LLM Sherpa provides strategic APIs to accelerate large language model use cases.

Start on the free tier to explore the latest Intel® AI tools

Intel® Developer Cloud [5] accelerates your AI development with Intel®-optimized software on the latest Intel® Xeon® processors and GPU compute.