Google released and teased a few open source models in its launch today. One actually-released model is a vision language model based on SigLIP. It is extremely easy to tune and extend to a variety of tasks. This Colab Notebook shows how to do so with clean, readable code.
2024.05.15·colab.research.google.com·TLDR AI Elon Musk's AI startup xAI is negotiating a potential $10 billion deal to rent cloud servers from Oracle, aiming to become one of Oracle's largest customers and rival AI offerings from OpenAI and Google.
2024.05.15·bit.ly·1 min read·TLDR AI Gemini Flash is a new lightweight model from Google that features multimodal reasoning and a long context window of up to one million tokens.
2024.05.15·deepmind.google·Tool·TLDR AI Veo is a new video generation AI model from Google Deepmind that can generate 1080p resolution videos that can go beyond a minute long.
2024.05.15·deepmind.google·Tool·TLDR AI Sponsored
What do high-growth AI companies like Perplexity, Jasper, Cursor, and Copy.ai have in common?
2024.05.14·workos.com·Sponsor·TLDR AI OpenAI has announced a new model called GPT-4o (o is for omni) that is a natively multimodal model, with superior performance to GPT-4 on text and state-of-the-art performance on a variety of modalities. It also announced a new desktop app, a near real-time audio interface, and a variety of improved reasoning features.
2024.05.14·links.tldrnewsletter.com·12 min read·TLDR AI IBM is releasing its Granite code models, which range from 3 to 34 billion parameters and cover a variety of programming tasks, to the open-source community to facilitate easier and more efficient coding across numerous platforms.
2024.05.14·research.ibm.com·6 min read·TLDR AI Apple is nearing an agreement with OpenAI to integrate ChatGPT technology into the iPhone, potentially featuring it in the upcoming iOS 18 as part of its AI enhancements.
2024.05.14·9to5mac.com·1 min read·TLDR AI Simulators can be powerful tools in AI for collecting training data or for model learning interactions. This simulator can be used to model different atomic interactions across a variety of elements.
2024.05.14·arxiv.org·30 min read·TLDR AI Researchers have developed a new method for creating scene graphs, making it faster and more efficient. Their transformer-based technique focuses on improving the way the model understands and connects different elements in an image, leading to better performance on challenging tasks.
2024.05.14·arxiv.org·18 min read·TLDR AI InternLM-XComposer2 is a vision-language model that excels in creating and understanding complex text-image content. It introduces a Partial LoRA approach for a balanced vision and text comprehension, outperforming existing models in multimodal content creation and understanding.
2024.05.14·arxiv.org·11 min read·TLDR AI Sponsored
For enterprises, there's a lot on the line [11] with genAI. It has immense potential for new revenue, cost savings, and improved products; but there are many risks and unknowns that need to be mitigated to avoid disaster. This white paper by Domino [11] covers toolsets, processes, and actionable steps to get started with
2024.05.14·domino.ai·Sponsor·TLDR AI A framework for building voice (and multimodal) conversational agents.
2024.05.14·github.com·GitHub repository·TLDR AI MRSegmentator is a new tool designed to enhance MRI scan segmentation, effectively identifying 40 different organs and structures across the abdominal, pelvic, and thorax regions.
2024.05.14·github.com·GitHub repository·TLDR AI The Time-Evidence Fusion Network (TEFN) is a novel deep learning model designed to enhance long-term time series forecasting. It combines information fusion and evidence theory, utilizing a specialized module to improve prediction accuracy and stability.
2024.05.14·github.com·GitHub repository·TLDR AI 5M novel captions based on the alt-text and images of a portion of the COYO dataset.
A model designed to browse the web and answer questions accordingly. This could be used to synthesize a high-quality pretraining dataset or perform research that requires querying information from a web page.
2024.05.14·github.com·GitHub repository·TLDR AI AI tools like GPT-4 are increasingly assisting and even outperforming academics in tasks like writing research papers. Liang et al. found up to 18% of papers in some fields are AI-assisted. This integration of AI could create a loop where software both generates and reviews academic publications. However, the impact on scientific progress is nuanced - it could potentially enable more productivity but there is also a risk of a phase where more is produced with less understanding.
2024.05.14·lemire.me·4 min read·TLDR AI Sponsored
Sourcing data to train or fine-tune AI models is complicated. Use TrainAI's checklist of 20 must-ask questions [19] to find the right data partner for your AI project.
Create and edit diagrams and docs using natural language prompts that output diagram code.
OpenAI has launched a detection tool to identify images generated by its DALL-E 3 model as part of an effort to address concerns about AI-generated fake content and enhance digital content authenticity by incorporating C2PA standards.
2024.05.14·qz.com·2 min read·TLDR AI Microsoft is updating Copilot for Microsoft 365 with new features like auto-complete and prompt elaboration to enhance prompt creation for generative AI alongside a new "Catch Up" chat interface and customizable prompt management in Copilot Lab.
2024.05.14·theverge.com·2 min read·TLDR AI Sponsored
It seems like everyone is jumping into GenAI. But when training your LLM, how do you build for accurate, up-to-date responses ❓🤔
2024.05.13·neo4j.com·Sponsor·TLDR AI What are you waiting for? GenAI is moving quickly...and so should you!
OpenAI has announced a live stream event scheduled for May 13 to present updates related to ChatGPT and GPT-4, possibly including the launch of an AI-powered search engine.
2024.05.13·9to5google.com·1 min read·TLDR AI Command R fine-tuning offers industry-leading performance at a fraction of the cost. Command R with fine-tuning consistently outperforms larger models across key performance metrics that matter most for businesses. Command R fine-tuning is immediately available for businesses and developers on Cohere's platform and Amazon Sagemaker.
2024.05.13·cohere.com·4 min read·TLDR AI Altera is building digital human beings, starting with agents who can play any game with you, just like a friend. The company raised $9 million in an oversubscribed seed round, co-led by First Spark Ventures (Eric Schmidt's deep-tech fund) and Patron (the seed-stage fund co-founded by Riot Games alums).
2024.05.13·techcrunch.com·4 min read·TLDR AI Salesforce has trained and released the 3rd non-commercial version of the popular BLIP models, vision and language models mainly used for image understanding and captioning.
2024.05.13·huggingface.co·7 min read·TLDR AI Language models rely on separately trained tokenizers. These may produce tokens that are never seen during language model training. There are many in even the most powerful modern language models. This paper explores this phenomenon and presents their findings for identifying and dealing with these tokens.
2024.05.13·arxiv.org·30 min read·TLDR AI Hazy research has introduced a new DSL for writing CUDA kernels. It has written flash attention, which is 30% faster and fits in only 100 lines of code.
2024.05.13·hazyresearch.stanford.edu·7 min read·TLDR AI Sponsored
Learn how to integrate Snowflake's data platform with AtScale's Semantic Layer and Large Language Models (LLMs) to enhance self-service analytics capabilities [13]. Featuring Alex Ross, Senior Solutions Engineer @ Snowflake; Dave Mariani, CTO @ AtScale; and
2024.05.13·atscale.com·Sponsor·TLDR AI All in one LLM and RAG serving framework.
2024.05.13·github.com·GitHub repository·TLDR AI The Mirage project is a multilevel tensor optimization engine that can produce extremely high performance kernels for linear algebra modules.
2024.05.13·github.com·GitHub repository·TLDR AI E2URec is a new approach that enables large language model-based recommendation systems to forget user data efficiently and effectively, ensuring privacy without sacrificing performance.
2024.05.13·github.com·GitHub repository·TLDR AI Lumina is a project that aims to be a unified text-to-X generation model. It's trained on images, video, audio, and text interleaved, which improves downstream performance.
2024.05.13·github.com·12 min read·TLDR AI The quest for AGI is a focal point for top AI labs, with predictions for its achievement ranging from 2027 to 2047. Despite AI not yet reaching AGI, certain systems demonstrate superhuman skills in specific tasks, suggesting that AI's current best use is as a co-intelligence, augmenting human efforts rather than replacing them.
2024.05.13·oneusefulthing.org·8 min read·TLDR AI California's SB1047 bill proposes regulations for AI models with computational capacities over 10^26 FLOPs. It focuses on ensuring these models are used safely by requiring secure environments, quick deactivation capabilities, and rigorous misuse potential testing. The bill targets only high-risk scenarios, aiming to balance innovation with safeguards against misuse in response to concerns about AI's potential impact on society.
2024.05.13·astralcodexten.com·9 min read·TLDR AI Sponsored
This two-hour workshop shows agencies and consultants how to create enterprise-grade AI solutions tailored to clients' unique needs. No
2024.05.13·form.jotform.com·Sponsor·TLDR AI This repository is from one of ElevenLabs' research scientists and contains a potential starting point to replicate the amazing results.
2024.05.13·github.com·GitHub repository·TLDR AI Amazon's Bedrock Studio is a web-based platform within Amazon's Bedrock generative AI environment designed to help developers experiment with, fine-tune, and deploy AI models.
2024.05.13·techcrunch.com·1 min read·TLDR AI Cleanlab created a playground for its Trustworthy Language Model.
2024.05.13·tlm.cleanlab.ai·Tool·TLDR AI Sponsored
If you want to see the future of AI-powered hospitality, look no further than Jurny [4]. And if you want to invest in that future - now's your chance [4].
2024.05.10·links.tldrnewsletter.com·Sponsor·TLDR AI 2024.05.10·links.tldrnewsletter.com·TLDR AI A former Google ML Head of Product and an MIT professor have raised money from a16z's new game fund for generative 3D character creation.
2024.05.10·links.tldrnewsletter.com·4 min read·TLDR AI Stability AI has introduced Stable Artisan, a system combining all of its models that can be run from Discord. This is likely a play to compete directly with Midjourney.
2024.05.10·stability.ai·3 min read·TLDR AI Voice AI startup ElevenLabs is previewing a new model that converts prompts into song lyrics. The company is using a promotional strategy similar to the one OpenAI used for Sora AI.
2024.05.10·links.tldrnewsletter.com·3 min read·TLDR AI