Apple has developed a new multimodal LLM called Ferret-UI that has the potential to understand the user interfaces of mobile displays, enabling Siri to comprehend and interact with on-screen elements effectively.
2024.04.10·appleinsider.com·1 min read·TLDR AI 200 AI and aerospace engineers gathered to prototype innovative solutions for the Aviation and Space industries and built an impressive array of tools ranging from AI air traffic controllers to AI flight planners to Apple Vision Pro flight simulators.
2024.04.10·gonavi.ai·5 min read·TLDR AI Train over 200k context windows on an H100 with a new gradient accumulation offloading.
2024.04.10·colab.research.google.com·TLDR AI Sponsored
Even if you’re a startup, you can’t afford to cut corners on auth — especially when it comes to features like SSO. This free (ungated) resource [3] covers the essentials of SaaS user management — from 101 topics [3] to more advanced concepts.
2024.04.09·workos.com·Sponsor·TLDR AI Sam Altman and Jony Ive, former Apple design chief, have officially joined forces to develop an AI-powered personal device that won't resemble a smartphone. They are currently seeking funding of up to $1 billion.
2024.04.09·macrumors.com·1 min read·TLDR AI Hugging Face’s popular and powerful inference server was briefly licensed under non-commercial to try and prevent larger businesses from hosting a competitive version. This didn't lead to improved business outcomes but did diminish community involvement. It has reverted to a more permissive license.
Prime Minister Justin Trudeau announced a $2.4 billion investment package from Budget 2024 to reinforce Canada's AI sector. The package includes funding for computing capabilities, support for AI start-ups, and resources to ensure responsible AI adoption. These measures aim to accelerate job growth, enhance productivity, and maintain Canada's competitive edge in AI globally. The funds will also go towards creating a Canadian AI Safety Institute and strengthening enforcement of the Artificial Intelligence and Data Act.
2024.04.09·pm.gc.ca·9 min read·TLDR AI Prompt Auto-Editing (PAE) is a method developed by researchers to advance text-to-image generation using diffusion models like Imagen and Stable Diffusion. This innovative approach automates the refinement of text prompts by dynamically adjusting the weights and injection times of specific words, guided by online reinforcement learning.
2024.04.09·arxiv.org·14 min read·TLDR AI Seg-NN is a framework that streamlines the process of 3D segmentation. By removing the need for extensive pre-training, these models quickly adapt to new, unseen classes without the typical domain gap issues.
2024.04.09·arxiv.org·16 min read·TLDR AI This comprehensive survey explores the potential of Healthcare Foundation Models (HFMs) in transforming medical services. These models, which are pre-trained on diverse data, are well-suited to adapt to various healthcare tasks, potentially enhancing intelligent healthcare services across numerous scenarios.
2024.04.09·arxiv.org·48 min read·TLDR AI LLM training in simple, pure C/CUDA by Andrei Karpathy. No need for 250mb+ of PyTorch.
2024.04.09·github.com·GitHub repository·TLDR AI An LLM agent operating system that embeds a large language model into Operating Systems as the brain of the OS, enabling an operating system "with soul".
2024.04.09·github.com·GitHub repository·TLDR AI Anthropic has launched a public beta allowing Claude AI to interact with custom client-side tools provided in API requests. Developers must use the 'anthropic-beta: tools-2024-04-04' header to access the feature. Claude's functionality can be extended with detailed JSON schemas for each tool.
2024.04.09·docs.anthropic.com·11 min read·TLDR AI Neural networks' limited ability to generalize beyond their training data restricts their reasoning and reliability, necessitating alternative approaches to achieve artificial general intelligence.
2024.04.09·garymarcus.substack.com·3 min read·TLDR AI A Pew Research Center survey indicates ChatGPT usage among U.S. adults has increased from 18% to 23% since July 2023, with upticks in occupational, educational, and entertainment contexts. Young adults and those with higher education are more likely to use ChatGPT. Reflecting general wariness about AI and politics, 40% of Americans distrust election information from ChatGPT. Despite tech companies' efforts to combat AI-generated misinformation, only 2% of Americans have used ChatGPT to seek election-related facts.
2024.04.09·pewresearch.org·5 min read·TLDR AI Flyflow is API middleware to optimize LLM applications.
2024.04.09·github.com·GitHub repository·TLDR AI Artifact's technology, not its team, is the focus of the deal, with co-founders Systrom and Krieger becoming special advisors.
2024.04.09·theverge.com·4 min read·TLDR AI Convenience chain Re-Up has introduced "The Wingman," a robotic fry cook by Nala Robotics, which uses advanced AI to prepare fried food.
2024.04.09·theverge.com·2 min read·TLDR AI Sponsored
Higgsfield’s new foundational model and app [3] change the game for video AI — allowing any creator to instantly bring their vision to life with unparalleled control: ➡️ Starting from just 1 selfie [4], create highly personalized and realistic human characters that can be dropped into almost any scene.
2024.04.08·higgsfield.ai·Sponsor·TLDR AI AMD has agreed to open source the firmware for its Radeon GPUs. This means the community can quickly improve AI frameworks and potentially AMD adoption.
2024.04.08·theregister.com·6 min read·TLDR AI Elon Musk's xAI is in talks with investors to raise $3B in a funding round that would value the artificial intelligence startup at $18B.
2024.04.08·economictimes.indiatimes.com·1 min read·TLDR AI Cohere has introduced Command R+, a powerful, scalable LLM designed for enterprise use cases, featuring advanced retrieval augmented generation with citation, multilingual coverage in 10 key languages, and tool use capabilities.
2024.04.08·txt.cohere.com·4 min read·TLDR AI The Qwen team has trained and released a 32B parameter model that achieves strong performance. It can be fit in more modest memory systems.
2024.04.08·qwenlm.github.io·18 min read·TLDR AI "Anything Unsegmentable" is a new approach designed to shield digital images from being segmented by powerful AI models, addressing potential copyright and privacy issues.
2024.04.08·arxiv.org·20 min read·TLDR AI Researchers have launched ReaLMistake, a benchmark aimed at systematically detecting errors in large language model responses.
2024.04.08·arxiv.org·18 min read·TLDR AI Sponsored
2024.04.08·orca.security·Sponsor·TLDR AI SWE-agent turns LLMs (e.g. GPT-4) into software engineering agents that can fix bugs and issues in real GitHub repositories. SWE-agent sets the state-of-the-art performance on the full SWE-bench benchmark, resolving 12.29% of issues.
2024.04.08·swe-agent.com·3 min read·TLDR AI Researchers from Meta have been teasing a new optimizer on X. They have now released the code along with various integrations. The optimizer has no LR schedule, which means you don’t need to know the full number of training steps beforehand. It has been shown empirically to work on a wide variety of problems including language models.
2024.04.08·github.com·GitHub repository·TLDR AI ReFT is a new parameter-efficient method for fine-tuning language models. It is substantially cheaper than even PeFT while achieving strong performance.
2024.04.08·github.com·GitHub repository·TLDR AI The development of artificial intelligence heavily relies on vast amounts of data, which is being rapidly consumed by tech companies faster than it is being produced, leading to predictions that high-quality digital data may be exhausted by 2026. In response, companies like OpenAI, Google, and Meta are exploring new methods to obtain more data, including using YouTube video transcripts, revising privacy policies, considering the purchase of major publishers, and investigating the use of "synthetic" data generated by AI models, despite the risk of compounding errors.
2024.04.08·nytimes.com·5 min read·TLDR AI MLPerf has updated its inferencing benchmarks to include large language models like Llama 2 70B and Stable Diffusion XL, reflecting the industry's shift to massive generative AI. In the latest tests, Nvidia's systems, particularly those equipped with the H200 processor, outperformed competitors from Intel and Qualcomm in both speed and efficiency. The benchmarks highlight the importance of high-bandwidth memory in handling large AI models, with Intel's Gaudi 2 and Qualcomm's Cloud AI 100 Ultra also showcasing significant performances in the generative AI space.
2024.04.08·spectrum.ieee.org·6 min read·TLDR AI Rabbit partners with ElevenLabs to incorporate voice command technology into its upcoming r1 devices, enhancing human-device interaction with low latency models for a more natural experience. The first batch of r1 devices, which feature functionalities like chatbot interaction and bi-directional translation, is set to ship by March 31. ElevenLabs has recently raised $80 million, despite facing challenges with misuse of its voice cloning technology.
2024.04.08·techcrunch.com·2 min read·TLDR AI Sponsored
Learn how to make the most of Hugging Face models, Sagemaker, and Inferentia2. Join free, expert-guided, in-person workshops: Seattle (4/11) [21], Santa Clara(4/17) [22], NYC(4/25) [23], or Austin(5/30) [24].
2024.04.08·aws.amazon.com·Sponsor·TLDR AI OpenAI's DALL-E has been integrated with ChatGPT - users can now edit DALL-E images in ChatGPT across web, iOS, and Android.
2024.04.08·theverge.com·2 min read·TLDR AI A curated list of the top 100 AI tools to boost your work productivity.
2024.04.08·flexos.work·20 min read·TLDR AI A completely locally running search engine using LLM Agents.
2024.04.08·github.com·GitHub repository·TLDR AI 2024.04.05·invest.helloryse.com·TLDR AI Sponsored
Where were you when Amazon acquired Ring for $1B? Or when Google bought Nest for a cool $3.2B? Hopefully, you were invested in those promising startups. But for those that missed out, the next groundbreaking Smart Home innovation has arrived 一 RYSE. Their automated window shade tech just launched in +100 Best Buy stores [3] and their pre-IPO investment offering is open to the public for a limited time. But hurry, their SHARE PRICE HAS ALREADY GROWN 20% from their last round!
2024.04.05·invest.helloryse.com·Sponsor·TLDR AI GPU provider Lambda has a special debt financing deal for $500m to expand its GPU cloud offering in addition to the $230m Series C earlier this year.
2024.04.05·businesswire.com·4 min read·TLDR AI OpenAI is expanding its Custom Model program with assisted fine-tuning and custom-trained models to help enterprise customers develop tailored generative AI models for specific use cases.
2024.04.05·techcrunch.com·2 min read·TLDR AI Higgsfield AI, founded by former Snap executive Alex Mashrabov, has launched Diffuse, a mobile-first, AI-powered video creation and editing app targeted at creators and social media marketers.
2024.04.05·techcrunch.com·3 min read·TLDR AI One drawback of modern transformers is that each token uses the same amount of predictive compute. However, some tokens are much easier to predict than others. This work from DeepMind allows models to exit early during generation to spend less flops on certain tokens, effectively opening the door to dynamic compute - with a fixed maximum. The results are 50% fewer flops at generation time for equivalent performance.
2024.04.05·arxiv.org·23 min read·TLDR AI MGFiD enhances the way question-answering systems understand and select relevant information by introducing a multi-level evidence discernment method.
2024.04.05·arxiv.org·18 min read·TLDR AI Linear Attention Sequence Parallel (LASP) introduces a new strategy for efficiently managing long sequences in language models, surpassing traditional methods with its innovative use of linear attention.
2024.04.05·arxiv.org·16 min read·TLDR AI Sponsored
A new global survey by ClearML [10], the AI Infrastructure Alliance, and FuriosaAI reveals the current state of AI infrastructure planning — including high interest in open source tools, challenges in GPU utilization [10], and dissatisfaction with current job scheduling options. Get the full survey results and research analysis for free >> Download
2024.04.05·go.clear.ml·Sponsor·TLDR AI 23m tokens of text to SQL data is now available on HuggingFace. Gretel has collected a significant dataset to help generate SQL queries based on natural language tasks. This can help in RAG applications and in synthetic data generation.
2024.04.05·gretel.ai·6 min read·TLDR AI InstantStyle introduces a new approach to image personalization, overcoming the challenge of style consistency without the need for complex tuning. By cleverly separating style and content in images and focusing on style-specific areas, this framework ensures detailed and consistent visual stylization, blending style intensity with text control seamlessly.
2024.04.05·github.com·GitHub repository·TLDR AI