Parse notes
Sponsored
The in-person GTC experience is back. Come connect with a dream team of industry luminaries [5], developers, researchers, and business strategists helping shape what’s next in AI and accelerated computing. From the highly anticipated keynote by NVIDIA CEO Jensen Huang [5] to 900+ inspiring sessions, 300+ exhibits, and tons of unique networking events, GTC delivers something for every technical level and interest area.
After a decade of effort and billions of dollars, Apple is canceling its unsuccessful attempt at building a car to rival Tesla. Many of the employees are expected to move to generative AI projects.
Function calling is when a language model can access tools via synthesized functions to complete its given instructions. This requires proper synthesis of arguments to pass to those functions. This leaderboard is designed to assess model capability on function calling tasks.
Music understanding typically relies on adding a modality-specific encoder to a language model. This is expensive and unstable. This work found that music understanding increased substantially without impact to base language ability when music was tokenized into ABC notation.
Bytedance has produced a system called MegaScale that can be used to train massively parallel large language models. It succeeded in training a 175B LLM on 12,288 GPUs with 55.2% Model FLOPs Utilization (MFU), which is extremely impressive. Bytedance plans to open source some aspects of the codebase.
ListT5 introduces a cutting-edge reranking method that not only improves the precision of information retrieval but also offers an efficient solution to the challenges faced by previous listwise rerankers.
EMIFF is an innovative camera-based 3D detection framework for vehicle-infrastructure cooperative object detection. It uses Multi-scale Cross Attention and Camera-aware Channel Masking to correct pose errors from camera asynchrony.
FuseChat introduces an innovative way to blend the strengths of various large language models into a single, more powerful model without the high costs of training from scratch.
ShieldLM is a safety detector for large language models that aligns with human safety standards, offers customizable detection, and explains its decisions.
This article reports on interviews with founders from companies at the forefront of AI, covering their views on the advent of AGI, how to think about LLMs, and simple tactics for founders on how to approach AI within their products.
MobiLlama is a fully open-source, transparent, small language model for use on mobile devices. Its performance is excellent for a small 0.5B parameter model - it even outperforms some larger models.
IR-QLoRA is a new approach that enhances the accuracy of quantized large language models, making them more suitable for use on devices with limited resources.
Sponsored
Raycast Pro lets you harness the power of genAI, add custom themes,
Researchers from UCSD trained humanoid robot policies to be more expressive, socially inclined, and robust. Their videos of non-choreographed dancing on grass are very impressive.
Simulatrex is an open-source project focused on Generative Agent-Based Modeling (GABM). It utilizes large language models for more accurate simulations.
14,509 books summarized in 5 bullet points using AI.