Parse notes
Sponsored
Ready to save up to $2,000 on every vacation for life? Dollar Flight Club has your back—TRY THE CLUB FOR JUST $1 IF YOU SIGN UP IN THE NEXT 12 HOURS [5]. That means; Hawaii from $174, Iceland from $215, or Greece from $245 round trip. Join over 1 million members saving on travel this year.
Meta's Llama team is reportedly still working on alignment to enable the model to loosen up and answer more queries that aren’t actually controversial.
Most serverless GPU offerings require one POST request per model inference. However, this is a challenge in cases where you want to stream model outputs. Websockets make streaming possible.
Apple CEO Tim Cook announced at the company's annual shareholders meeting that the company plans to break new ground in generative AI in 2024, promising transformative opportunities for users.
An amazing paper that frames video as a potentially better way for AI to interact with human users. It shows how video models can be used as planners, agents, compute engines, and environment simulators.
Most language models use 16 or more bits to represent a parameter in a model. This results in powerful models that can be expensive to run. This work proposes a method that uses 1.58 bits per parameter - each parameter is in {-1, 0, 1}. This method matches performance exactly up to 3B parameters. No code or models have been released yet.
This research focuses on advancing multi-modality foundation models like GPT-4V in low-level visual perception tasks. The large-scale experiment gathered feedback on 18,973 images from 58,000 humans and created the Q-Pathway dataset to analyze clarity, color, and brightness.
Sponsored
What separates top-performing enterprises from laggards when it comes to GenAI adoption? Join this FREE virtual summit [12] to learn about practical hands on architecture and insights from GenAI builders, the emerging enterprise GenAI stack [12], and much more. Featuring speakers from LLAMAINDEX, COINBASE, LINKEDIN, COMCAST, P&G, ROBLOX, DATABRICKS, JPMORGAN CHASE, FIDELITY, CHEGG, and many others.
Graph diffusion policy optimization enhances graph generation models for drug design using a unique reinforcement learning technique. This approach promises better performance in creating complex and diverse graph structures and could set new standards in the field.
Dual Chunk Attention (DCA) extends the capabilities of large language models like Llama2 70B, allowing them to handle over 100k tokens without additional training. It breaks down attention computation into chunks, enhancing the model's understanding of both short and long-range context.
The Big Code project has released another version of its flagship coding model. The model has a 16k context window and was trained on 4T tokens. Its performance is strong, but still under that of DeepSeek coder.
HiGPT is an approach to learning across diverse heterogeneous graphs without the need for fine-tuning. Its integration with a novel graph tokenizer and a vast corpus of graph instructions allows it to excel in adapting to various data distributions.
PromptMM improves recommendation systems on platforms like Amazon and TikTok by using Multi-modal Knowledge Distillation. It addresses inaccuracies in user preferences and simplifies systems by distilling important features from various content types (visual, textual, or acoustic) to prevent overfitting.
A minimal code set up with TRL to tune a model to be more descriptive.
A coding style at Character AI dramatically improves the readability of shapes in tensors.
Adobe Acrobat's new AI Assistant can query documents for answers with attribution, create document summaries, offer a list of suggested questions for deeper insights, assist in drafting content for various communication needs, and provide outlines and key points so users can swiftly navigate essential document information.