Full-text search across article titles and summaries. Refine with sector, year, content type, and reading-time filters.
How many GPUs do you need? How wide should your model be? These are regularly asked questions with fairly simple calculations. This post walks through these and a bunch more interesting questions involving Transformers and the math needed to train good ones. One interesting take away is that models should not be trained for less than 200B tokens regardless of size.
The paper proposes using machine-generated instruction-following data to instruction tune large language models (LLMs) for multimodal tasks. This resulted in LLaVA, a large multimodal model that combines a vision encoder and language-only GPT-4. LLaVA exhibits impressive multimodal chat abilities and achieved a new state-of-the-art accuracy of 92.53% when fine-tuned on Science QA in synergy with GPT-4.
The paper proposes Low-code LLM, a human-LLM interaction framework that uses low-code visual programming interactions to achieve more controllable responses for complex tasks. Low-code LLM includes a Planning LLM and an Executing LLM and offers controllable generation results and user-friendly interaction. The approach is demonstrated through four applications.
Promptr is a CLI tool for operating on your codebase using GPT. Promptr dynamically includes one or more files into your GPT prompts, and it can optionally parse and apply the changes that GPT suggests to your codebase. Several prompt templates are included for various purposes, and users can create their own templates.
Lift3D, an inverted 2D-to-3D generation framework, addresses the limitations of NeRF-based 3D GANs by offering photorealistic output with adaptable resolution and accurate 3D annotations for downstream tasks. The framework is evaluated on autonomous driving datasets, demonstrating its ability to enhance the performance of 3D object detectors.
Atlassian Corp. unveiled new artificial intelligence features for its workplace collaboration tools, making it the latest technology company to utilize OpenAI’s generative AI models.
Tech companies are now ransacking university AI programs in search of talent.
LLaVA provides visual instruction tuning towards large language and vision models with GPT-4 level capabilities.
Coinbase has secured a license from the Bermuda Monetary Authority to expand its international business amid increasing hostility from US regulators towards the crypto industry. Potentially as early as next week, the company is planning to launch an offshore derivatives exchange in Bermuda, targeting perpetual swaps and other crypto-related derivatives largely unavailable in the US due to regulatory restrictions. This move could position Coinbase to challenge Binance's dominance and diversify its revenue base. While an immediate exodus of major US crypto firms is unlikely, this is yet another sign that the industry is increasingly considering alternative locations like Hong Kong, Dubai, and Singapore as primary places of business.
Btn.social is an easy, lightweight, and affordable OAuth solution that works with any tech stack. They are privacy-first, store no data, have a small 1.5kB client SDK, and scale with login instead of users to provide affordability to developers.
If you have ever struggled to fit your website and browser developer console in the same window, this tool solves that. It brings console logs onto the page without needing to explicitly open the Developer Tools menu.
As a software engineer, ChatGPT can be a game-changer. Kent Beck, the “father of test driven development (TDD)”, believes that 90% of his skills are now worth $0, but 10% of his skills have now 1000x-ed in value.
This blog post breaks down Internet speed tests and the challenges that come with network testing. The breakdown includes explanations of bandwidth, latency, jitter, and packet loss, along with real life examples. Cloudflare has open-sourced their speed test which can be found in the GitHub repository linked in the article.
A new technique called "gisting" has been introduced as a way to utilize multitask capabilities of language models without requiring prompts or model retraining for each task. Gisting compresses prompts into smaller sets of tokens that can be reused, resulting in computational efficiency, FLOP reductions, and speedups without significant loss in output quality. This technique was tested on two LMs, achieving up to 26x compression of prompts and up to 40% FLOPs reductions.
A new real-time end-to-end object detector called Real-Time Detection Transformer (RT-DETR) has been proposed to address the high computational cost issue of end-to-end transformer-based detectors (DETRs), which limits their practical application. RT-DETR uses an efficient hybrid encoder, IoU-aware query selection, and supports flexible adjustment of inference speed without retraining. RT-DETR achieves up to 54.8% AP on COCO val2017 and 74 FPS on T4 GPU, outperforming YOLO detectors and DINO-Deformable-DETR-R50 in both speed and accuracy.
There has been recent work in making RL agents less afraid. One paper specifically talks about mitigating cowardice in models trained in RL. This is interesting in the realm of self-driving cars and terrifying in other potential applications. This repository shows how we can now train RL agents to win in a fighting game. The full training and evaluation code is available.
Window AI is a browser extension that lets you configure AI models in one place and use them on the web.
Camel explores the potential of building scalable techniques to facilitate autonomous cooperation among communicative agents and provide insight into their "cognitive" processes.
Sponsored
Japan is using OpenAI’s ChatGPT to try and make its often opaque and complex government regulations easier to understand.
TurboPilot is a self-hosted copilot clone which uses the library behind llama.cpp to run the 6 Billion Parameter Salesforce Codegen model in 4GiB of RAM.
Sponsored