Sakana.ai is building a world-class research lab in Tokyo to build smaller and more efficient foundation models. The company was founded by ex-Google researchers David Ha and Llion Jones, who are responsible for breakthroughs such as Transformers, World Models, and LoRA. It has raised a 30m seed round from Brandon Reeves at Lux Capital and Jon Chu at Khosla Ventures to pioneer this effort and put Tokyo on the AI map.
2024.01.17·sakana.ai·3 min read·TLDR AI A strong 3B model that outperforms the 7B CodeLlama model and is small enough to run locally on MacBooks.
2024.01.17·stability.ai·4 min read·TLDR AI OpenAI is forming a new Collective Alignment team to integrate public input into its AI models.
2024.01.17·techcrunch.com·2 min read·TLDR AI This blog explores the current dominant paradigm for taking a pretrained language model and adding multimodal capabilities. Namely, aligning the embeddings between an encoder and the text model.
2024.01.17·paul.mou.dev·13 min read·TLDR AI Hard problems have been thought to require hard data, but that data is hard to label and noisy. This work shows that fine-tuning models on related, but easy, data dramatically improves their generation capabilities on hard problems. Another data point to support fine-tuning as eliciting knowledge instead of adding knowledge.
2024.01.17·arxiv.org·12 min read·TLDR AI Researchers have developed a novel approach called Mutual Distillation Learning For Person Re-identification (MDPR) that enhances person re-identification by combining two different techniques.
2024.01.17·arxiv.org·16 min read·TLDR AI Sponsored
Microsoft is marketing that its Direct Lake architecture on Fabric is the ideal way to run direct queries on cloud storage in Power BI. Does the data support their claim? This webinar [12] will dive deep into AtScale’s TPC-DS benchmark report [12] that tests the scalability, cost effectiveness and manageability of Microsoft Fabric Architecture.
2024.01.17·atscale.com·Sponsor·TLDR AI One of the most viral uses of generative image models is personal stylized image generation. Historically, this required training a LoRA or using DreamBooth. Now, with the use of ID embeddings, you can dramatically improve quality while reducing computational cost, with just a single image.
2024.01.17·github.com·GitHub repository·TLDR AI Following the recent trend of repurposing diffusion models for various other vision tasks, this work improves the stability of training for super resolution and upscaling.
2024.01.17·github.com·GitHub repository·TLDR AI FILCO is a new technique designed to improve AI systems, especially in areas like answering questions and checking facts, by giving them better context. It works by choosing the most helpful information and training models to filter out less relevant details.
2024.01.17·github.com·GitHub repository·TLDR AI Dataset to help align models to write correct Haiku’s.
The "Wait Calculation" concept advises delaying actions, like a space journey to Barnard's Star or starting certain projects, until technology sufficiently advances to save significant time and effort. However, this approach must be balanced against potential learning losses and the unpredictability of technological progress.
2024.01.17·oneusefulthing.org·8 min read·TLDR AI This project improves the Model Parameter Randomisation Test, a key tool in eXplainable AI (XAI), by introducing two new versions: Smooth MPRT and Efficient MPRT.
2024.01.17·github.com·GitHub repository·TLDR AI Sponsored
Join DeepBrain AI and Runway’s joint webinar to see the latest in generative AI video — bringing video to life with just text input.
2024.01.17·us06web.zoom.us·Sponsor·TLDR AI Meta recently announced a suite of music and sound generation models that sound incredible. It has now released the models with inference code.
Tiny Narrations is a text-to-speech read version of the popular (and small) Tiny Stories dataset. It uses XTTS2 on the SF Compute H100 cluster.
2024.01.17·github.com·3 min read·TLDR AI An AI assistant that helps sales teams with personalized prospecting and efficient meeting preparation.
ProShares has submitted proposals for five leveraged and inverse Bitcoin ETFs. This comes on the heels of the SEC's approval of 11 spot Bitcoin ETFs. The five proposed funds are named ProShares Plus Bitcoin ETF, ProShares Ultra Bitcoin ETF, ProShares UltraShort Bitcoin ETF, ProShares Short Bitcoin ETF, and ProShares ShortPlus Bitcoin ETF. The spot Bitcoin ETFs are off to a fast start, with billions of dollars in trading volume in the first few days, so these proposed ETFs are presumably aiming to capitalize on that, giving investors more ways to get exposure to Bitcoin, either by shorting it or being able to leverage long it.
Cantor Fitzgerald's CEO Howard Lutnick came out and publicly defended the legitimacy of USDT, supporting the company's claims of having adequate funds backing the asset. Noting the firm's recent assertion that its reserves consist primarily of US Treasuries, Lutnick confirmed managing many of Tether's assets. Tether has long drawn the ire of skeptics who doubted that it had the reserves it claimed to, and this has created an overhang that many in the industry have constantly worried about.
After successfully selling out its first-generation mobile device, the Saga, Solana has announced it will be rolling out a new product next year. It is taking $450 deposits for preorders for the undisclosed product. Along with this, Solana is rolling out a points program based on customer referrals, which could give users the chance for rewards and giveaways.
Chainlink's Cross-Chain Interoperability Protocol has been integrated with Circle's Cross-Chain Transfer Protocol, enabling an easier way to transfer USDC across different blockchains. This development allows developers to build functions involving cross-chain USDC transfers. Chains included in this collaboration include Ethereum, Arbitrum, Optimism, Avalanche, and Base mainnets, with more integrations planned for the near future.
This thread lays out a strategy for optimizing airdrop allocations and yield farming throughout the Solana ecosystem. Combining Drift with other tokenless protocols, the author claims users can follow this method to potentially achieve triple-digit yields. Steps include adjusting settings in Drift Protocol, monitoring APR, and buying spot positions to hedge against short positions. The strategy also involves lending or depositing spot positions, and staking SOL for increased yield. Users can also employ rate arbitrage or directional trade according to their preferred risk levels.
Andrew Hong's 2024 annual guide to crypto data tools provides an in-depth analysis on the state of the data stack. It examines key components like indexers, explorers, query engines, data transformations, and ZK reverse ETL. The guide goes over data tool innovations, complications, the evolution of crypto data startups, its landscape, and predictions for the crypto data ecosystem in 2024. It also highlights the integration of zero knowledge tech for data verification.
2024.01.17·read.cryptodatabytes.com·14 min read·TLDR Crypto This article discusses several trends and opportunities Multicoin - of Solana fame - is looking forward to in 2024. The topics covered include the increasing importance of "attention theory" in determining the value of a variety of entities, the potential for stablecoin-powered remittances in emerging markets, and the growing influence of blockchain and cryptocurrency technologies in fields such as novel marketplaces, remittances, and social applications.
This post lays out a thesis for Blast and other L2s like it. The growing commodification of L2 blockchain solutions is driving competition for users, attention, and traction amid an increasing number of L2s. This shifts user behavior and has caused protocols to focus on incentivizing on-chain activities. Despite criticism around the way it launched, Blast has attracted more TVL than established L2s like Coinbase's Base. The fact that many complained about the launch but also bridged assets to the L2 highlights the more general mismatch between public sentiment and private actions in the crypto space.
According to the IRS, businesses won't need to report crypto transactions over $10,000 as cash until new regulations are issued, despite the current law enacted at the beginning of the year requiring it.
This post goes over what the approval of Bitcoin ETFs might mean for the adoption of the cryptocurrency and of cryptocurrencies in general as more ETFs will likely be approved over time.
The proliferation of cross-chain bridges, valued at $23.5 billion, addresses the need for asset and information transfer across diverse blockchains, but it also comes with challenges around regulation of the movement of these assets.
This post attempts to estimate the EigenLayer airdrop value, predicting around 20-25 points per day per ETH deposited, with a potential total value airdropped around $1.05 billion.
Though the network is dropping "the" from its logo, it will still largely be referred to as The CW since that sets it apart from other networks. While the change has already been implemented on the network's social channels, the new CW logo is yet to make its official TV debut.
Adobe is introducing AI-powered audio editing features to Premiere Pro, streamlining tasks like audio transition creation and clip labeling. These updates enhance the editing process, giving editors more time to focus on other aspects of their projects.
The Samsung Music Frame is a unique audio solution that blends with home decor. It resembles a modern picture frame and can display art or photos while functioning as a surround sound speaker. Connected through Samsung's Q-Symphony, it offers a wide soundstage and Dolby Atmos capabilities.
Bloomberg's Mark Gurman says the virtual keyboard in visionOS 1.0 is "a complete write-off," so most people will use a Bluetooth keyboard instead. In-air typing is far from magical, as one has to poke each key at a time or look at a character and pinch in. It might also be exhausting since you have to hold your hands in the air to type.
A call to action to create a Global Design System that provides the world’s web designers & developers with a library of standard UI components. A Global Design System would improve the quality and accessibility of the world’s web experiences, save the world’s web designers and developers millions of hours, and better use our collective human potential.
How easily information can be retrieved from memory depends on how often we’ve encountered that information, how recently we’ve used it, and how much it relates to the current context. Interfaces that promote recognition give users extra help in remembering information, whether about tasks and items they had seen before or about interface functionality.
Learn CSS Grid Layout with small examples that demonstrate features of the specification, including Subgrid.
Easometric makes it easy to create isometric elements in Figma, with top, left, and right isometric views.
Componly is a comprehensive suite of features, including component visualizer tools, custom component tracking, detailed reporting, and insightful analytics.
Compared to the old way, AI allows creative work to be completed faster and for less money. That has an impact on the price of creativity. Competing with AI is impossible if the client wants something fast and cheap. In contrast, the pricing discussion becomes less sensitive if they value your point of view and how you articulate your creative assets, including AI.
2024.01.17·reiinamoto.substack.com·11 min read·TLDR Design This case study looks into how spatial banking will look with Apple’s Vision Pro and how the principles for spatial experience — Familiar, human-centered, dimensional, immersive, and authentic- will shape the user experience.
If alt text doesn’t accurately capture the essence of the image it’s describing, it can do more harm than good. A good alt text is specific and concise and isn’t redundant. It’s objective, relevant, under 125 characters, and doesn’t start with “image of…” Designers can now use AI tools to generate image descriptions that are good alt texts.
The internet has developed a fascination with parodying "Girl with a Pearl Earring" with various creative renditions, including AI-generated art. From a feline version called "Cat with a Pearl earring" to Nintendo's Toad, these unique interpretations showcase the limitless possibilities of AI art.
Having grown up with devices and digital connectivity, Generation Z has distinctive UX and design expectations, requiring an innovative approach. They focus on immediate satisfaction, effortless interactions, visual storytelling, social belonging, and transparency.
As Charlie Munger famously said, “Show me the incentive, and I will show you the outcome”. Incorrect incentives can have second-order effects that might have hugely negative impacts on your startup. This article explores the adverse impact of misaligned incentives and what to look out for.
There’s a lot of debate about whether raising capital or bootstrapping your way to success leads to better outcomes for founders. Perhaps there’s an alternative to chasing the venture dragon and raising multiple rounds – instead, just raise one round to get liftoff and build sustainably from day one.