This blog post from Meta outlines the infrastructure being used to train Llama 3. It talks through storage, networking, Pytorch, NCCL, and other improvements. This will lay the foundation for Meta's H100s coming online throughout the rest of this year.
2024.03.13·engineering.fb.com·12 min read·TLDR AI Physical Intelligence (Pi) has emerged from stealth with $70 million in seed funding. The company, founded by a team of renowned robotics and AI experts, aims to develop foundation models and learning algorithms that can power a wide range of robots and physically-actuated devices.
2024.03.13·maginative.com·3 min read·TLDR AI You can steal portions of closed language models such as the embeddings layer just by using their public APIs. This can be done for a modest budget of less than $2,000.
2024.03.13·arxiv.org·24 min read·TLDR AI A sequence prediction model for DNA built on the Transformer competitor Mamba. It is extremely efficient and powerful for a small model.
2024.03.13·caduceus-dna.github.io·7 min read·TLDR AI This project introduces a novel approach that enhances 3D object generation, producing high-quality, detailed objects from a single image.
2024.03.13·heheyas.github.io·2 min read·TLDR AI Sponsored
DataGPT is your on-demand, always available data analyst. From simple reporting to cohort and trend analysis [11], DataGPT gives reliable, thorough, and accurate answers to natural language questions like “why did our conversions drop?” 🆕 Use Dynamic Benchmarking [11] to compare two segments in your data, including from different starting dates.
2024.03.13·datagpt.com·Sponsor·TLDR AI Transformer Debugger is a tool developed by OpenAI's Superalignment team to support investigations into specific behaviors of small language models. The tool combines automated interpretability techniques with sparse autoencoders.
2024.03.13·github.com·GitHub repository·TLDR AI VideoMamba is a solution that addresses the complexities of video understanding by efficiently managing local redundancy and global dependencies.
2024.03.13·github.com·GitHub repository·TLDR AI This project presents a way to improve the efficiency of Large Vision-Language Models like LLaVA-1.5, QwenVL-Chat, and Video-LLaVA by addressing the "inefficient attention" problem. Its use of FastV, a new method that optimizes these models by pruning visual tokens and learning adaptive attention patterns, leads to a significant reduction in computational costs without losing performance on tasks related to images and videos.
2024.03.13·github.com·GitHub repository·TLDR AI Researchers have created a generative AI worm called Morris II that can attack AI systems like ChatGPT, spreading autonomously while potentially stealing data. The worm uses “adversarial self-replicating prompts” to perpetuate and compromise AI email assistants, highlighting new cyberattack risks within the AI ecosystem. Security experts urge AI developers to take potential AI-driven threats seriously as AI applications become more autonomous and interconnected.
2024.03.13·arstechnica.com·6 min read·TLDR AI 38 AI experts and 39 English experts were asked to rate and guess whether poems were written by an AI or a human. The human came in 1st place, while Bard, ChatGPT-4, and Claude came in 2nd, 3rd, and 4th places respectively, both in writing quality and their ability to fool respondents into believing their poems were authored by a human. English experts were far better at discerning which poems were written by AI, which points to a need for them to play a greater role in helping shape future versions of AI technology.
2024.03.13·medium.com·14 min read·TLDR AI In a discussion about the need for AI regulation and transparent development practices with tech companies, Former President Barack Obama highlighted AI's potential risks and rewards and urged tech experts to engage in government roles to help shape thoughtful AI policies. The conversation also tackled First Amendment challenges and the necessity of a multi-faceted, adaptive regulatory approach for AI.
2024.03.13·theverge.com·27 min read·TLDR AI Perplexity has integrated Yelp's data to enhance chatbot responses with maps, reviews, and detailed information on restaurants to provide users with direct and rich local search results.
2024.03.13·theverge.com·1 min read·TLDR AI Google is rolling out a new feature for the Gemini web app that allows users to fine-tune AI-generated responses using options like Regenerate, Shorter, Longer, and Remove, with the goal of providing greater control over their creative content.
2024.03.13·9to5google.com·2 min read·TLDR AI Microsoft announced updates focused on accessibility, like new Azure AI features for developers with disabilities, a preview of the “Speak For Me” feature for those with speech disabilities, Copilot's new skills, and a Mental Health toolkit, at its 14th Ability Summit.
2024.03.13·engadget.com·3 min read·TLDR AI Cryptocurrency exchange Coinbase intends to raise $1 billion through a private offering of senior convertible notes with repayment due by April 2030. This initiative aims to secure funds for clearing off existing debts due in 2026, 2028, and 2031 and for corporate purposes. The notes will be offered to eligible institutional investors and can be converted into cash, Coinbase shares, or a combination thereof.
Digital Asset has successfully tested its Canton Network, a blockchain service involving major financial firms including Goldman Sachs and BNY Mellon. The trial allowed the seamless transaction and settlement of tokenized assets, with uses ranging from fund registry to margin management. The successful execution of 350 simulated transactions demonstrated potential advantages including reduced risk and optimized capital.
The Primitives Protocol is a system designed to build consumer crypto apps on Solana. The creators exploited Solana's potential for seamless, inexpensive transactions to establish a consumer experience akin to setting up a social media profile. Their system aims to push mainstream adoption of crypto by simplifying the usually complex process. They have started working on a software development kit to support more social applications on Solana, enhancing its infrastructure and facilitating user-friendly minting.
The newly established Tensor Foundation, which supports Solana's Tensor NFT marketplace, has revealed plans for its TNSR governance token. Tensor presently claims around 33.49% of the NFT market share, battling with platforms like Magic Eden. Without mentioning a potential TNSR airdrop, the foundation praised Solana's blockchain benefits, such as speed and cost-efficiency. The foundation aims to nurture a network of creators and builders devoted to the success of NFTs.
This article outlines a comparison between Solana and Ethereum's transaction mechanisms. Solana's advantages include a minimal transaction fee and quick execution time. However, Solana's fee mechanics are insufficient for scalability, unlike Ethereum's dynamic transaction fees which are efficient and resourceful. Despite Solana's continuous block building and multi-threaded scheduler, weak inclusion guarantees and less reliable prioritization make substantial network improvements necessary.
The guide offers tips for identifying small-cap cryptocurrency gems. It recommends using Dexscreener for filtering based on liquidity, pair age, and transaction volume. Etherscan can help in tracking notable wallets in new launches. Automated notifications about potential small caps and the use of tools that track high-profit trades on Ethereum are also encouraged. The guide also suggests monitoring new wallet activity as an indicator of project interest. These methods carry inherent trading risks.
The world of cryptocurrency is shifting towards the “Attention Theory of Value,” where the price of an asset depends largely on the amount of attention and investment it attracts. "Publisher-Exchanges," apps that combine attention and value, are predicted to rise, essentially becoming marketplaces of attention. These platforms could expand chances for asset creation, allowing inventive interaction and coordination. With embedded asset issuance and trading, "Publisher-Exchanges" have the potential to revolutionize how consumers interact with crypto.
Despite a 30% decrease in CleanSpark's (CLSK) price amidst a 30% increase in Bitcoin (BTC) price, CLSK remains a strong investment due to key factors such as competent management and solid growth in hash rate. Notably, the company's decision to reserve call options to potentially double its productivity by year's end is highlighted as an unrecognized advantage. BTC's trend upwards will likely produce positive outcomes for CLSK.
MapleStory Universe switched from Polygon to Avalanche for its blockchain MMO as part of its plans to achieve enhanced security, unique NFT items, and a focus on user-generated content by the end of 2024.
Alt season triggers when Bitcoin's wealth effect boosts investor confidence, hinting at significant market shifts and investor behavior changes. It could potentially move billions into altcoins.
Grayscale plans to launch a smaller, cheaper Bitcoin Mini Trust fund to offer competitive fees and a non-taxable spin-off for GBTC investors. Approval by the SEC is pending.
Wyoming introduced DUNA for DAOs, offering benefits like legal existence, privacy, and limited liability and promoting decentralization. Effective July 1, it supports smart, flexible governance for token-using companies with a U.S. nexus.
Several outlets have published alleged CAD-based renderings of the iPhone 16 in the past few weeks. According to the leaks, the camera island on the new phone may get a pill-shaped makeover. The only visible change on the iPhone 16 Pro is an extra button on the right edge beneath the power button. It won't be a physical button and may act as a camera shutter button. It may also be customizable.
Midjourney’s new algorithm can use the same character across multiple images and styles without deviating too far from their original design. The feature isn’t designed to replicate real people from photographs and works best on characters generated via Midjourney.
Developed by brand consultancy Wolff Olins, Decathlon's rebrand aims to transform the sports giant into a "future-fit" sports brand. As part of the new positioning, the company now focuses on a sense of play and enjoyment through sports. This rebrand retains the interconnected 'C' and 'A' but introduces a darker blue and a new brand icon. The Decathlon Sans typeface has also changed with looser kerning, making it more legible than before.
UX is diluted, minimized, and disempowered. However, we’re gaslighted into believing it’s our fault, which adds to our disempowerment. Designers have little or no power to do the job description they were hired to do. However, they’re gaslighted and told it’s their fault.
Design Operations (DesignOps) aims to address pain points and cross-functional gaps in a UX org through a lay-of-the-land assessment and a focused roadmap. To create such a roadmap, designers need to synthesize all past learnings, identify and prioritize initiatives with OKRs, create the roadmap, and socialize it by catering to the audience. Start small and build trust.
Exploring the extremes is an excellent way to find ideas that transform the status quo and improve user experience. It can also unlock innovation and creativity, resulting in breakthroughs. The best way to embrace extremes is to let go of what's familiar and comfortable, embrace constraints, and be open to vulnerability.
This is a new home for micro-interactions, Easter eggs, and other seemingly extra design details that infuse the web with life, personality, and fun.
Neat is a free tool that generates beautiful gradient animations for websites with a wide range of customization options.
Get inspired by exploring this library of real and fictional logos.
Instagram has revamped its app's motion design to add a more human and imperfect touch to its brand. Inspired by natural human interactions like tapping and scrolling, this comprehensive motion system, created by Studio Dumbar/Dept, was guided by design rules that embrace imperfection, incorporate techniques that mimic accurate camera movements, and integrate the creators' experience.
There's a disturbing paradox in the design industry. In most businesses, design managers have been explicitly trained to avoid getting involved beyond people and operations. On the other hand, many designers follow industry standards too much and need help thinking outside the box. Management needs to drive business outcomes actively and designers must create work that solves user problems and differentiates your product from the competition. Otherwise, all the people-oriented work will not matter since the product will only last for a while.
This article examines the differences between Apple and Android designs over the years. It reveals the UX philosophies that underpin their design choices and offers vital lessons for crafting products that resonate. Android values flexibility, adapting to user preferences while maintaining a cohesive user experience through collaboration with device manufacturers, unlike Apple, who emphasizes rigorous market research, extensive user feedback, and highly emotional and practical products.
This is an assessment (and a beautiful data visualization) of Rolling Stone’s approach to picking the best albums.
"Food Type" by Gabriel Pang, an expert in branding, graphic design, and illustration, transforms everyday edibles into stunning alphabet representations.
Peter Deng, OpenAI's VP of Consumer Product, dodged a question about artist compensation for training data, reflecting the delicate legal position that OpenAI and similar companies find themselves in when using data to train generative AI.
Startup acquisitions by other startups hit a 3-year low in 2023 and continue to look sluggish in 2024. With valuations falling and big tech acquirers steering clear, startups looking to sell may have limited options and may have to settle for smaller deals focused on investor returns rather than big exits.
Applied Intuition, a leader in autonomous vehicle software, raised $250 million in Series E funding. This values the company at $6 billion, a 67% increase from its previous valuation. Its generative AI tech is used in developing software for automotive, trucking, and other industries, leading to profitable triple-digit growth and partnerships with major manufacturers.
AI start-up Cognition has launched Devin, a groundbreaking AI software engineer capable of autonomously managing full development projects, from coding to execution. Unlike other coding assistants, Devin can independently handle a wide range of software engineering tasks, demonstrating superior performance compared to other models like Claude 2, SWE-Llama-13b, and GPT-4 in the SWE-bench test by resolving 13.86% of issues end-to-end without human intervention.
Amplitude's journey from a failed YC pitch to a $4 billion public company is a masterclass in perseverance. Despite initially gaining traction for their voice-to-text app, the founders pivoted after being unable to solve retention issues. Their story shows the importance of listening to users, boldly charging higher prices when possible, and being willing to abandon products that aren't working.
Firing someone is never easy, but waiting too long can be costly for everyone. This candid account reveals how holding onto underperforming employees slows down productivity and ultimately kills team morale. Trust your gut and act decisively. Your future self — and your team — will thank you.
This author challenges the conventional VC wisdom that only large, mass-market opportunities are worth pursuing. They make a compelling case for the hidden value in smaller, specialized markets by detailing the success of Procore and advocating for a strategic approach to market segmentation and niche market exploitation. Founders and investors alike should reconsider their assumptions about market size and potential – the next big success story may well emerge from a niche market.
<250 ms latency text-to-speech API.