Lifelong Learning (LL) is a growing area of machine learning research in which AI agents continually learn as they encounter new tasks while retaining knowledge of previous tasks. A team of LL researchers recently discovered that AI agents can quickly learn a wide range of tasks by sharing knowledge with each other at the same time. Their system has many similarities with the concept of crowdsourcing. The researchers believe that their technique could transform any field that requires vast, diverse knowledge or dealing with complex systems.
A limited public beta release of GitHub Copilot Chat is now available to enterprise companies and organizations on Visual Studio and VS Code. GitHub Copilot Chat turns GitHub Pilot into a context-aware conversational assistant, allowing developers to execute tasks with prompts. The feature will help developers create much faster and democratize software development as we know it. Information on how organization admins can enable the feature is available in the article.
Ollama allows users to run and package large language models on macOS. It includes a library of open-source models, including Llama2, Orca Mini, Vicuna, and Nous-Hermes. At least 8 GB of RAM is needed to run the 3B models, 16 GB for the 7B models, and 32 GB for the 13B models.
Netflix is in better financial shape than its industry rivals and can make better deals. It will likely not be affected by ongoing strikes in Hollywood by writers and actors. Netflix could force a settlement to the strikes before its rivals get back to business. Wall Street analysts estimate that Netflix will be earning up to $9.5 billion annually by 2025.
Several companies, including Microsoft, Google, and OpenAI, have committed to certain safeguards for their technology until Congress passes legislation to regulate AI. Officials want to make sure that the technology is developed responsibly and in a way that benefits society without negatively impacting the safety, rights, and democratic values of the public. The tech firms have agreed to eight measures, including letting independent experts test models for bad behavior, investing in cybersecurity, flagging societal risks, and watermarking AI-generated audio and visual content. A full list of the measures is available in the article.
Chrome extensions in Chrome 116 will allow developers to programmatically open a Sidepanel, record audio and video in the background, keep service workers alive for longer, and much more.
Meta's recent deal with Microsoft to bring LLaMA to Microsoft's Azure platform suggests that the industry may see a growing number of partnerships, not just head-to-head competition.
Meta and Microsoft have announced the support for Llama 2, a family of large language models, on Azure and Windows, marking its first commercial release. The partnership enables developers to build, fine-tune, and deploy Llama 2-powered models on Azure while also optimizing for local use on Windows. It aims to bolster Azure’s model catalog, democratize AI, and reinforce Microsoft’s position as a global supercomputing platform for AI, while also upholding responsible AI practices through safety measures and risk mitigation.
Google is testing Genesis, an AI tool designed to help journalists by generating news articles. Despite these innovations, concerns remain over misinformation and bias if such tools are not accurately supervised.
Tech giants including Microsoft, Google, and OpenAI are voluntarily committing to White House-prompted safeguards for their AI technology, including independent testing and addressing societal risks. This pledge will be in effect until Congress enacts official AI regulations.
Google DeepMind researchers are presenting more than 80 new papers at ICML this year, including demos on AlphaFold, advances in fusion science, and new models, like PaLM-E for robotics and Phenaki for generating video from text.
Much of modern AI relies on large matrix multiplications. When implemented in hardware, this means there are expensive multiply components on the chips. If we could use cheap additions instead, we could fit more transistors on the chip and potentially run with much less power. This is very early research, but the algorithm presented suggests we can use just additions for large matrix multiplications.
Another deep learning library, this time by Apple and it is built on top of Jax. Notably, it supports compiler-based parallelism for large-scale training, which is a feature not present in several other popular frameworks.
Deploy a private ChatGPT alternative hosted within your VPC. Connect it to your organization's knowledge base and use it as a corporate oracle. Supports open-source LLMs like Llama 2, Falcon, and GPT4All.
Instead of using a vector store to index directly over the data, you can use metadata and an existing query language to dramatically improve the quality of retrieved data.
This blog walks through the reimplementation of a thousand lines of C++ in an opencv function to a few lines of Mojo. They discuss the trade offs and speed ups. Mojo still doesn't have a local release, but it is expected to come soon.
A nice, high-level discussion around the key components, emerging trends, and industry players working in generative AI. There’s lots of information here around foundation models, compute, frameworks, orchestration, fine-tuning, synthetic data, and more!
OpenAI just launched custom instructions for ChatGPT users, so they don’t have to write the same instruction prompts to the chatbot every time they interact with it.
GitHub has announced that its new Copilot Chat feature — a ChatGPT-like experience designed to help developers with coding — is now available as a limited public beta for enterprise companies and organizations.
Amidst regulatory concerns, Coinbase is terminating its Borrow program for retail customers, officially sunsetting it on November 20. The move comes after it disallowed new loans earlier in May. Borrow users have until the end date to repay any remaining balances, and Coinbase will sell any Bitcoin collateral needed to close the loans. This decision is confined to retail customers and doesn't impact institutional users or Coinbase Prime customers. The decision to scrap the Borrow program happens amidst ongoing legal dispute between Coinbase and the SEC.
An investors group, headed by Matthew Roszak from Tally Capital and Peter Vessenes from Capital6, is on the verge of buying cryptocurrency media firm CoinDesk for around $125 million. The deal is in its final stages. CoinDesk is owned by DCG, which has had a myriad of financial issues this year. Since these issues began, DCG has been looking for suitors to help remedy the situation. The parent company hired Lazard back in January to begin exploring a sale.
Starknet is launching Appchains to provide applications with more customization and performance capabilities. Appchains allow applications to utilize Starknet’s technology while modifying it to meet the application's unique needs. Starknet, known for its scalability, will offer apps additional throughput and an enhanced user experience. The benefits of Appchains also include customizability, decentralization, and expressiveness, allowing for unique features, blockchain parameters, and increased network security. The underlying Cairo-powered Starknet Stack utilizes a Rust-like and ergonomic language for more expressive smart contracts.
Synthetix has integrated Chainlink's Cross-Chain Interoperability Protocol into its v3 protocol, marking a groundbreaking use of Chainlink CCIP. The upgrade allows for efficient and secure cross-chain transfers of sUSD via the Synthetix Teleporter, initially facilitating movements between Ethereum and Optimism. This development opens a pathway for additional expansions to other EVM-compatible chains. The integration establishes shared collateral across multiple chains while keeping the total supply of sUSD constant. Synthetix is also exploring the possibility of utilizing Chainlink CCIP for cross-chain synthetic perpetual futures and staking pools, among other uses.
In this Twitter thread, Punk 6529 breaks down how NFTs can be useful beyond just being collectibles, specifically focusing on ENS. Many NFTs to date have been purely collectible or experimental, but ENS exhibits exceptional utility and real network effects. Many applications integrate ENS as a standard practice and a vast number of users have adopted ENS names as their identities, so a large network effect has already been built out. Additionally, the names are a great alternative to confusing blockchain addresses, akin to domain names versus IP addresses. Many people will argue that you could use other name spaces like .sol or .crypto, but .eth is basically a parallel to .com in the 90s, so infrastructure should keep being built on top of ENS.
Telegram trading bots have been all the rage over the past month or so. These bots can automate all manner of on-chain transactions, such as sniping DEX listings, tracking wallets, managing airdrops, and bridging funds. They provide a simple interface on a platform that many crypto users are already spending vast amounts of time on for regular peer-to-peer communications, making them an ideal solution for a number of core issues in crypto, like poor user interface. Protocols like Maestro and Unibot are leading the market - Maestro is generating over $140k in daily fees, and Unibot's token has surged over 100x in just two months.
This Twitter thread breaks down how USDC on Coinbase's Advanced Trade retains its ability to earn rewards, even when limit orders are placed with the funds. Funds rest on the order book and are only filled once the set limit – possibly lower than the current market price – is reached. Even though these funds are inaccessible during that time, users continue to earn rewards, provided they are eligible for USDC incentives. Importantly, this only happens with USDC and not USD on the platform. This novel feature is not yet available on any other crypto platform or traditional finance products.
In an interview at EthCC, Chainlink's co-founder Sergey Nazarov explained how he foresees banks adopting their own blockchains and connecting them via Chainlink's newly launched CCIP protocol. Nazarov suggests this could inject trillions of dollars into the crypto space. As banks tokenize real-world assets, they are predicted to want their own blockchain to maintain complete control. Chainlink's CCIP infrastructure facilitates secure movement of assets between blockchains and is currently being tested with crypto projects. Nazarov expects banks to develop their own stablecoins operating cross-chain via CCIP, once regulations allow for it.
Cymbal, a tech firm including team members from Meta, Microsoft, and Hulu, is aiming to make blockchain data more understandable for everyone with its newly launched human-readable block explorer.
This article explains how Morgan Stanley-backed Securitize Inc. navigated a complex three-year process to become one of the few crypto companies registered with the SEC, a task others in the sector argue is excessively challenging.
The UK government rejected proposals to regulate crypto like gambling, arguing that existing plans to apply traditional financial rules better address crypto-associated risks.
Sequoia Capital, one of the most high profile VC firms, is experiencing a significant leadership transition following the departures of five key investors, including two of their crypto investors.
Less venture funding dollars are going to space tech startups. In 2021, $12.1 billion went to space tech across 450 deals. In 2022, this decreased by 25% to $9 billion. So far in 2023, we’ve only seen $2.4 billion go to them. To the moon, maybe, maybe not.
UC Berkeley researchers found that ChatGPT has not improved over time, and in fact, may have gotten worse. The researchers suggest that one of the reasons for this decline could be the result of new safety protocols being implemented by OpenAI.
Five partners are leaving the firm, but the headline is that Mike Moritz is officially moving on after 38 years service. As the venture capital scene gets more competitive, it’ll be interesting to see what 2024 and beyond has in store for Sequoia.
This article explores the metrics you should be aware of as you build out your product-led growth muscle at your SaaS company. It double-clicks on the funnel conversions you can expect from when a visitor lands on your website and eventually becomes a paying customer.
Gergely, writer at The Pragmatic Engineer, interviews Jean Yang, the founder of Akita, which was very recently acquired by Postman. They dive into finding your co-founder, fundraising, hiring, pivoting, and all the challenges faced along the way.
2023.07.21·
blog.pragmaticengineer.com·11 min read·TLDR Founders
AI has long played a role in games, from procedurally generated environments, to machine learning and NPC behavior. Generative AI is the next frontier in game development, enabling hyper personalization and adaptive environments. How about a game that designs itself and never ends?
An insightful read that digs into the positive correlation between wealth and social liability. In today’s society, the wealthier you get, the more you feel a responsibility to give back to family, friends, and the global community.
As a founder, you want to get things done fast and see results now. Sometimes this isn’t always possible. Godin provides a nice reminder that we have to be persistently patient.
File this under “problems we’d like to have” - thinking through being worth 18x ARR with continuing massive growth across every KPI. Fascinating read and something to aspire to.
The main problem front-end frameworks set out to solve is change detection, meaning detecting changes to application state so that the UI can be updated accordingly. This article dives deep into how each framework (React, Angular, Vue, and Svelte) tackles change detection. For example, React’s change detection is straightforward, while Angular’s change detection is a disaster.