Databricks recently announced an AI-generated documentation feature, using large language models (LLMs) to automate documentation for tables and columns, with over 80% of the company’s table metadata updates now AI-assisted. A bespoke LLM was developed by two Databricks engineers in one month for under $1,000 in compute costs, resulting in high quality, fast throughput, and low costs. This new model, MPT-7B, fine-tuned on around 3,600 examples, addresses issues of documentation in data platforms and demonstrates the feasibility and efficiency of creating custom LLMs for specific tasks.
Complex codebases lead to change amplification, where simple changes require modifications in multiple places, slowing down the process. Research on 1.5 million pull requests showed that the number of files changed in a pull request (PR) correlates with the time taken to merge it. To minimize complexity and enhance efficiency, it's recommended to keep PRs small, limit them to three or fewer file changes, and use strategies like stacking if possible.
It’s important to take time to make consequential decisions, rather than responding under pressure or panic. While quick action has its place, big decisions rarely require instant responses. Instead, be prepared, consider the best alternatives, and make decisions with a substantial amount of information rather than wait for perfect information.
Trace allows developers to create SwiftUI components and screens for mobile apps with natural language. The application allows for the iterative development of iOS apps in the browser, along with the ability to export files to Xcode for further development.
A new generation of AWS Amplify, an AWS backend platform, has been released. It transitions Amplify to a code-first DX, allowing developers to succinctly express app requirements like data models, business logic, and authorization rules in TypeScript. Core new features include Typescript and monorepo support, per-developer cloud sandbox environments, a unified Amplify console, and the ability to use AWS CDK code inline.
StabilityAI has released Stable Video Diffusion as open-source. Stable Video Diffusion can create videos using generative AI. This post shows various demos of the model in action.
Sam Altman is returning as CEO of OpenAI five days after an attempted coup by the company’s board. The OpenAI board is being overhauled and now seats Bret Taylor (former CEO of Salesforce), Larry Summers (Former United States Secretary of the Treasury), and Adam D'Angelo (CEO of Quora and already a current member of the OpenAI board).
Firefox is transitioning from Mercurial to Git for version control. The Mozilla source code, initially stored in a CVS repository since 1998, moved to Mercurial in 2007, a time when distributed version control systems (DVCS) like Git and Mercurial were just emerging. The choice of Mercurial was largely influenced by Git's subpar performance on Windows at the time. Over the years, as Git gained popularity and GitHub became a major platform for open-source projects, more Mozilla developers began using Git. As a result, Mozilla decided to finally move over to Git to keep up with current developer trends.
Amazon CodeWhisperer for the command line includes IDE-style completions for 500+ CLIs and natural language-to-bash translation.
Chrome Extensions using Manifest V2 will start being disabled as early as June 2024.
A deep dive into advanced techniques and best practices for securing Docker containers against cyber attacks.
Microsoft has hired Sam Altman and Greg Brockman to lead its new advanced AI research team. Altman will be the CEO of this new group. The new team will include some key OpenAI talent. Former Twitch CEO and co-founder Emmett Shear has been named as interim CEO at OpenAI. Altman had been negotiating a return to OpenAI, but the company's board refused to step down and let him return. Microsoft still has a multibillion-dollar investment in OpenAI and will remain committed to its partnership with the company.
2023.11.21·theverge.com·4 min read·TLDR Most of the staff at OpenAI have threatened to resign from the company and join Microsoft. Microsoft has assured OpenAI staff that there are positions for all OpenAI employees in its new advanced AI research team should they choose to join. Over 650 out of a total of 770 OpenAI staff have signed a letter saying they will leave if the board doesn't reinstate Sam Altman and Greg Brockman and then resign. The board seems to have decided to remain in place - they have named a new CEO, Emmett Shear.
2023.11.21·theverge.com·4 min read·TLDR Kernel, a new endeavor from the founder of Chipotle, is a vegetarian fast-casual restaurant that will be operated mostly by robots. There are plans to open at least 15 locations with the first opening by early 2024. The remainder will be on track for New York City in the next two years. Each location will employ three workers who will receive more pay and better benefits than people working at other chains.
2023.11.21·ny.eater.com·2 min read·TLDR A new type of heat pump developed by materials scientists at the Luxembourg Institute of Science and Technology in Belvaux uses electric fields and a special ceramic to warm or cool air. The technology combines a number of existing techniques and could be potentially competitive with heat pumps without the need for refrigerants in a smaller space. It still needs to be refined further before it is ready for commercialization.
2023.11.21·nature.com·2 min read·TLDR This thread looks at the experience of those who have maintained open-source software at work, particularly those with forks of abandoned projects and forks that diverged from upstream. The replies in the thread are long and detailed.
Using the full power of the GPU during LLM inference requires knowing if the inference is compute-bound or memory-bound. Calculating the operations per byte possible on a given GPU and comparing it to the arithmetic of a model's attention layers reveals where the bottleneck is. This information can be used to pick an appropriate GPU for model inference and use techniques like batching to better utilize GPU resources.
2023.11.21·baseten.co·18 min read·TLDR OpenAI fired Sam Altman on Friday. Altman was quickly hired by Microsoft. This has caused a talent drain within OpenAI, with a good portion of it going to Microsoft. The situation highlights the problems of running a non-profit organization. This article looks at OpenAI's non-profit model, the issues within OpenAI, Microsoft's involvement, and how these recent events will change the AI landscape.
2023.11.21·stratechery.com·20 min read·TLDR Spotify doesn't pay any commission fees when it uses its own payment processor on Android. It only pays a 4% fee when users choose to use Google as their payment processor. Google fought to keep the terms of its deal with Spotify secret during its antitrust trial as it could damage negotiations with other app developers who might want more generous fees. Spotify's unprecedented popularity was enough to justify a bespoke deal.
2023.11.21·theverge.com·2 min read·TLDR Cruise's co-founder and chief product officer Daniel Kan has resigned just a day after the company's CEO Kyle Vogt announced his resignation.
2023.11.21·engadget.com·2 min read·TLDR Emmett Shear is the co-founder of the video game live-streaming company Twitch.
Some Firefox users are experiencing a five-second delay when loading YouTube videos.
2023.11.21·androidauthority.com·3 min read·TLDR This opinionated essay talks about good and bad practices in data visualization with examples and explanations.
2023.11.21·github.com·GitHub repository·TLDR More information isn't always better - index size is a trade-off against retrieval quality.
2023.11.21·matt-rickard.com·2 min read·TLDR Multiple sources say that Sam Altman and Greg Brockman are willing to return to OpenAI if the remaining board members who fired Altman stepped aside.
2023.11.21·theverge.com·6 min read·TLDR OpenAI is in disarray following the board's ousting of CEO Sam Altman, with over 700 employees threatening to leave for Microsoft. One board member who previously supported Altman's removal now regrets his decision. Microsoft, holding a 49% stake in OpenAI, has reportedly guaranteed positions for all OpenAI employees at a new AI subsidiary.
2023.11.21·nytimes.com·5 min read·TLDR AI Despite being hired by Microsoft, Sam Altman and co-founder Greg Brockman are still willing to return to OpenAI if the remaining board members who fired him step down.
2023.11.21·theverge.com·3 min read·TLDR AI 2023.11.21·theverge.com·1 min read·TLDR AI LLaVa is a recipe for training a multi-modal model from a text model. It can now work with video. The resulting model (based on Vicuna) is extremely powerful and easily achieves state-of-the-art performance in video summarization and captioning.
2023.11.21·github.com·22 min read·TLDR AI The Orca models are a set of small models from Microsoft that excel at reasoning tasks. There has been concern about validity because much of the information was kept closed. Orca 2 has now been released and the model is available on HuggingFace. It demonstrates good performance for its size, outperforming several larger models on reasoning benchmarks.
2023.11.21·microsoft.com·12 min read·TLDR AI An in-depth way to study what data was used to train language models. The results of which suggest that many closed-source models likely didn't train on popular benchmarks.
2023.11.21·arxiv.org·18 min read·TLDR AI tldraw made a viral app recently that allows users to design software quickly with its paint-like interface and then use GPT-V to generate code for a web version of the design. It works surprisingly well and generates robust and working code. It also takes natural language instructions.
2023.11.21·github.com·GitHub repository·TLDR AI A list of exploits that have been found and responsibly disclosed in AI applications.
2023.11.21·github.com·GitHub repository·TLDR AI 2023.11.21·github.com·GitHub repository·TLDR AI Microsoft has dramatically altered the AI landscape by acquiring key personnel and IP from OpenAI, including co-founders Sam Altman and Greg Brockman, following Altman's firing and Brockman's resignation from OpenAI, which was struggling with its non-profit model and internal conflicts.
2023.11.21·stratechery.com·12 min read·TLDR AI Bain Capital Ventures has created a new AI incubator and technical community called BCV Labs, offering office space, events, a fellowship program, GPU credits, and recruiting support, along with funding.
2023.11.21·news.crunchbase.com·1 min read·TLDR AI The rapid advancement of AI, particularly AGI, could significantly impact the valuation of SaaS and tech companies by increasing competition, compressing margins, and reducing the demand for traditional project management and CRUD apps, while also challenging incumbents with new AI-native startups and self-serve app creation, ultimately leading to a shift in the software value chain.
2023.11.21·nextword.substack.com·5 min read·TLDR AI Sponsored
Explain your most complex flows in seconds! Record your actions and watch Guidde add step-by-step instructions, voiceover, and more. Get
2023.11.21·guidde.com·Sponsor·TLDR AI Salesforce CEO Marc Benioff has revealed the firm will provide full compensation for OpenAI staff who join Salesforce’s Einstein Trusted AI research team.
2023.11.21·itpro.com·2 min read·TLDR AI A web ChatGPT clone entirely crafted using Rust and HTMX.
2023.11.21·github.com·GitHub repository·TLDR AI Microsoft is rebranding Bing Chat to "Copilot," unifying the name of its generative AI assistant across its products, including Bing Chat Enterprise, now also known as Copilot.
2023.11.21·engadget.com·2 min read·TLDR AI The DOJ is reportedly close to finalizing a $4 billion settlement with crypto exchange Binance. The settlement would conclude the department's investigation into the company's alleged involvement in money laundering, bank fraud, and sanctions violations. As part of the deal, Binance must meet conditions including the payment of fines, admission of non-compliance, and setting up a monitoring process for future legal compliance.
Crypto news outlet CoinDesk announced it was being acquired by Bullish, a crypto exchange led by ex-NYSE president Tom Farley. CoinDesk's parent company DCG has been facing financial issues in the wake of the collapse of FTX. CoinDesk will function as an independent subsidiary with its current management. A new editorial committee will be launched, overseen by former Wall Street Journal editor-in-chief Matt Murray.
The $60 billion DeFi market was revolutionized by the UNI V2 protocol, yet it still faces issues linked to volatility and profiteering bots. This piece discusses these issues and proposes a solution, SUClave, which utilizes UNI V4 to afford more profitability to liquidity providers and mitigate the effects of market volatility. The suggested remedy employs an auction mechanism, leading to greater profits for liquidity providers and lower fees for users.
Vega Protocol, a trading-focused blockchain, has introduced perpetual futures markets, a community-led feature where members can vote on the specific assets to be included. Previously, the settlements were limited to USDC or equivalent stablecoins, but now any ERC-20 token can be approved for settlements. The Vega Protocol has had over $850 million in trading volume so far.
This report from Token Terminal provides in-depth information on Ethereum as an investment. It covers the historical context for open protocols, how they compare to the internet, what the business model of Ethereum is, what the tech stack looks like, tokenomics, valuation frameworks, and more.
This post describes how to dive deep into MEV and transactions on ETH. With the help of system-specific tools like cryo and reth, the process is likened to reverse-engineering a puzzle to effectively identify different types of bundles (independent, backrunning, frontrunning, and backrunning) and calculate vital information like ETH tipped, ETH burned, and estimated profit. Moreover, a post-processing pipeline corrects any potential anomalies, thus ensuring the reliability of the data.
The SEC has accused crypto firm Kraken of operating an unregistered securities exchange. The charges are yet another example of the SEC's ongoing crusade to enforce stricter regulations on cryptocurrencies. Kraken has refuted these allegations, maintaining that it does not list securities. The SEC's charges also include accusations of poor record-keeping practices and alleged commingling of the company's and customers' funds.
This article outlines the concept and potential advantages of using "based rollups" on the Ethereum blockchain as an alternative to the current rollup frameworks. Based rollups allow for better scalability and interoperability without relying on third-party middleware or sacrificing Ethereum's core properties. The author highlights the simplicity, improved security, and greater economic alignment of based rollups.