Full-text search across article titles and summaries. Refine with sector, year, content type, and reading-time filters.
This post summarizes some of the common knowledge among people who train large-scale models. It covers parallelizing and memory-saving tricks, how to communicate state between these GPUs as quickly as possible, and how to recover from failures as quickly as possible. A list of resources for further reading is available.
The imbalance between major contributors and those who contribute minimally harms open source communities. This, along with a lack of an environment that supports the fair coexistence of open source businesses, could discourage entrepreneurs from starting open source businesses, which could harm the future of open source. Solving these challenges by creating a more equitable and sustainable open source ecosystem would help strengthen the future of open source.
The median year-over-year pay increase for job switchers has fallen and is now at its lowest growth rate since April 2021. The gap between pay gains for job changers and job stayers is at its narrowest since January and a far cry from the levels seen during the 2022-2023 'Great Resignation'. This indicates that the labor market is currently less dynamic. The slowdown could characterize the labor market data for the rest of 2024 as quits and layoffs remain low.
Sponsored
Grab the attention of software developers, product managers, marketers, executives, and other tech professionals reading TLDR every day. Learn more [16] about running your first campaign with us.
The base credit line is $4 billion, with an option to increase it by an additional $2 billion.
Zero is a set of types and functions that enables JSX to be transpiled into DOM nodes.
Data Leakage is the use of information during training and/or evaluation of machine learning models that is not available in deployment.
Photos and videos captured on the Ray-Ban Meta glasses will not be used for AI training as long as users don't submit them to AI.
The month-long assault targeted organizations in the financial services, internet, and telecommunications sectors.
Avra Capital is a trade school that monetizes through venture capital.
Sponsored
THE ENTERPRISE READY CONFERENCE IS A [5]one-day event in SF [6], bringing together product and engineering leaders shaping the future of enterprise SaaS.
Sponsored
Ready to reach your goals? SNHU is a private, nonprofit, accredited university that offers some of the lowest online tuition rates in the nation. Explore 200+ online degree programs [5].
OpenAI has raised $6.6 billion in new funding, with investors valuing the startup at $157 billion. Investors in the round include Thrive Capital, Microsoft, SoftBank, and Nvidia. The startup was last valued at $86 billion early this year. Investors have the right to withdraw their money if OpenAI fails to convert to a for-profit company within two years.
iOS 18 will allow users to select which contacts to share with an app instead of revealing their entire address book. Apple doesn't think the change will hurt developers, but some startups have seen contact sharing drop significantly since the iOS 18 change. The ability to quickly connect new users with friends can mean the difference between success and failure for apps. This change could mean friend-based social apps may eventually be replaced by apps like TikTok which show users content based on what they like rather than who they're connected to.
Teams at Google have made progress on software for AI models with humanlike reasoning abilities in recent months. The company is using chain-of-thought prompting, which allows large language models to solve multistep problems using a series of intermediate reasoning steps, to give models the ability to solve more complex math- and company-programming-related inquiries. OpenAI's new o1 model also uses chain-of-thought prompting. Google employees were worried last year that the company had fallen behind in the AI race, but they are now less concerned now that Google has unveiled more products to compete with.
Researchers now have a map of the brain of a single female fruit fly that includes nearly 140,000 neurons and captures more than 54.5 million synapses. The map was described in a package of nine papers by a consortium known as FlyWire, which is co-led by neuroscientists Mala Murthy and Sebastian Seung at Princeton University in New Jersey. It has been in development for more than four years. The map shows how neurons connect through chemical synapses but doesn't offer any information about electrical connectivity between neurons or how neurons chemically communicate outside synapses.
Sponsored
Pipet is a tool for scraping and extracting data from online assets. Made for hackers, the command line-based web scraper supports HTML parsing, JSON parsing, and client-side JavaScript emulation. It can be used to track shipments, receive notifications, monitor stock prices, and much more.
This blog post lists several command-line tools that just work out-of-the-box. These include Fish, Helix, Lazygit, and Zellij. Developers should strive to make the default experience of their apps work really well for most people.
Automattic asked WP Engine to hand over 8% of its revenue each month in a deal sent on September 20. WP Engine was given the choice to pay the 8% cut as a royalty fee to Automattic or as salaries for WP Engine employees who would contribute to the WordPress.org open-source project. It didn't accept the proposal as it believes that its use of the WordPress trademark and 'WP' abbreviations meet fair use guidelines. Automattic says that the main issue is over trademarks, not the use of open source software.
Gmail's new summary cards will now start appearing inside of individual messages on iOS and Android, starting with purchases but expanding to more categories soon.
TinyJS is a JavaScript library that allows developers to generate any standard HTML tag programmatically, apply properties, append content, and select DOM elements with ease.
The cheapest Tesla is now the Model 3 Long Range Rear-Wheel-Drive at $42,500.
A look at regular mistakes made in job adverts aimed at helping recruiters write better listings.
Google and Samsung are also partnering on a high-end mixed-reality headset to take on the Apple Vision Pro.
This post discusses how to allow users to do as much as possible when offline even when everything the user does in an app is related to an API request.
Sponsored
Exciting things are happening in fintech. Get the free ebook [4] to learn about 5 startups unlocking faster growth with Plaid.
Apple is nearing production of an updated iPhone SE that will become its new entry-level model. This will be the first update to the iPhone SE since 2022. It is expected to support Apple Intelligence and resemble the iPhone 14. Apple is also aiming to manufacture new iPad Air models and keyboards for release around the same time.
One of the lesser-known co-founders of OpenAI, Durk Kingma, is joining Anthropic. He has not revealed which org he will be joining or leading. Kingma will be working remotely mostly from the Netherlands, but will visit the San Francisco Bay Area as frequently as possible. Anthropic has also previously recruited OpenAI's former safety lead and another OpenAI co-founder. Its CEO was once the VP of research at OpenAI.
3D-printed architecture firm Icon is now constructing its El Cosmico campground hotel project in the Texas desert. The 3D-printed hotel will have camping areas, a central swimming pool, vacation homes, shared amenities, and some permanent residences. The permanent residences will be up for sale starting at $2.29 million. There will be some affordable 3D-printed housing for the local community. Renders of the project are available.
Asteroid 2024 PTS, which usually orbits the Sun as part of a small asteroid belt that follows Earth, should now be orbiting Earth as a second moon. The mini-moon event will end on November 25. These gravitational capture events are quite common. 2024 PTS won't be observable to the average skywatcher. After its brief stay around Earth, the asteroid will continue to orbit the sun as part of the Arjuna family of asteroids.
Sponsored
Use this simple reference to track Azure OpenAI usage and performance with Datadog's preconfigured dashboard. Monitor your API requests and token usage, track performance in aggregate, by language model, and
OpenAI unveiled four major API updates for developers on Monday at its DevDay 2024 event in San Francisco. The most notable new API feature is the Realtime API, which enables developers to build features similar to ChatGPT's Advanced Voice Mode into their applications. It streamlines the process of creating voice assistants so developers can handle speech recognition, text processing, and text-to-speech conversion with a single API call. The other API updates enable developers to fine-tune smaller and cheaper models from more advanced models, speed up inference by remembering frequently used prompts, and fine-tune models using images.
GitHub has unveiled enhancements for GitHub Issues that make it easier to break down work, visualize progress, and categorize and find the right issues on GitHub. They include sub-issues, issue types, and advanced search for issues. This post covers the highlights. The new features are now available in public preview.
More than 60% of ProductHunt's over 1 million signups are bots. Most of the comments on products now seem to be generated by ChatGPT. It is likely that some people are purchasing upvotes. This post looks at data from the site to show how much of its traffic is generated by bot activity.
The Department of Justice has just wrapped up a trial where it argued that Google has created illegal monopolies in the ad tech market. Google has a variety of defenses, ranging from Supreme Court precedent to security concerns. One of its biggest arguments was that the agency doesn't understand advertising and that it was slicing up the market in a way that doesn't make sense. Google also claims the agency is ignoring Google's biggest advertising competition, social media. The trial will resume for closing arguments on November 25.
Sponsored
You don't need to put your career on pause to get a high-quality education. Browse 200+ affordable, online degree programs at SNHU — an accredited, nonprofit institution. Start here (US learners only)
This post discusses how a developer created a local-first trip-planning app.
A team of quantum physicists from the University of Toronto observed photons exiting a material before entering it.
Microsoft Cloud + AI Group Executive Vice President Scott Guthrie allegedly said to staff that Microsoft won't return to working in the office five days a week unless it notices a lag in productivity.
Sourcebot is a tool that can effortlessly index and search through multiple public and private repositories in GitHub or GitLab.
The world isn't running out of sand, we're just more aware of the cost involved in procuring it and taking more account for how using it affects the environment.
Sponsored
Bugs sneak out when less than 80% of user flows are tested before shipping. However, getting that kind of coverage — and staying there — is hard and pricey for any team.