Search the archive

10 REASONS WHY STATIC SITE GENERATORS ARE PERFECT FOR MODERN WEB DEVELOPMENT

Static site generators offer simplicity, flexibility, performance, versatility, and developer-friendliness.

REGEX CHARACTER “$” DOESN'T MEAN “END-OF-STRING”

The regex character '$' doesn't always mean "end-of-string" in Python - it also matches the position before a trailing newline, making reliable end-of-string matching language-dependent.

THE ARCHITECTURE OF DOORDASH'S SEARCH ENGINE

Elasticsearch was not scaling well for DoorDash’s search engine and lacked customization for the company’s needs in modeling complex data and search ranking, so DoorDash built its own search engine using Apache Lucene, a core search library, and designed its own indexer and searcher to meet its specific requirements. The indexer processes documents into easily searchable formats, while the searcher replicates index data and uses Lucene's search functionality to match queries and rank results.

UNDERSTANDING GOOGLE’S FILE SYSTEM

When Google revealed its File System (GFS), it was a breakthrough in distributed storage. Designed for storing massive files across commodity hardware, GFS stored files in 64MB chunks replicated across machines for redundancy and performance. A central "master" managed metadata (file names, chunk locations, and versions) and coordinated reads/writes. To append data to files, the client would get write permission from the master, send data to multiple chunk servers, and have the designated "primary" server coordinate final writes.

A BEGINNER'S GUIDE TO NODE.JS WORKER THREADS

Worker threads provide a way to create independent JavaScript execution threads that run in parallel. This post walks through an example of offloading CPU-intensive tasks to a worker thread in Node.js. Without offloading, tasks can block the event loop and prevent the server from processing other requests. The article shows an example of the server going from processing 7.3k requests to 0 tasks due to a CPU-intensive task.

HOW TO START GOOGLE

Paul Graham, the founder of Y Combinator, gives advice to people who want to create the next Google. They should be makers and work on their own passion projects to learn fast. The best ideas come from projects you build for yourself and your friends to use. Something you truly need is a great sign. Great co-founders come from working together on things.

IS THE “AI DEVELOPER” A THREAT TO JOBS – OR A MARKETING STUNT?

AI tools like Devin claim to replace software engineers. These startups face an uphill battle against established AI coding assistants like GitHub Copilot, so their claims need to be bold to get attention. For decades, there have been attempts to automate away the need for programmers, yet software engineers remain high in demand. The future likely lies in improved versions of existing AI coding assistants, not standalone "AI developers."

BUILD SYSTEM SCHISM: THE CURSE OF META BUILD SYSTEMS

Meta’s build systems follow a two-step process. The first step generates instructions for what to build and the second step executes the build. This separation makes them inflexible, as you can't add new files without re-running the first step. "End-to-end" (E2E) systems combine both steps, allowing for dynamic target discovery. In these systems, cloud caching, early cutoff, suspending schedulers, and minimal builds are all features easier to implement correctly.

Build fast, build secure. Try Veracode DAST Essentials free

ETA

Eta is a lightweight and fast embedded JavaScript templating engine that works inside Node, Deno, and the browser. It is written in TypeScript and emphasizes great performance, configurability, and small bundle size.

CAPO.JS

How you order elements in the `head` tag can have an effect on the perceived performance of the page. Capo.js helps identify which elements are out of order in your `head` tag on a web page.

GARNET

Garnet is a remote cache store developed by Microsoft Research. It is compatible with standard Redis clients and features a wide range of APIs, custom server-side operations, a robust storage layer, security, and more.

WHY DOES AN EXTRANEOUS BUILD STEP MAKE MY ZIG APP 10X FASTER?

This author built a Zig implementation of an Ethereum virtual machine with the aim of making it faster than the official Go version. A seemingly unrelated change to a benchmarking script made the Zig app slower. This was because commands in bash pipelines run in parallel, so a Zig app, when freshly compiled, has to wait for input from preceding commands. The author limited memory usage at compile time and used buffered reads to make his implementation faster than the official Go version.

INSIDE THE MASSIVE ALLEGED AT&T DATA BREACH

An alleged AT&T data breach leaked data on 70 million customers, including sensitive information like SSNs. AT&T maintains the data did not originate from its systems, leaving the source of the breach unclear. The accuracy of the leaked data, which has now been dumped publicly, has been verified.

PARSING THE HN WHO IS HIRING THREAD WITH CHATGPT AND NODE.JS

This author built a tech job board based on Hacker News threads using Node.js and the ChatGPT API. They found that ChatGPT was good at converting unstructured job post text into structured JSON data. The input size for the OpenAI API calls was optimized to stay within token limits and concurrent requests were made to speed up the entire process. They then used Node.js, TypeScript, and SQLite to track and store data. Most work in building AI apps is in building the infrastructure around it and handling error cases.

WHO COMMITS CODE AND AT WHAT FREQUENCY?

The median active developer merges 2 PRs per week. 48% of active developers are responsible for 80% of PRs merged since 2023.

JNV

jnv is designed for navigating JSON, offering an interactive JSON viewer and jq filter editor.

C++ CREATOR REBUTS WHITE HOUSE WARNING

Bjarne Stroustrup, the creator of C++, disagrees with the White House's recommendation to avoid C++ due to memory safety concerns, as the language has improved its safety over time.

JAVA 22 / JDK 22: GENERAL AVAILABILITY

Java 22 has been officially released.

WEBSOCKETS VS SERVER-SENT-EVENTS VS LONG-POLLING VS WEBRTC VS WEBTRANSPORT

There are many options for sending updates from the server to clients for real-time web applications such as Long-Polling, WebSockets, Server-Sent Events, and WebTransport. Long-Polling is outdated and inefficient, while WebTransport is new and promising but lacks widespread support. WebSockets are ideal for two-way communication in scenarios like chats and games, while Server-Sent Events are great for server-to-client updates.

IS AWS LAMBDA COLD START STILL AN ISSUE?

A Lambda cold start refers to the initial delay experienced when an AWS Lambda function is invoked after being idle. The duration of a cold start varies from under 100 ms to over one second, the latter of which occurs in about 1% of all invocations. This article goes into detail on ways you can optimize cold start latency, such as fine-tuning memory for your function, using ARM64 CPU architecture, optimizing function creation methods, and more.

THE MECHANICS OF ASYNC AWAIT

Under the hood, async/await is built on promises, where the async function returns a promise that represents the eventual result. The event loop handles promise resolution by tracking promises and resuming suspended processes when promises are fulfilled. There’s a notion that async/await is inherently non-blocking, but that’s not true, as shown by a code example within this article.

THOUGHTS ON THE FUTURE OF SOFTWARE DEVELOPMENT

Software development is more than just coding. AI tools like ChatGPT help with specific tasks, but they can't replace the full range of developer responsibilities, which include design, deployment, gathering requirements, and more. Engineering is also about managing complexity - AI may not be able to translate business problems into software solutions properly. The market for technology is expanding, so while AI may automate some tasks, the overall demand to solve business problems will continue to grow.

WHAT I WISH I KNEW ABOUT ESPP AND RSUS SOONER

ESPPs (Employee Stock Purchase Plans) let you buy company stock at a discount, which can be profitable if the stock price rises. RSUs (Restricted Stock Units) are promised shares that vest over time. When they vest, their value becomes taxable income. Use the ESPP discount to buy shares, then immediately sell for a profit if you don't believe in the stock's long-term growth. For RSUs, if you don’t want the stock, sell them immediately upon vesting. This avoids price fluctuations and the tax implications of holding the stock.

WHY AMAZON'S CULTURE MAKES ME A BETTER ENGINEER

Amazon's leadership principles create shared expectations across roles and ensure that everyone is working toward common goals. The company prioritizes a single obsession to create a focused direction, with the goal of becoming the best in the chosen area. This allows for clear guidelines of success for both products created and for clearer role guidelines on an individual level, removing ambiguity from performance evaluations.

experienced developers. Fit the bill? Apply now

TEAMCITY PIPELINES

JetBrains has released TeamCity Pipelines, which offers self-tuning CI/CD pipelines to help developers stay in flow.

SHIKI

Shiki is a syntax highlighter that runs on any JavaScript runtime and works with VS Code.

PLANKA

Planka is a real-time Kanban board built with React and Redux. It can be used to create projects, boards, lists, labels, cards, and more. Planka supports Markdown, filtering, real-time updates, and internal notifications.

OH SH*T, MY APP IS SUCCESSFUL AND I DIDN’T THINK ABOUT ACCESSIBILITY

Apps built without considering accessibility can miss out on a significant portion of users. Retrofitting accessibility can be difficult. This article shows how to improve accessibility within a SwiftUI iOS app. The process involved auditing the app, fixing text scaling, implementing views when necessary, improving accessibility for screen readers, and using native components when possible. In general, it’s easier to develop while keeping accessibility in mind than to rehaul applications to be more accessible after the fact.

BEFORE THE CROWD SHOWS UP

Success often comes from being among the first to engage with new opportunities or "arenas". Arenas can be communities, platforms, movements, technologies, or even physical spaces like coffee shops or cities. Early arrivals in a new arena enjoy advantages like easier networking, access to important figures, insider knowledge, and professional opportunities. However, new arenas are also inherently risky. Developers should focus on identifying a niche within an “arena” regardless of when they arrive and focus on contributing as much value as possible.

LOOK MA, I WROTE A NEW JIT COMPILER FOR POSTGRESQL

pg-copyjit is a new experimental PostgreSQL JIT compiler designed to be faster than the existing LLVM JIT. The compiler has reduced overhead as it prioritizes producing "fast enough" code quickly and uses a "copy-and-patch" method that stitches together pre-compiled code snippets for speed.

ASK HN: HOW TO CHANGE JOBS WITH ALMOST NO INTERVIEWING EXPERIENCE? (HACKER NEWS THREAD)

It’s helpful to practice mock interviews and interview with many companies when switching jobs without any interviewing experience.

TEST GENERATOR | PLAYWRIGHT

Playwright comes with the ability to generate tests for you as you perform actions in the browser.

A NEW SERVERLESS POSTGRES PLATFORM

Xata, a database platform, now offers a serverless Postgres service.

DESIGN IS AN ISLAND

Developers should be prepared for both incremental adjustments and significant re-designs when designing software.

HOW WEB BLOAT IMPACTS USERS WITH SLOW DEVICES

The web has seen an increase in complexity, slowing it down significantly for users with low-end devices or slow internet connections. Modern web apps are CPU-hungry. Even with fast internet, websites like Threads and Patreon take a long time to load on low-end phones because of CPU demands. Most developers believe that hardware will get faster and solve performance issues, but hardware improvements slow down over time. Instead, deliberate optimization to reduce CPU impact is crucial in making the web usable for everyone as web bloat locks people from countries with slower internet speeds out.

LAMBDA ON HARD MODE: INSIDE MODAL'S WEB INFRASTRUCTURE

Modal's HTTP and WebSocket stack for serverless functions allows for seamless web endpoint deployment and real-time communication capabilities. To overcome the limits of traditional serverless platforms, Modal designed a system that can handle demanding workloads, offering extensive CPU, memory, and GPU resources. Modal treats HTTP/WebSocket requests like function calls and leverages Rust and ASGI (Asynchronous Server Gateway Interface) for efficient processing.

PASSKEYS – UNDER THE HOOD

Passkeys are an alternative to traditional passwords designed to be phishing-resistant and user-friendly. Unlike hardware security keys, passkeys can be backed up and synced across devices. However, since the private key is stored on the device with passkeys, this can potentially make passkeys less secure than hardware keys, unless private keys are exportable.

HERE'S WHAT DEVELOPERS FOUND AFTER TESTING DEVIN AI

Devin AI is a recently released software engineering tool. This post looked at how Devin created 4 projects: setting up a Chatbot, creating a US airport map, developing a chess website, and crafting a Chrome extension. It highlights Devin's coding and debugging capabilities and potential to replace software developers.

A FEW WORDS ON TESTING

Years of encountering slow, unreliable tests and fixing bugs without adding tests have shaken this author’s faith in testing as the ultimate quality indicator. There are many high-quality projects that run surprisingly few tests. The key to software quality isn't the amount of testing, but rather prioritizing tests based on developer judgment and having developers that deeply care about their work.

THE HIGH-RISK REFACTORING

Before starting a refactor, developers should carefully assess the potential costs of failure (lost revenue, damaged trust, etc.) and how those risks can be mitigated. Refactors should be isolated from feature development and be rigorously tested. Sometimes, the best choice can be to not do a refactor.

FREE savings estimate

SATCSS

A CSS refactoring tool that minimizes CSS files.

PRETZEL

Pretzel is an offline tool for exploring and visualizing large datasets directly within a web browser. Its interface and automatic updates streamline data manipulation, eliminating the need for complex setups.