This article goes over how LLMs' sizes have changed over time, starting with GPT-2 and GPT-3's parameter counts and training data specifics and ending with the limited public information about GPT-3.5 and GPT-4. Models like Mixtral and Deepseek V3 use a Mixture-of-Experts architecture, which makes them harder to compare to the traditional "dense" architectures.
The XOR (exclusive or) bitwise operation has its applications in solving interview questions. The "XOR trick" is where duplicated values in a sequence of XOR operations cancel each other out. This trick can be applied to solve problems like in-place swapping of variables, finding a missing number in an array, finding a duplicate number, and even finding two missing/duplicate numbers.
LLMs can function as compilers in the future, transforming context into software features. Instead of directly manipulating code, engineers will focus on providing context, defining tests, and iterating based on the results.
High-value work is always deep work, as focus and perseverance are necessary to solve complex problems, while motivation is from having strong personal beliefs from ego, prestige, distraction, gratitude, or social connection.
Important modern Node.js patterns for 2025 include using ES Modules with the `node:` prefix for built-in modules, using top-level await for better initialization, and using native web APIs like fetch and AbortController to reduce external dependencies.
Modern browsers automatically include `rel="noopener"` when `target="_blank"` is used, preventing a security vulnerability where the linked page could manipulate the original page.
GitHub Actions can be used to automatically take screenshots of a statically exported Next.js website during pull requests, solving the problem of not having preview deployments when hosting on GitHub Pages. The solution uses a Node.js script using Puppeteer to find all HTML pages in the built Next.js app, serve them locally, and capture full-page screenshots while handling lazy-loaded images and animations. The screenshots are then uploaded as GitHub Actions artifacts.
Graph theory is applied in video games with 3D graphics, race game lap counting, and maze generation. Graph theory concepts, such as Hamiltonian circuits and disjoint-sets, efficiently solve problems in game design.
Software development often has unexpected hidden complexity. A reliance on unstable foundations and a "worse is better" mentality leads to unpredictable and frustrating development experiences. This is made worse when relying on tools maintained and built by others in your software.
Go should provide more opinionated guidance on application structure and project layout, similar to how it enforces formatting with `go fmt` and has strong opinions on other language features. While Go is easy to learn due to its "one way to do things" philosophy, teams struggle when scaling beyond small projects because they must invest a lot of time figuring out how to structure larger applications without official guidance.
FaultOrdering is a Swift package that speeds up iOS app launch times by generating order files that optimize how code is loaded into memory. Order files work by instructing the linker to group startup-critical symbols together in the binary, reducing page faults and the number of memory pages needed during app launch. This is a technique already used by major apps like Snapchat, Airbnb, and Spotify.
OpenFLOW is an open-source Progressive Web App built with React and Isoflow that allows users to create isometric diagrams directly in their browser. It has auto-saving, privacy-first local storage, and import/export capabilities for diagrams in JSON format.
History has had catastrophic failures due to software bugs, like the Boeing 737 MAX crash and NASA's $125 million Mars orbiter loss due to unit confusion. There were also amusing bugs, like Google accidentally marking every website as dangerous due to a single typo. Complex systems rarely fail from a single cause but from cascading chain reactions.
An experiment was conducted to rebuild a Rails application page in Next.js using AI assistance through Cursor. After three attempts with different AI models and refined prompts, they came very close to success, with the result just missing one line (“use client”). Prompt specificity and approach matter a lot for getting usable results.
Spegel is a proof-of-concept terminal web browser that uses LLMs to rewrite web pages into personalized markdown views.
Tips for making JavaScript regular expressions more readable and maintainable include using the `/v` flag, alphabetical flag ordering, named capture groups, inline comments (via libraries), and proper documentation examples.
Vite 7 has Rolldown integration, new Vite DevTools, updated Node.js and browser support, Vitest compatibility, and experimental Environment API improvements.
This website is a nostalgic tribute to the simple, early 2000s web development era, with basic HTML, limited CSS and JavaScript, low screen resolutions, and creative workarounds for achieving basic layouts and animations.
Sponsored
Autonomous coding agents are everywhere: Devin, Codex, Jules, etc. But how do you actually use them?
Vercel's BotID is an anti-bot solution, which in its Basic mode uses client-side signals to detect bots. Basic mode uses obfuscated JavaScript to collect browser fingerprints and detect automation frameworks, but the current implementation appears to be passive, collecting data rather than actively blocking bots. Deep Analysis mode uses an anti-bot system by Kasada, which is a software security company.
The DoltHub team had a mysterious 3x performance regression while working on Doltgres (a version-controlled Postgres-compatible database) compatibility with SQLAlchemy. They used Go's pprof tool to diff performance profiles between branches, which revealed that a hard-coded parameter was unnecessarily calling an expensive method to generate system table names on every table lookup.
Major AI breakthroughs aren't driven by novel ideas, but rather by unlocking new datasets. The core mechanisms behind recent advancements have existed for a while, so major progress happens when AI can learn from previously untapped sources like ImageNet, the internet, human feedback, and verifiers. The next paradigm shift won't come from better algorithms, but from harnessing data from video or embodied systems like robots.
Unlike prompt engineering, context engineering designs dynamic systems that deliver the right information and tools at the right time for LLMs to accomplish tasks. This means structuring various forms of context, like instructions, short and long-term memory, retrieved data, and available tools, into a properly detailed input. The quality of this context is necessary to better AI agents.
React has become overly complex and confusing to use. The components-based architecture coupled with features like React Hooks leads to convoluted state management and hard-to-parse code. Part of this complexity is due to the inherent challenge of building reactive UIs with many inputs and outputs, rather than it being a React-specific problem.
Claude Code hooks are user-defined shell commands that extend Claude Code's behavior by executing at specific points in its lifecycle. These hooks offer control over actions like notifications, code formatting, logging, feedback, and custom permissions. They can be configured in JSON settings files (user, project, and local) and can be organized by event type (PreToolUse, PostToolUse, Notification, and Stop) and matchers.
React Native Nitro Image is a high-performance image processing library built with Nitro. It provides an instance-based Image type with pixel data access and supports in-memory operations like resizing and cropping. The library has fast web image loading and caching using SDWebImage (iOS) and Coil (Android), along with ThumbHash support for placeholders.
CertMate is an open-source SSL certificate management system designed for modern infra, with multi-DNS provider support, Docker containerization, and a REST API. It automates certificate renewal.
OpenAI Codex and Claude Code can both be used as command-line AI coding assistants. This developer tested them on a JSON file merging task. Codex successfully completed the task with detailed explanations, while Claude Code wasn't able to. Though Codex was less transparent about its process, it was powerful and successful, which means it may be more useful for experienced devs over vibe coders.
As generative AI becomes more integrated into software, these systems will end up inheriting the unreliable, non-deterministic nature of LLMs. This isn't great for enterprise software that requires reliable, predictable results, which means companies need to implement guardrails on inputs/outputs, filtering mechanisms, and specialized observability tools to monitor AI behavior.
Unions and macros in C can be used to create type-safe generic data structures like linked lists, maps, and arrays, which allows for compile-time type checking and better memory management.
Gaps in CSS are better than margins for spacing elements in layouts because gaps are applied by parent containers (using Flexbox or Grid) to space their children, while margins are applied to individual elements, requiring more manual code management.
Admitting "I don't know" is better for creating trust with others and is better for learning.
SnapAI is an AI-powered CLI tool for React Native & Expo devs to generate app icons quickly using OpenAI's image generation models.
Sponsored
A practical guide to OAuth Scoped Access that walks through the Authorization Code Flow with real code examples, security best practices, and clear explanations of how third-party app integrations
Bloom filters are probabilistic data structures that efficiently check if an element might be in a set. They use a bit vector and multiple hash functions to set bits when an element is added, allowing for quick membership tests. While Bloom filters can definitively say an element is not in the set, they may produce false positives due to the possibility of different elements setting the same bits.
Claude-swarm is a tool that orchestrates multiple Claude AI instances to do Ruby migrations for a large project. It can be set up to have a "lead developer" AI instance identify projects with outdated Ruby versions and delegate upgrade tasks to a "ruby_upgrader" AI specialist. The tool successfully upgraded 5 Ruby projects from older versions to Ruby 3.3.5 by automatically modifying Gemfiles and configuration files.
Having an extensive "second brain" system can become a burden over time, replacing actual thought and adding extra friction to life. This author's new approach is having "no system at all," focusing on presence, living knowledge, and trusting that meaningful ideas will resurface naturally.
MCP is intended for AI and has the potential to become a universal plugin system like USB-C. USB-C has unexpected versatility, and similarly, MCP's standardized connection opens possibilities for other types of apps.
2025.06.30·worksonmymachine.substack.com·5 min read·TLDR Web Dev Tailwind CSS has drawbacks like verbose class names and a learning curve, but is still great for teams. Its opinionated nature enforces consistency and reduces decision fatigue.
Sponsored
Join the Sentry engineering team for a hands-on workshop [10] on debugging AI-integrated applications and agents with full-stack visibility. During the session you'll work hands on with Sentry to spot broken code, model misbehavior, and silent failures before your
Octelium is a free platform that provides a unified solution for zero trust resource access. It can function as a remote access VPN, ZTNA platform, secure tunnel infrastructure, API/AI gateway, or PaaS.
Sirius is a GPU-native SQL engine designed to integrate with existing databases like DuckDB using the Substrait query format. It has huge speedups, around 10x faster than CPU query engines, on TPC-H benchmarks at the same cost, making it great for various data workloads. The engine supports specific hardware and software configurations, including Ubuntu, NVIDIA GPUs with CUDA, and CMake, and can be deployed using AWS images, Docker, or manual installations.
ZeQL+ is an open-source, cross-platform terminal-based SQLite database browser. It allows users to open, browse, and query SQLite databases directly from the command line without dependencies.
This developer created a custom SMBIOS data file to trick a Xen virtual machine into thinking it had a CPU fan. This involved defining SMBIOS types 27 (Cooling Device) and 28 (Temperature Probe) by analyzing the host system's SMBIOS data.
Anthropic conducted an experiment where Claude managed a small office store called "Claudius" to understand AI's capabilities in real-world economic scenarios. Claudius had strengths in identifying suppliers and adapting to customer requests, but did not do well with profit maximization. It hallucinated details, had bad inventory management, and gave discounts for no reason.
Social media platforms, despite initial good intentions, inevitably become addictive due to venture capital incentives that prioritize growth and engagement. These platforms use algorithms to manipulate users' emotions. Individual efforts like digital detoxes are not enough.
2025.06.30·masonyarbrough.substack.com·9 min read·TLDR Web Dev Due to the limited precision of floating-point representations (float32 and float64), most integers (int32 and int64) cannot be represented exactly as floats, with only a small percentage (around 3.5% for 32-bit and 0.5% for 64-bit) being accurately convertible.