Full-text search across article titles and summaries. Refine with sector, year, content type, and reading-time filters.
A weird fact of modern language modeling is that we train a tokenizer first before training the model. The second weird fact is that vocab size doesn't seem to matter too much at large scales.
Sponsored
SPEAKERS: Dr. Ali Arsanjani, Ph.D., Director of Engineering @ Google; Alex Watson, Co-Founder and Chief Product Officer @ Gretel; Maarten Van Segbroeck, Ph.D., Principal Applied Science @ Gretel
WHAT: This workshop will showcase an end-to-end machine learning approach [10] to automatically anonymize sensitive customer data in financial documents, including:
Decompile binary code with large language models.
GroupContrast redefines self-supervised 3D representation learning by integrating segment grouping with semantic-aware contrastive learning.
This project introduces a new method for identifying objects in images taken from various spectrums like RGB, near-infrared, and thermal imaging, focusing on object-centric information to overcome background noise and improve recognition accuracy.
A new companion website, More Useful Things, offers a trove of free AI and machine learning resources, underlining the quirky and effective ways AI-generated prompts, like imaginative scenarios, can outperform human-crafted ones in tasks such as mathematical problem-solving. The experiment underscores the importance of adding context, few-shot learning, and chain-of-thought techniques for more consistent prompting results. As AI models advance, prompting as a skill may become less critical, with AI improving at inferring user intent, but currently, structured prompting remains an evolving art with significant potential benefits.
Recent studies suggest human prompt engineers may become obsolete as AI and machine learning models increasingly optimize their own prompts. Algorithmically generated prompts can be bizarre yet effective, outperforming human-crafted ones and reducing optimization time dramatically. While automatically tuned prompts show promise, experts believe that the demand for prompt-related jobs will evolve rather than disappear, potentially under new job titles like LLMOps (Large Language Model Operations).
Sponsored
Every customer counts when you're a startup. Get free access to the tools you need to deliver exceptional customer experience. Apply for 6
VLOGGER is an AI created by Google researchers that generates lifelike videos of people speaking and moving from a single photo.
Copilot Pro users can still opt for the older model and they also have access to Copilot GPT Builder for creating custom chatbots without programming expertise.
KAIST researchers have developed the C-Transformer, an ultra-low-power AI chip for large language models that boasts significant energy efficiency improvements over Nvidia's A100 GPU.
Fidelity has amended its spot Ether ETF proposal to include staking to give customers an option to earn income on their holdings. If accepted, the firm will stake an undisclosed portion of its assets using one or multiple reliable staking providers. The news temporarily boosted Lido, a leading Ethereum staking protocol. While this is a seemingly positive development, analysts and betting markets are putting the likelihood of an Ether ETF approval by May at 35% or less.
OKX, the world's fourth largest cryptocurrency exchange, is discontinuing its support for Tether trading pairs in the European Economic Area. This move comes ahead of the EU's implementation of the Markets in Crypto-Assets law, which restricts the use of certain stablecoins. OKX also plans to roll out new product offerings and Euro fiat onramps for EEA customers.
Canto's proposed Cyclone Stack is a set of upgrades aimed at improving the network's performance and scalability via a parallel execution engine. The update involves three steps: the Callisto Upgrade, which will transition Canto towards ABCI 2.0; the Elara Upgrade, which implements the Cyclone EVM for concurrent transaction processing; and the Kallichore Upgrade, which will integrate mem-IAVL to address storage bottlenecks. All existing apps are expected to function normally post-upgrade. The new changes are set to be launched by H2 2024.
Light is a new approach meant to address the fragmentation of user experience across EVM chains. The tool enables users to interact with any EVM chain, including L2s and L3s, as if using one network. It functions like network abstraction, cross-chain asset management, and batch transaction execution. Light is fully open source and aligns with open standards such as ERC-4337 and ERC-7579.
Solana's program security is critical to ensuring applications behave as intended, affecting performance, scalability, and interoperability. As such, developers must understand potential attack vectors and vulnerabilities such as logic bugs, data validation flaws, and access control vulnerabilities and employ strategies like rigorous testing and code auditing to mitigate risks. This comprehensive guide delves into common vulnerabilities developers might face, offering insights and mitigation strategies to safeguard Solana programs against exploits.
MEV has returned to Bitcoin due to the introduction of Ordinal Theory, leading to a reordering of blocks in Bitcoin’s chain and threats to the network's decentralization and neutrality. This analysis explores different forms of MEV in Bitcoin, such as Replace-By-Fee, Lightning Watch Tower Attacks, and Sniping Sidechain Auctions, emphasizes the importance of recognizing and addressing these issues, and proposes several potential solutions, including Rollups, BitVM, and Bitcoin-backed stake chains.
Slerf, a sloth-themed memecoin on Solana, recently attracted $10 million in funding from a presale. The developer subsequently accidentally burned the liquidity pool and the presale proceeds. The coin unexpectedly surged in value due in part to the attention the mishap drew to the project. Despite the colossal mistake, Slerf recorded $1.7 billion in trading volume and was listed on several exchanges.
This article discusses the rising prominence and potential of the DePin space, an often overlooked sector in crypto. DePin uses blockchain technology to accelerate and make infrastructure projects more efficient and globally accessible. With over 650 projects in six core subsectors, DePin's market cap is anticipated to reach about $3.5T by 2028.
A Utah court sanctioned the SEC for abuse of power and undermining judicial integrity, highlighting the impact on taxpayers for the Commission's litigation misconduct.
Popular memecoin WIF saw a sharp price increase after influential trader GCR acquired the original Dogwifhat meme image for 1,210 ETH.
Base, an Ethereum L2 network created by Coinbase, saw transactions soar to over 1 million and fees drop after the Dencun upgrade.
Data indicates that BlackRock's IBIT, the largest spot bitcoin ETF, with an average trade size of $13,000, has so far primarily attracted retail investors.
Google Drive introduced a new dark theme option for users, accessible via Settings. The new theme does not change the appearance of Docs, Sheets, or Slides and does not sync with the device theme. Other Google apps like Google Keep and Chat also have dark modes, but night mode availability remains limited on the web.
Warner Music Group has partnered with Pentagram to refresh its brand identity and bring its diverse brands under one roof. The company created a palette of motifs that can be used across internal brands and platforms. The rebrand highlights Warner Music Group's legacy with a modern, playful spirit, contemporary typography, and a refreshed color scheme.
Adobe has integrated Firefly AI tools into its Substance 3D suite to enhance texture creation and scene staging. The move aims to significantly speed up the creative process for 3D content creators. The new features are available in Substance 3D Sampler 4.4 and Stager 3.0. They offer innovative capabilities for realistic texturing and environment generation outside the Creative Cloud subscription.
Headspace XR is a mixed and virtual reality experience created by Headspace, Meta, and Nexus Studios. It targets Gen Z users to strengthen their mind-body connection and alleviate loneliness. However, like with any innovation or new technology, there’s a danger that this becomes just another complicated distraction.
For decades, designers have asked for a seat at the table in the boardrooms where decisions are made. Yet, this seems next to impossible, given that the people sitting next to them often struggle to understand their role. Instead of trying to prove their value and explain design, designers should invite those who don’t understand their role to experience design.
When used effectively, color has the power to capture a viewer's attention. Today's software is mostly a canvas for displaying people's (colorful) content, so you cannot rely on color alone to guide their behavior. You should remove colors from interface design whenever possible, treating them as part of a budget only used where it returns the best results.
A free AI plugin to generate images inside Figma. The plugin suggests prompt modifiers for any style so designers can quickly build a prompt for their images.
Based on your input, QoQo can help you identify challenges, risks, and critical elements in a design brief and generate cards to build personas with user goals, needs, motivations, frustrations, and tasks.
Figma CEO Dylan Field has observed a shift from the futuristic, neon-lit cyberpunk aesthetic to a more optimistic and natural solarpunk theme, characterized by sustainable energy and architecture integrated with the environment. The trend suggests a movement from dystopian imagery to more human-centric designs and harmonious with nature.
Tech has an unhealthy relationship with tools: we use them to define our goals. However, the problem with most tools is that they succumb to “the way of ways” and eventually replace the goal entirely. The cause of the problem is the lack of leadership necessary to define goals beyond “follow the book.”
You can elevate your design to a new level and completely change its mood with the right typeface. Fortunately, you don't have to rely on expensive fonts to achieve that. This carefully curated collection of free fonts will give you plenty of options to look premium without spending a fortune.
Odd Bleat and VML Singapore revamped Scoot Airlines' identity with 100 illustrations in a powerful collaboration. These vibrant narratives embody Scoot's "Escape the Ordinary" ethos.
In many situations, accessibility (or lack thereof) seems related to common beliefs. This practical website lists the most popular ones and debunks some of the myths related to them.
Llamasoft: The Jeff Minter Story is a playable documentary game archive created by Digital Eclipse that covers the legendary gamer designer's work, which spans over 40 titles.
With Meta and Google reducing their involvement in the news business, LinkedIn is using the opportunity to emerge as a news platform. Its user base is already increasingly engaging with news content. However, concerns remain regarding the company’s ability to combat AI-generated spam and misinformation.
Advertisements will inevitably become a regular feature in AI-powered chatbots. Smaller startups are already monetizing their chatbots through advertising plugins. The future of ad-driven chatbots will depend on how developers and marketers implement ads.
The biggest danger of widely adopted automated bid strategies is the risk of unintentionally paying extremely high CPCs in Google Ads. Setting a max CPC bid limit as part of the portfolio bid strategy can prevent this from happening. This article walks through how to correctly set up portfolio bid strategies to maximize ad performance.
Inbox retargeting is a tactic to identify users that land on key pages and then directly reach out to them in their inbox. It works by firing scripts to identify visitors, then mapping those users to segmented email campaigns based on which page they visited. It is effective on campaign landing pages, product pages, and registration pages.
Rhym creates interactive and gamified campaigns within minutes, leading to increased engagement and first-party data collection. It offers a library of high-performing templates, including match-3 games, interactive banners, and more. These campaigns can be published to your brand's website, Meta ads, swipe up stories, and SMS/Whatsapp.
Google launched a closed beta in Search Ads 360 for off-site retail media campaigns. It claims to have created a privacy-centric way for participating brands to use their first-party data to fuel AI-powered Performance Max campaigns. Google said it will expand the beta to more retailers globally over the upcoming months and support additional retail media campaign types, including Microsoft campaigns.
Instagram has launched its new “Ads with Promo Codes” option to all brands globally, enabling advertisers to entice potential shoppers with promo codes listed in ad captions. This provides brands another option to track IG sales based on the promo code entered.
There are 3 prominent models in the AI landscape: GPT-4, Claude 3 Opus, and Gemini Advanced. Each has distinct characteristics and capabilities, catering to different needs such as coding, writing, or streamlining basic tasks. This article delves into concepts like context windows and agents, highlighting how these features enhance AI systems capabilities. Even though GPT-4 remains the benchmark and standard, new emerging features in other models could make them solid alternatives in the near future depending on the specific use case.
Brand architecture plays a big role in gaining a competitive edge. There are 4 major approaches to structuring brands: house of brands, endorsed brands, sub-brands, and branded house. This article explains how each strategy is different and shares examples from companies like Volkswagen and Unilever. It showcases how these companies strategically aligned their brand portfolio to improve customer appeal and market position.
Properly establishing null and alternative hypotheses before conducting A/B tests is essential. The null hypothesis suggests sample observations occur randomly, while alternative hypotheses propose that the control and variant groups are not comparable. This article shares best practices and discusses in detail the different types of alternative hypotheses and how to use them to interpret results based on statistical significance.