This is a guide on how to do great work for anyone in any field. The factors in doing great work are ability, interest, effort, and luck. Finding work where ability and interest combine can lead to an explosion of new ideas. The only way to find the work you are most suited for is by trying. Many people are held back by modesty and fear. There are worse problems to have than experiencing failure.
The trend towards non-permissible licenses in open source AI seems clear - most startups in the LLM industry are likely building on top of non-commercially licensed technology.
Some of the biggest companies in Europe have taken collective action to criticize the European Union’s recently approved artificial intelligence regulations, claiming that the Artificial Intelligence Act is ineffective and could negatively impact competition.
Shared more for the insightful take on Casetext, the overnight success that took a decade to build, this article gives some perspective on how transformative AI can be and how when the opportunity arises, you have to seize it.
State space models have made a splash recently. They arose as a potentially useful model alternative by sidestepping some challenging aspects of the Transformer while maintaining performance. In this work, the Hyena model is applied to DNA sequence modeling and improves in 23 tasks.
CLIPA-v2 improves the efficiency of image-text matching models like CLIP by using shorter sequences, achieving a zero-shot ImageNet accuracy of 81.1% for just $10,000.
This study introduces 'Volume Fusion' (VF), a new way to train 3D medical imaging models without needing large amounts of pre-labelled data. The research showed that VF, combined with a new network structure, improved the accuracy of medical image interpretation for different body parts.
This research presents a method called Filtered Guided Diffusion (FGD) that enhances Image-to-Image (I2I) translation without requiring extra training or changes to the underlying model. FGD adjusts the diffusion process based on previous steps and offers significant improvements in structural guidance and performance.
While we are all waiting for our 22k H100s to be delivered, we should probably practice training large models. Sasha Rush has another set of puzzles, but instead of GPUs or tensor shapes, he walks us through model parallelism, gradient accumulation, and more!
The article discusses the rise of AI engineering as a specialized field and the skills required to thrive in this domain, highlighting the need for a strong understanding of machine learning algorithms, data manipulation, and programming languages, as well as the ability to bridge the gap between research and implementation in order to create practical AI solutions.
It is well known that Europe has stronger privacy requirements for many digital applications. This includes AI and language models. Unfortunately, many of the model providers today don't fully comply with these privacy requirements. This post explores where they fall short and which ones are the closest to full compliance.
The Walrus examines the rise of AI religion and explores the concept of artificial general intelligence (AGI) as a potential deity. It discusses the beliefs and practices of those who see AGI as a religious force, the ethical implications of AI worship, and the motivations behind this emerging phenomenon, highlighting the role of technology in shaping our spiritual experiences and challenging traditional notions of religion.
This article is about the author's experience using AI tools, which were often dissatisfying or simply did not live up to the hype they were given, and reflects on the few AI tools the author found most unpleasant.
Prioritizing privacy, security, and accuracy, CaseMark is revolutionizing legal processes and leading impactful change in the legal profession. Use our customized legal AI to streamline workflows, boost productivity, and ensure more thorough legal outcomes.
YouTube is running a small global experiment that prompts users with ad blockers to allow ads or try YouTube Premium. Some users have reported that video playback is being cut off after viewing more than three videos when an ad blocker is active. YouTube says that users will receive multiple warnings before playback is disrupted. Users can dispute their bans if they feel that they have been falsely flagged as using an ad blocker.
Reddit has given its moderators deadlines to lay out plans for reopening. Subreddits will not be allowed to remain closed. The company claims that moderators are violating the Moderator Code of Conduct, which says that they need to be active and engaged. Many subreddits have switched from private to restricted, so while content can still be viewed by the community, only certain users are allowed to post or comment.
Virgin Galactic completed its first commercial spaceflight on Thursday. Galactic 01 took off from Spaceport America in New Mexico with a pair of pilots, four passengers, and 13 research payloads. The company plans to fly its spacecraft once a month after a second mission in August. It currently has a backlog of about 800 passengers, many who bought tickets for between $200,000 to $250,000 over a decade ago. Ticket sales reopened two years ago, with prices starting at $450,000 per seat.
A prototype reactor in Everett, WA is already producing high-energy neutrons from nuclear fusion. Zap Energy's Fuze-Q prototype, which is an office-desk-sized device, is designed to reliably produce enough power for 30,000 homes all day and night, year-round. The system has no cryogenics, no superconducting coils, no auxiliary heating, and no magnets. Zap believes that gargantuan systems are unnecessary, undesirable, and impractical for fusion power. The company is betting that it will be easier to produce practical amounts of power by stringing together short pulses of fusion activity rather than trying to create a continuous fusion reaction.
GitLab's AI-assisted Code Suggestions helps teams create software faster and more efficiently. Developers can use the tool to complete entire lines of code, generate tests, and more with a single keystroke. The tool keeps source code secure - it is not used as training data. GitLab's AI-powered Code Suggestions supports 13 languages, including C/C++, Go, Java, Python, and Rust.
TypeID is a modern and type-safe global unique identifier. It is type-safe, K-sortable, and compatible with UUIDs. TypeID's encoding is URL safe, case-insensitive, clear, easily selectable, and compact.
Fern is an open source tool to automatically generate idiomatic client libraries and Stripe-like API documentation. Find out why companies like Scale AI and Flatfile already use Fern to develop their APIs and generate their SDKs, click here to learn more
Twitter's new CEO Linda Yaccarino is preparing a series of measures to bring advertisers back. The plans include introducing a video ads service, attracting more celebrities, and increasing headcount. Twitter's new ad format, which focuses on video, is still in a beta stage. Yaccarino, known as the 'velvet hammer' in the ad industry due to her tenacity in dealmaking, plans to make commerce easier on Twitter and will seek to mend relations with partners.
Marc Andreessen, co-founder of a16z, has authored three seminal essays: 'Why Software is Eating the World', 'It's Time to Build', and 'Why AI Will Save the World'. This article contains a transcript from an extensive interview with Andreessen about these essays, with a particular focus on the most recent one about AI. There was also some discussion of a16z-related topics. A link to the audio is available.
Neuroscientist Christof Koch bet philosopher David Chalmers that humans would discover how the brain's neurons produce consciousness by 2023 - and lost.
The economic landscape doesn't look very good right now - venture capital is drying up and many startups don't have the cash to continue for much longer.
SAE International has announced support for Tesla's North American Charging Standard port, making it easier for electric vehicle charging station manufacturers and operators to implement the port.
Inflection, a one-year-old startup founded by ex DeepMind co-founder and head of applied AI, has raised a significant amount of money. The company offers a personalized AI assistant called Pi. This announcement comes on the heels of the recent MLPerf results from Inflection’s newly built Nvidia + CoreWeave supercomputer. Most of the money raised will go to compute, with 22k H100s announced.
Rep. Ted Lieu has criticized new House guidelines restricting AI tool ChatGPT's use to research only, advocating for each office's autonomy to use it as they see fit. These advisory guidelines arrive as lawmakers focus on formulating AI regulation.
a16z lays out the future of computing and the paradigm shift from a tool to a companion. The article walks through a bunch of potential interesting angles for what’s next with AI.
This delightful article discusses two novel concepts: integration and coverage. These refer to two axes of capabilities in language models - generalization and memorization. The idea posed is that both are useful for tasks and it is hard to tell which is being used for those tasks. Additionally, small models might be good on benchmarks because of increased coverage at the expense of true integration.
Instruction tuning is good at getting models to do what we want. People misunderstand the importance of FLAN because it gives short responses and humans typically prefer long responses. This article also shows other models and when you should consider using them.
This study introduces ChatLaw, a new open-source language model designed specifically for the Chinese legal language, aiming to assist the digital transformation of the field.
Audiocraft presents MusicGen, a model that simplifies and enhances music generation. This single-stage, auto-regressive Transformer model doesn't need self-supervised semantic representation like prior methods and it generates music more efficiently by predicting all codebooks in parallel, resulting in fewer steps per audio second.
XrayGPT is a pioneering AI model that can interpret chest X-rays and answer questions about them in a conversational manner. It merges visual understanding with textual knowledge and is enhanced by summaries of real-world radiology reports. XrayGPT offers new possibilities for automated X-ray analysis.
Can we get models to take images as output without retraining them? Amazingly, if you use small, image-specific modules, you can provide context to a fully frozen language model that allows it to answer questions about images. Paper, code, and demo is included.
The rise of generative AI demands startups to increase their pace of innovation. This piece suggests a mindset shift, including detaching ego from product, seeing operations as experiments, and overcoming self-sabotage, to fully capitalize on the opportunities AI presents.