AI's success could render it less discussed in five years as it becomes an integral part of everyday technology and business solutions. The term may evolve, with current AI being redefined, much like how big data has become ubiquitous. Machine learning will become the main focus as AI transforms into standard functionality.
Google DeepMind's Veo 2 sets a new benchmark in AI video generation, surpassing competitors with its quality, consistency, and prompt accuracy. The rise of deep fakes blurs reality, fostering creativity but undermining trust in visual content. There is concern over losing cultural continuity and the ability to discern reality as technological advancements accelerate.
Valuable AI companies are predicted to have strong growth in 2024 while many hyped ventures may falter. Vertical integration and buy-and-build strategies are expected to rise, capitalizing on markets needing technology streamlining. A shift towards emerging, capacity-constrained managers will contrast with the decline of overfunded growth companies from 2020-2021.
RAG accuracy improves when you can feed the LLM more relevant documents. Learn how semantic reranking can improve text search and RAG pipelines in this technical blog by Elastic [16].
Tencent's open-weight AI model, HunyuanVideo, enables local, uncensored video synthesis, offering a potentially transformative tool like Stable Diffusion.
In an era where AI is reshaping how businesses operate, the journey of building an early-stage startup [4] has never been more dynamic—or complex. How do founders navigate finding product-market fit, delegation, and scaling, all while adapting to technological innovations?
The FACTS Grounding benchmark evaluates LLMs' ability to generate factually accurate responses grounded in provided source material to reduce hallucinations. A leaderboard on Kaggle tracks industry progress, with initial results from leading LLMs. The evaluation involves diverse, long-form examples judged by multiple LLMs to ensure comprehensive and bias-free assessments.
Medtronic is leveraging AI to enhance productivity, automate tasks, and improve decision-making using tools like AI-driven contract management and supply chain optimizations. The company is focusing on AI applications in healthcare, such as precision in diagnostics, robotic-assisted surgeries, and image analysis for early detection of conditions. Medtronic balances internal AI R&D with collaborations, emphasizing partnerships with tech companies and AI startups.
AI dominated 2024's startup funding with Databricks raising $10B and OpenAI $6.6B. xAI secured $12B across two rounds, while Waymo raised $5.6B. Other notable raises include Anthropic at $4B and Anduril Industries with $1.5B.
TiGDistill-BEV introduces a novel approach to improve camera-based 3D object detectors by distilling knowledge from LiDAR using depth supervision and BEV feature distillation.
SVDR is a unified framework for face video restoration that supports tasks such as BFR, Colorization, Inpainting, and their combinations within one cohesive system.
The MS-PR benchmark evaluates Vision-Language Models on sensor-specific reasoning, enhanced by DNA optimization to address information gaps between images and sensors.
Vertical AI startups are rapidly gaining traction by focusing on four key areas: voice automation, unstructured data parsing, verticalized search, and content generation. These technologies enable startups to address specific industry pain points, enhancing efficiency and accessibility while reducing costs. As these companies grow, they may evolve their offerings and potentially become essential systems of record within their industries.
AI model pre-training improvements may be stalling, according to experts like Ilya Sutskever, but the perception of an AI progress plateau could be due to outdated evaluation methods. Despite scaling challenges, AI's potential continues with untapped data sources and synthetic data, enhancing capabilities across various domains. Advances in teaching models reasoning and using new data could unlock significant improvements, suggesting AI development remains robust.
ChatGPT o1 Pro, despite its hefty $200 monthly fee, shows only marginal improvements over its predecessor. It fails key identification tests and displays an unsettling confidence in incorrect answers. This rigidity raises concerns about its reliability in critical scenarios, such as insurance or health discussions. The persistence of such behavior warrants closer evaluation and development adjustments.
2025.01.07·
engineeringprompts.substack.com·7 min read·TLDR AI
AI's growing energy demands have boosted interest in nuclear and fusion power, with companies exploring new reactor designs and fusion startups racing to meet early 2030s grid connection targets. The Inflation Reduction Act's potential changes could threaten hydrogen startups relying on subsidies to achieve cost goals. Expect more tech alliances with power providers as regulatory approvals impact grid-related investments in 2025.
CES 2025 in Las Vegas will showcase major tech events from January 7-10, with companies like AMD, Samsung, and Nvidia presenting key innovations. AI remains a focal point across sectors, including chip advancements from Nvidia and AMD, as well as applications in automotive and smart home technologies.
A truly open source model released by Allen AI including all code, data, weights, and training logs. It's a great artifact for learning about training a strong series of language models.
Lambda's Inference API offers the lowest cost AI inference on the market. [10] Access state-of-the-art models—Llama 3.3, Hermes 3, Qwen 2.5, LFM-40B, and more—and scale effortlessly with no rate limits and pay-as-you-go pricing. With Lambda, you get:
PyTorch fault tolerance code for gracefully handling training interruptions. Most large established organizations have code of this sort, and to have an open version is quite compelling.
KaLM-Embedding introduces a multilingual embedding model trained on cleaner, diverse, and domain-specific data, leveraging innovative techniques like persona-based synthetic examples and ranking consistency filtering.
Vultr, an AI cloud infrastructure startup, raised $333 million at a $3.5 billion valuation, marking its first outside financing round. The investment was co-led by AMD Ventures and LuminArx Capital Management. The funds are earmarked for acquiring GPUs. This deal highlights AMD's competitive push against Nvidia and Intel in providing AI infrastructure.
Hamming raised $3.8M in seed funding to enhance AI voice agent reliability with automated testing and monitoring tools. The company offers solutions such as LLM prompt management, vulnerability detection, and call analytics, crucial for compliance-heavy industries. Co-founder Lauren Farleigh highlights their role in ensuring safe AI development as conversational AI grows.
Universities are struggling with AI-assisted cheating, leading to false accusations. Detection software like Turnitin often produces unreliable results, disproportionately affecting certain student demographics. The crisis has exposed deeper issues in higher education, highlighting the transactional nature of obtaining a degree and the impersonal relationship between students and institutions.
Generative AI investments reached a record $56 billion in 2024, marking significant growth fueled by enterprise demand and advancements in foundation models.
Google announced third-party tool support for Gemini Code Assist, enhancing its AI code completion capabilities. The tools, available in private preview, connect Code Assist to external applications, increasing productivity and minimizing context switching. Initially, tools are limited to Google Cloud partners, with offerings from GitLab, GitHub, and others at launch.
A fascinating paper that explores closed form equations that can model generated images from diffusion models. This means that with a high degree of confidence you can predict the image that will be generated, in a simpler setting.
Researchers have trained a language-like model that can predict cognitive reactions in human participants better than an MRI. This can be used to continue study in behavioral science and neuroscience.