TLDR AI

TLDR AI 2023-08-23

6 sections13 entriesinline urlcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

In the first offering of its kind, IaaS provider NexGen Cloud is giving investors the opportunity to purchase its GPU cloud servers. The company is projecting 30-50% annualised returns.

info.nexgencloud.comSponsor

02HEADLINES & LAUNCHES

ai.meta.com4 min read

03RESEARCH & INNOVATION

MAKING OBJECT DETECTION BETTER FOR SMALL ITEMS

While current methods are great at detecting objects, they often have problems spotting small items. CFINet is designed specifically for these small object challenges. It uses a step-by-step approach to first find good areas of interest and then focuses on mimicking features to better recognize the small items.

arxiv.org16 min read

OPEN REPLICATION OF STATE-OF-THE-ART VISION/LANGUAGE MODELS

HuggingFace has released IDEFICS, which is quite the acronym (Image-aware Decoder Enhanced à la Flamingo with Interleaved Cross-attentionS). IDEFICS is essentially a replication of Flamingo, which is a text and image model that interleaves the two and allows for visual question answering and reasoning. It is built on Llama v1 and has 8B and 70B variants.

huggingface.co28 min read

IMPROVING 3D SCENE UNDERSTANDING

While Neural Radiance Fields (NeRF) are a hot topic in computer vision, combining multiple NeRFs together is still a challenge. To tackle this, this team developed DReg-NeRF, a new method that pulls out features from NeRF. It uses advanced techniques to understand how different 3D scenes relate to each other without needing any human input or special markers.

aibluefisher.github.io2 min read

04ENGINEERING & RESOURCES

WHISPER API

This open-source project provides a self-hostable API for speech-to-text transcription using a fine-tuned Whisper Automatic Speech Recognition model.

github.comGitHub repository

JAX FOR STRUCTURES PROBABILITY DISTRIBUTIONS

SynJax has tools for probability over objects like trees, sequences, segmentations, alignments, and more! Very cool tool from DeepMind with a number of useful utilities.

github.comGitHub repository

05MISCELLANEOUS

SECURING AI

The rush to AI is palpable and the inherent security challenges are of a complexity never seen before. As with every new technology we need to think about how it's going to be weaponized WHILE it is hockey-sticking.

greylock.com8 min read