Parse notes
It's here! Google’s long anticipated entry into the language models as a service game. Bard is a lightweight version of Lambda, which was a 70B parameter conversational agent trained a few years ago. They have spent a lot of effort making things safe and grounded in truthfulness, we’ll see when people start getting added to the waitlist if it lives up to the promises!
Researchers from Google propose a novel approach called SVDiff to address the limitations of existing text-to-image diffusion models for personalization, including overfitting and inefficient parameter storage. SVDiff involves fine-tuning the singular values of weight matrices, resulting in a compact and efficient parameter space that reduces the risk of overfitting, language-drifting, and has a significantly smaller model size, making it more practical for real-world applications.
Zero-1-to-3 is a framework for changing the camera viewpoint of an object from a single RGB image, using a conditional diffusion model that learns controls of relative camera viewpoint from a synthetic dataset. This approach shows strong zero-shot generalization abilities to out-of-distribution datasets and in-the-wild images, including impressionist paintings, and can be used for 3D reconstruction from a single image, outperforming state-of-the-art models by leveraging Internet-scale pre-training.
CG3D proposes a framework for zero-shot 3D geometric feature extraction by training a 3D encoder using point clouds, rendered 2D images, and text. Contrastive loss aligns features in a multimodal embedding space, and prompt tuning with trainable input parameters overcomes distribution shift issues. CG3D demonstrates impressive zero-shot, open-scene understanding, and retrieval capabilities, and serves as a strong starting weight for downstream 3D recognition tasks.
AI Commits is a CLI that writes your git commit messages for you with AI.