Stream is the leading provider of chat messaging and activity feed technology for virtual events, communities, marketplaces, and more. Get started with Stream for free! [https://gstrm.io/tldrQ123]
Instruction-following models such as GPT-3.5 (text-davinci-003), ChatGPT, Claude, and Bing Chat have become increasingly powerful. However, instruction-following models still have many deficiencies: they can generate false information, propagate social stereotypes, and produce toxic language. To make maximum progress on addressing these pressing problems, it is important for the academic community to engage. Alpaca is a model fine-tuned from the LLaMA 7B model on 52K instruction-following demonstrations.
OpenChatKit provides a powerful, open-source base to create both specialized and general purpose chatbots for various applications. OpenChatKit is Together’s version of OpenAI’s ChatGPT. All of the model’s weights, code, and training data are available online. And it was even trained on 100% carbon-negative compute.
An extremely useful inequality for applied mathematicians and machine learning practitioners. This post explores this often backwards, but useful, inequality. If you're hoping to learn more of the math behind ML, this is a good piece to read.
This paper proposes a solution to the limitations of StyleGAN, which is restricted to cropped aligned faces at fixed image resolution. The solution involves using dilated convolutions to rescale the receptive fields of shallow layers in StyleGAN without altering model parameters, resulting in features that can accommodate variable resolutions and better characterize unaligned faces. Additionally, the paper introduces an encoder that provides the first-layer feature of the extended StyleGAN and validates the effectiveness of the method in various face manipulation tasks, including super-resolution, facial attribute editing, sketch/mask-to-face translation, and face toonification.
The authors introduce MVImgNet, a large-scale dataset of multi-view images for 3D vision. It contains 6.5 million frames from real-world objects and bridges the gap between 2D and 3D vision. MVPNet, a 3D object point cloud dataset, is also introduced.
Based on the NanoGPT repo, this code can train a decoder only transformer model to somewhat reasonable perplexity in just 3 minutes. It is designed to be simple to understand, hackable, with fast convergence for researchers to explore their ideas.
According to Microsoft Germany CTO Andreas Braun, OpenAI’s upcoming GPT-4 upgrade will allow users to turn text into video. Braun added that the more powerful AI will be introduced this week, putting an end to speculation over its release. "We will introduce GPT-4 next week, where we will have multimodal models that will offer completely different possibilities – for example, videos," Braun said.
Apple is expected to launch a virtual reality headset that features augmented reality capabilities this year. It will be the company's first computing platform entirely developed under Tim Cook's leadership. Cook's tenure at Apple has been influential in elevating the company's market capitalization from approximately $350 billion in 2011 to over $2.4 trillion today. Apple anticipates that it will only sell around one million headsets within the first year of its launch.
Unplugin is a plugin system for Vite, Rollup, Webpack, esbuild, and more that provides a compatible layer for various build tools. It can make multiple nested plugins behave like a single plugin. Unplugin provides compatible layers for some hooks, but its functionality is limited to the common subset of the build's plugin capability. Unplugin provides an escape hatch for more advanced framework-specific usage.
Elon Musk is planning to build a new town for his employees along the Colorado River in Texas about 35 miles from Austin. The aim of the proposed town is to create a type of Texas utopia where Musk’s employees can live and work. Musk and his top executives want their employees, particularly those at his Austin-area companies such as Tesla and SpaceX, to live in new homes with affordable rents. The site will be adjacent to Boring and SpaceX facilities which are currently being built. Pictures of the site and plans for the future city are available in the article.
There are now three levels of Enterprise Packages on Twitter's developer platform: the Small Package gives access to 50 million tweets for $42,000 a month and the higher tiers give access to 100 million tweets for $125,000 a month and 200 million tweets for $210,000 a month.
One of the reasons chatGPT is so powerful is because of the instruction tuning process. By feeding the model data formatted as instructions, it becomes much more likely to follow instructions that users give it. Openchatkit is a 20 billion parameter instruction tuned Transformer and other useful tools to make an open source replication of the powerful and popular chatbot.