In this issue, we cover the top ML Papers of the Week (Jan 30 - Feb 5).
1). REPLUG - a retrieval-augmented LM framework that adapts a retriever to a large-scale, black-box LM like GPT-3. (Paper)
![Twitter avatar for @WeijiaShi2](https://substackcdn.com/image/twitter_name/w_96/WeijiaShi2.jpg)
![Image](https://substackcdn.com/image/fetch/w_600,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FFn0oYGzaAAEYTDX.jpg)
2). Extracting Training Data from Diffusion Models - shows that diffusion-based generative models can memorize images from the training data and emit them at generation time. (Paper)
![Twitter avatar for @Eric_Wallace_](https://substackcdn.com/image/twitter_name/w_96/Eric_Wallace_.jpg)
![Image](https://substackcdn.com/image/fetch/w_600,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FFnz3bW4aUAQsA5V.jpg)
3). The FLAN Collection - release a more extensive publicly available collection of tasks, templates, and methods to advancing instruction-tuned models. (Paper)
![Twitter avatar for @ShayneRedford](https://substackcdn.com/image/twitter_name/w_96/ShayneRedford.jpg)
![Image](https://substackcdn.com/image/fetch/w_600,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FFn44x_OWAAMDMDZ.jpg)
![Image](https://substackcdn.com/image/fetch/w_600,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FFn49FLdXoAA21I7.jpg)
4). Multimodal Chain-of-Thought Reasoning - incorporates vision features to elicit chain-of-thought reasoning in multimodality, enabling the model to generate effective rationales that contribute to answer inference. (Paper)
![Twitter avatar for @arankomatsuzaki](https://substackcdn.com/image/twitter_name/w_96/arankomatsuzaki.jpg)
![Image](https://substackcdn.com/image/fetch/w_600,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FFoAYv52XgAYHahZ.jpg)
5). Dreamix - a diffusion model that performs text-based motion and appearance editing of general videos. (Paper)
![Twitter avatar for @_akhaliq](https://substackcdn.com/image/twitter_name/w_96/_akhaliq.jpg)
6). Benchmarking LLMs for news summarization. (Paper)
![Twitter avatar for @Tianyi_Zh](https://substackcdn.com/image/twitter_name/w_96/Tianyi_Zh.jpg)
7). Mathematical Capabilities of ChatGPT - investigates the mathematical capabilities of ChatGPT on a new holistic benchmark called GHOSTS. (Paper)
![Twitter avatar for @omarsar0](https://substackcdn.com/image/twitter_name/w_96/omarsar0.jpg)
![Image](https://substackcdn.com/image/fetch/w_600,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FFn2I-k2XwAEFcEk.jpg)
8). Training ‘Blind’ Agents - trains an AI agent to navigate purely by feeling its way around; no use of vision, audio, or any other sensing (as in animals). (Paper)
![Twitter avatar for @DhruvBatraDB](https://substackcdn.com/image/twitter_name/w_96/DhruvBatraDB.jpg)
![](https://substackcdn.com/image/fetch/w_600,h_314,c_fill,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faf310e00-0793-411c-a5e8-564a74581084_1920x1017.jpeg)
9). SceneDreamer - a generative model that synthesizes large-scale 3D landscapes from random noises. (Paper)
![Twitter avatar for @_akhaliq](https://substackcdn.com/image/twitter_name/w_96/_akhaliq.jpg)
10). LLMs and irrelevant context - finds that many prompting techniques fail when presented with irrelevant context for arithmetic reasoning. (Paper)
![Twitter avatar for @johnjnay](https://substackcdn.com/image/twitter_name/w_96/johnjnay.jpg)
![Image](https://substackcdn.com/image/fetch/w_600,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fpbs.substack.com%2Fmedia%2FFn-MhWmXgAY2aRL.jpg)
See you next week for another round of awesome ML papers!