Discover more from NLP Newsletter
🥇Top ML Papers of the Week
The top ML Papers of the Week (Jan 23-29)
In this edition of the NLP Newsletter, we cover the top ML Papers of the Week (Jan 23-29).
MusicLM: Generating Music From Text abs: arxiv.org/abs/2301.11325 project page: google-research.github.io/seanet/musiclm…
Attention is all you need... but how much of it do you need? Announcing H3 - a new generative language models that outperforms GPT-Neo-2.7B with only *2* attention layers! Accepted as a *spotlight* at ! 📣 w/ 📜 arxiv.org/abs/2212.14052 1/n
is planning to stop users from making social media bots and cheating on homework by "watermarking" outputs. How well could this really work? Here's just 23 words from a 1.3B parameter watermarked LLM. We detected it with 99.999999999994% confidence. Here's how 🧵
Introducing Make-A-Video3D! Generating 3D dynamic (mini) scenes from input text. That is, text --> 4D! Needs no 4D data (i.e., no dynamic 3D data), no static 3D data, no paired text-video data. Paper: arxiv.org/abs/2301.11280 Website: make-a-video3d.github.io
Introducing ClimaX, the first foundation model for weather and climate. A fast and accurate one-stop AI solution for a range of atmospheric science tasks. Paper: arxiv.org/abs/2301.10343 Blog: microsoft.com/en-us/research… Thread🧵
Open Problems in Applied Deep Learning If you're looking for interesting open problems in DL, this is a good reference. Not sure if intentional but it also looks useful to get a general picture of current trends in deep learning with ~300 references. arxiv.org/abs/2301.11316 https://t.co/XGqIo9Hjnk
LLMs like ChatGPT are becoming more fluent – how can we detect if something was written by a language model or a human? We developed DetectGPT: a method for detecting if a passage was written by a particular language model.
StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesis significantly improves over previous GANs and outperforms distilled diffusion models in terms of sample quality and speed abs: arxiv.org/abs/2301.09515 project page: sites.google.com/view/stylegan-…
Excited to have our paper on using large language models like ChatGPT for protein design come out in ! You can tell a language model which type of protein to design, and it can generate one from scratch!