Distill

These papers were submitted to Distill prior to it going on hiatus, and are likely among the last papers Distill will publish in the foreseeable future.

A Gentle Introduction to Graph Neural Networks by @beangoben, @emilyrreif, @adamrpearce, and Alex Wiltschko. distill.pub/2021/gnn-intro/

Today Distill published two expository papers on Graph Neural Networks, listed below.

Distill will be taking a one year hiatus starting today, which may be extended indefinitely. Our editorial team has written some reflections on what we've learned over the past five years, and the factors that led to this decision. distill.pub/2021/distill-h…

Adversarial Reprogramming of Neural Cellular Automata — A new Distill article by @RandazzoEttore, @zzznah, @eyvindn, and @drmichaellevin. This is the fourth article in the Differentiable Self-organizing Systems thread. distill.pub/selforg/2021/a…

New lenses – tools for seeing more detail more clearly –are essential for any scientific endeavor, and this new Circuits article by @mpetrov et al. provides us with an incredibly crisp example of why.

For today's Dynamically Typed, I finally sat down to read (and summarize!) three recent @distillpub articles, on multimodal neurons, branch specialization, and weight banding. I'll highlight each one in this thread; all three are also here: dynamicallytyped.com/issues/063/ (1/4)

Weight Banding — A new Distill article by @mpetrov, @csvoss, @ludwigschubert, @nickcammarata, @gabeeegoooh, and @ch402. This is the ninth article in the Circuits thread. distill.pub/2020/circuits/…

Branch Specialization — A new Distill article by @csvoss, @gabeeegoooh, @nickcammarata, @mpetrov, @ludwigschubert, and @ch402. This is the eighth article in the Circuits thread. distill.pub/2020/circuits/…

Do neural networks have any emergent structures that are larger-scale than circuits? In our new Circuits article, we investigate the tendency of neural network branches to *specialize* – sorting closely-related features together across distinct branches. distill.pub/2020/circuits/…

Multimodal Neurons in Artificial Neural Networks -- A new Distill article by @gabeeegoooh, @nickcammarata, @csvoss, @shancarter, @mpetrov, @ludwigschubert, @AlecRad, and @ch402. distill.pub/2021/multimoda…

Self-Organising Textures — A new Distill article by @eyvindn, @zzznah, @RandazzoEttore, and @drmichaellevin. This is the third article in the Differentiable Self-organizing Systems thread. distill.pub/selforg/2021/t…

Visualizing Weights — A new Distill article by @csvoss, @nickcammarata, @gabeeegoooh, @mpetrov, @ludwigschubert, Ben Egan, Swee Kiat Lim, and @ch402. This is the seventh article in the circuits thread. distill.pub/2020/circuits/…

Curve Circuits — A new Distill article by @nickcammarata, @gabeeegoooh, @shancarter, @csvoss, @ludwigschubert, and @ch402. This is the sixth article in the circuits thread. distill.pub/2020/circuits/…

High-Low Frequency Detectors — A new Distill article by @ludwigschubert, @csvoss, and @ch402. This is the fifth article in the circuits thread. distill.pub/2020/circuits/…

Naturally Occurring Equivariance in Neural Networks -- A new Distill article by @ch402, @nickcammarata, @csvoss, @ludwigschubert, and @gabeeegoooh. This is the fourth article in the circuits thread. distill.pub/2020/circuits/…

Understanding RL Vision -- A new Distill article by @JacobHHilton, @nickcammarata, @shancarter, @gabeeegoooh, and @ch402. distill.pub/2020/understan…

Communicating with Interactive Articles -- A new Distill article by @fredhohman, @mathisonian, @jeffrey_heer, and @polochau. distill.pub/2020/communica…

Interested in this line of work? Check out the #selforg channel on the Distill slack (slack.distill.pub) for discussion and ongoing experiments!

Self-classifying MNIST Digits -- A new Distill article by @zzznah, @RandazzoEttore, @eyvindn, @drmichaellevin and @samgreydanus. This is the second article in the differentiable self-organizing systems thread. distill.pub/2020/selforg/m…