There was a really cool workshop at ICLR 2021, with the same title as this blog post, so I had to get involved! I wrote this paper about diagrammatic summaries for neural architectures.

Exec summary

The paper discusses some of the options for the scientific community for diagramming. The tl;dr; is that diagrams are used a lot but no-one thinks about it much. Sound familiar from business?! I’ve made a youtube video about the paper:

The main takeaway of my view on this is that we should start from where we are with our diagramming, and be a bit “agile” about how we move things. Scientific publishing is a strange beast, with large organisations and slow processes, but with really disruptive thinking going on by the “users”, especially in ML research. A very brief summary might be:

If anyone thinks slightly more about their diagramming, that is a good result.