Update: This paper was published at NeurIPS 2021 check out the final version or my presentation.
This work, with Mauricio Alvarez and Mike Smith, has been the main focus of the first year of my PhD, check it out on arXiv.
There will be a blog post explaining the key ideas coming soon!