Modular Deep Learning
Sebastian Ruder
FEBRUARY 23, 2023
For modular fine-tuning for NLP, check out our EMNLP 2022 tutorial. d) Hypernetwork: A small separate neural network generates modular parameters conditioned on metadata. We provide a high-level overview of some of the trade-offs of the different computation functions below. For a more in-depth review, refer to our survey.
Let's personalize your content