You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.
Currently, in many cases, LayerChoice induces long names like net.op_choice.choices.3.conv. There are two problems:
choices is basically useless. Users actually want to see net.op_choice.3.conv.
Use number to label the candidates in LayerChoice is not clear and easy to understand. Users should have the ability to give the modules customized names, like net.op_choice.sepconv3x3.conv. This is useful for debugging, visualizing and dumping search space for distributed search.
How to implement it
For point 1, I think adding the modules directly into _modules will work. We can refer to the implementation of nn.ModuleList.
For point 2, we can allow the op_choices in LayerChoice be more than a list (for example an OrderedDict). Refer to nn.Sequential.
As this involves changes of API, let's discuss it first.
This discussion was converted from issue #2112 on June 09, 2021 10:11.
Heading
Bold
Italic
Quote
Code
Link
Numbered list
Unordered list
Task list
Attach files
Mention
Reference
Menu
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Currently, in many cases, LayerChoice induces long names like
net.op_choice.choices.3.conv
. There are two problems:choices
is basically useless. Users actually want to seenet.op_choice.3.conv
.net.op_choice.sepconv3x3.conv
. This is useful for debugging, visualizing and dumping search space for distributed search.How to implement it
For point 1, I think adding the modules directly into
_modules
will work. We can refer to the implementation ofnn.ModuleList
.For point 2, we can allow the
op_choices
in LayerChoice be more than a list (for example an OrderedDict). Refer to nn.Sequential.As this involves changes of API, let's discuss it first.
Beta Was this translation helpful? Give feedback.
All reactions