Fan Mode
Fan mode informs weight initializers of the dimension for the weight matrix where Fan In corresponds to the size of incoming data and Fan Out corresponds to the size of outgoing data.
Fan mode informs weight initializers of the dimension for the weight matrix where Fan In corresponds to the size of incoming data and Fan Out corresponds to the size of outgoing data.