ALBERT vs BERT Parameters

Matrix Factorization: V x E + E x H < V x H
Layer Sharing: 12 Layers share same weights