ELECTRA

Google AI’s new approach to natural language processing (NLP) exceeds performance expectations as compared to existing NLP techniques, though at a smaller scale. Code for single GPU-based pre-training of the new ELECTRA or Efficiently Learning an Encoder that Classifies Token…