KeywordExtraction-BERT BERT is a bi-directional transformer model that allows us to transform phrases and documents to vectors that capture their meaning.