Skip to content

Latest commit

 

History

History
executable file
·
14 lines (12 loc) · 445 Bytes

File metadata and controls

executable file
·
14 lines (12 loc) · 445 Bytes

Text processing

General info

The set of classes to classify and analysis of texts

Description

We consider text processing in the area of:

  • preprocessing: remove punctuation, stemming of the words
  • calculate the Jaccard Similarity of the texts: in classical way and by the MinHash Algorithm

Technologies

Project has been created in Python 3.7.5. Main libraries:

  • Natural Language Toolkit (NLTK)
  • datasketch
  • unittest