Skip to content

fabriziomiano/VocabularyAnalyzer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

79 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Vocabulary analyzer

Are you always using the same words in your scientific papers? This is a tool to run a text analysis on PDF files containing an English corpus.

What is it?

It's essentially the Flask WebApp of the repo VocabularyAnalyzer, a simple tool to extract keywords and Part-Of-Speech distributions from a given PDF.

How to run

Install Python3.6+, create a virtualenv and, within the environment,

pip install -r requirements.txt.

Then run

python runserver.py

If all's good the local webapp will be up at http://127.0.0.1:5000, aka localhost.

Considerations

The tool is designed to run only on searchable PDF, namely PDF files in which the text can be selected and copied. That's it!

Results

Here there are the sample results obtained by running on a PDF of some proceedings I wrote a long time ago, taken from here.

Word cloud

alt text

Top 20 keywords

alt_text

Top 20 nouns

alt_text

Top 20 adjectives

alt_text

Top 20 adverbs

alt_text

Top 20 verbs

alt_text

Top 20 entities

alt_text

Top 20 entity types

alt_text

Acknowledgements

Thanks to the people at spaCy for the NE part, and to the guys who made word cloud for the awesome word-cloud images that can be produced.

About

A WebApp to produce distributions of keywords and parts of speech in a given PDF

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Used by

Contributors

Languages