MrEliptik
/ text_preprocessing.py
Created
January 14, 2019 12:01
A python script to preprocess text (remove URL, lowercase, tokenize, etc..)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import re, string, unicodedata | |
| import nltk | |
| import contractions | |
| import inflect | |
| from nltk import word_tokenize, sent_tokenize | |
| from nltk.corpus import stopwords | |
| from nltk.stem import LancasterStemmer, WordNetLemmatizer | |
| def replace_contractions(text): | |
| """Replace contractions in string of text""" |
thriveth
/ CBcolors.py
Created
January 22, 2014 14:52
A color blind/friendly color cycle for Matplotlib line plots.
Might want to shuffle it around a bit more,but already not it gives kinda good contrasts between subsequent colors, and shows reasonably well in colorblind filters (though not in pure monochrome).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| CB_color_cycle = ['#377eb8', '#ff7f00', '#4daf4a', | |
| '#f781bf', '#a65628', '#984ea3', | |
| '#999999', '#e41a1c', '#dede00'] |