Skip to content

Instantly share code, notes, and snippets.

@SandeepGusain

SandeepGusain/normalise.py

Forked from j4mie/normalise.py
Created October 18, 2019 18:52
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save SandeepGusain/6d1b9ebf1d67f98048069f78314d50e7 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save SandeepGusain/6d1b9ebf1d67f98048069f78314d50e7 to your computer and use it in GitHub Desktop.
Download ZIP
Normalise (normalize) unicode data in Python to remove umlauts, accents etc.
Raw
normalise.py
# -*- coding: utf-8 -*-
import unicodedata
""" Normalise (normalize) unicode data in Python to remove umlauts, accents etc. """
data = u'naïve café'
normal = unicodedata.normalize('NFKD', data).encode('ASCII', 'ignore')
print normal
# prints "naive cafe"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment