bobmaster/cChardet

PyYoshi 3c02f8766b fix

2012-06-20 11:31:41 +09:00

653 B

Raw Blame History

cChardet

This library is high speed universal character encoding detector. - binding to libcharsetdetect

Requires

Cython: http://www.cython.org/

uchardet-enhanced: https://bitbucket.org/medoc/uchardet-enhanced/overview

pip install or easy_install -U cython

Benchmark

see tests.TestCchardetSpeed

Sample(shift_jis): testdata/wikipediaJa_One_Thousand_and_One_Nights.txt

Result

chardet: 4.009999990463257s, shift_jis

cchardet: 0.0009999275207519531s shift_jis

Contact

Sorry for my poor English :)