bobmaster/cChardet
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
universal character encoding detector
6 commits 1 branch 0 tags 1.2 MiB
Python 76.2%
Cython 15.1%
Makefile 4.4%
Shell 2.3%
Dockerfile 2%
Find a file
PyYoshi fffb4b30ca add testdata
2012-06-20 21:37:15 +09:00
testdata add testdata 2012-06-20 21:37:15 +09:00
.gitignore first commit 2012-06-20 10:41:36 +09:00
cchardet.pyx first commit 2012-06-20 10:41:36 +09:00
charsetdetect.h first commit 2012-06-20 10:41:36 +09:00
libcharsetdetect.dll first commit 2012-06-20 10:41:36 +09:00
readme.md add spec 2012-06-20 11:40:03 +09:00
setup.py first commit 2012-06-20 10:41:36 +09:00
tests.py add benchmark 2012-06-20 11:29:50 +09:00

readme.md

cChardet

This library is high speed universal character encoding detector. - binding to libcharsetdetect

Requires

Cython: http://www.cython.org/

uchardet-enhanced: https://bitbucket.org/medoc/uchardet-enhanced/overview

pip install or easy_install -U cython

Benchmark

see tests.TestCchardetSpeed

Sample(shift_jis):

testdata/wikipediaJa_One_Thousand_and_One_Nights.txt

PC Spec.:

CPU: Intel Core i7 860 2.8GHz

RAM: DDR3-1333 16GB

Result:

chardet: 4.009999990463257s, shift_jis

cchardet: 0.0009999275207519531s, shift_jis

Contact

My blog

Sorry for my poor English :)