Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Except Pandas and SciPy use libraries written in CXX or Fortran and not pure python so speed is not really an issue with them usually


pandas.read_csv is kind of abysmally slow, unfortunately. There are a couple of alternatives, but nothing has really taken hold.

Dask exists, but not everyone can run a distributed system to read a multi-gigabyte csv.


Have you tried paratext from wiseio? I have had good experiences with it.


I have. For whatever reason, I had difficulty with it.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: