Several bug fixes + performance improvements (HOLD FOR NOW) - #9

Open

joshjung wants to merge 12 commits into

Floby:masterfrom

joshjung:master

Commits on Nov 25, 2014

Rework of some of the underlying functionality. Adding options.split property to help speed up tokenization for huge files where there is distinct breaks between tokens (e.g. CVS file).
jjung
committed
a7eafb7
Updating nodeunit test for special case scenario that was failing for me.
jjung
committed
d914a76
Updating the README.md
jjung
committed
9d2e2b9

Commits on Dec 3, 2014

Adding stepSize option. Also updating Readme.
jjung
committed
ecf0fe3
Adding dispatch of 'split' whenever the options.split is specified and the split token is encountered.
jjung
committed
52d2ea5
Updates to performance and increasing split capabilities.
jjung
committed
1948102
Increasing size of test perf integers.
jjung
committed
d6e53de
Various modifications to get unit tests working again. Attempting to get the 'end' event to fire and it just won't.
jjung
committed
39a5647
Removing the process next tick from the flush method as it was causing issues when trying to listen to when tokenizing was done.
jjung
committed
cc3afac

Commits on Dec 4, 2014

Commits on Dec 11, 2014

Fixing issues to get working with slim-to-jade
jjung
committed
71207ac