Performance issue with big arrays
When syncing a big data set the in_array function call in StoreData() is a huge perfomance flaw.
Changing it to check for isset on the index as suggsted here http://www.phpgangsta.de/php-in_array-die-performance-bremse reduced the runtime of a 100000 lines csv (already imported entries, update disabled) from 16 minutes to 14 seconds for me.
See attached patch and profiling.
[BUGIFX] Performance issue with big arrays
Avoid in_array function call in StoreData() because it is a huge
performance flaw when syncing big data sets.
Reviewed-by: Francois Suter <email@example.com>
Tested-by: Francois Suter <firstname.lastname@example.org>