Reading from MS Access is SUPER SLOW
Hello: I'm experiencing very slow read speeds from one (1) Access database table that only has approx. 114K records in it. This is also a local copy of the database (.mdb) file (did so to rule out network latency). Is there some trick to increase the read speed for Access?
I'm experiencing the same problem. Reading an .mdb database of 200 MB with FME workbench is taking me close to 2 hours to read with the MSACCESS_JDBC reader. I've added the following environment variables in >tools> Edit Header
FME_JVM_MIN_HPEAP_SIZE: 1024M
FME_JVM_MAX_HEAP_SIZE: 16384M
And the improvement is quite minimum (~10% improvement).
Any suggestions?
In case it helps, mdb_process_test.txtI attach the log file where I am reading only a few MB of the database, and it still takes almost 2 minutes:
Thanks!!
Curious what platform you're on, and if you tried the JDBC MS Access reader as well. That one has greater performance in our tests. Wondering if there may be something special about your dataset too -- if you're willing to share it, please do send in to support@safe.com or post it here.
How slow are we talking here - any resorsouce warnings in your log file?
Have you tried compacting the mdb first?
No WHERE clause at all. It's just a simple read on all records in the table.
Is there a WHERE-clause defined in the reader? If yes, are the referenced fields indexed?
