Export of products is very slow
Avatar image
Oct 14, 2017
Perrone Vincenzo wrote
Hello,
when I export products, even just some products and some columns, export is very slow.
My catalog is made up of over 200,000 products, now I am extracting 40,000 and after 20 hours is still at 40%.
What can I do to speed up speed?
Thank you.
Reply
10 Answers
Avatar image
Oct 16, 2017
Andrii Yanosh agent wrote

Hello Perrone.



Probably you're using the HTTP Tunnel or Direct database connection, which performance depends on the MySQL connection speed.



In this case, you should try to enable "Cache export" option:


As an option, you may use Bridge Connection, which will export 200'000 products in a few minutes.

Avatar image
Oct 16, 2017
Perrone Vincenzo wrote
Hello,

i use direct connection on my dedicated server (i7 Skylake).

there is another option, becasue i need to create multiple automatic feeds for each agent?
Avatar image
Oct 17, 2017
Andrii Yanosh agent wrote
Hello Perrone.

Cache "Cache export" option will significantly speed up the export process on a direct connection.
Avatar image
Oct 17, 2017
Perrone Vincenzo wrote
with the bridge connection the data is changed in real time?

thank you
Avatar image
Oct 17, 2017
Perrone Vincenzo wrote
I installed the "Bridge Connection" module, I follow the wizard, but the test is ok but the connection goes to "Time Out" when I download the data.
thank you
Avatar image
Oct 18, 2017
Andrii Yanosh agent wrote

Hello Perrone,



Bridge connection is the fastest way to manage store database, however, it requires manual synchronization, which means that you have to Get Data from Web every time before you have started working in Store Manager and Post Changes to Web once the changes are ready to be published.



Concerning the Timeout error. You should try to increase the Bridge connection timeout to 800 seconds:




Avatar image
Oct 18, 2017
Perrone Vincenzo wrote
does not rotate with any setting.
is compatible with the NGINX server?
Avatar image
Oct 19, 2017
Andrii Yanosh agent wrote
Hello Perrone,

Yes, Store Manager is compatible with NGINX server.

You may submit a ticket at https://support.emagicone.com/submit_ticket so we could check the issue for you.
Avatar image
Oct 20, 2017
Perrone Vincenzo wrote
Bridge Connector is for dedicated servers?
Avatar image
Oct 23, 2017
Andrii Yanosh agent wrote
Hello Perrone,

Yes, Bridge Connector can be used on dedicated servers.