Jun 30, 2015
Giuseppe Tripiciano wrote
I manage a store with 120.000 products.
Once a month I import my CSV with "Delete product image" checked and "Skip image if product already have image" unchecked, because over the month some products get somehow a wrong image. So I refresh all images.
The problem is that Store Manager creater 120.000 DELETE actions and 120.000 UPLOAD actions in this process, which take me over a day to complete.
I actually don't care about deleting, I just want them overwrote with the correct one.
I don't even know why should that be done since it's taken care by "Delete products that are not listed in CSV" already.
So I would like to have a checkbox to "Skip delete procedure" in the improt options and go straight to the UPLOAD one, so no more delete actions are created.
Once a month I import my CSV with "Delete product image" checked and "Skip image if product already have image" unchecked, because over the month some products get somehow a wrong image. So I refresh all images.
The problem is that Store Manager creater 120.000 DELETE actions and 120.000 UPLOAD actions in this process, which take me over a day to complete.
I actually don't care about deleting, I just want them overwrote with the correct one.
I don't even know why should that be done since it's taken care by "Delete products that are not listed in CSV" already.
So I would like to have a checkbox to "Skip delete procedure" in the improt options and go straight to the UPLOAD one, so no more delete actions are created.
New
1 vote
Vote
Reply
18 Answers
Jul 01, 2015
Alex Pryshlivskiy
agent
wrote
Hello Giuseppe!
Thanks for post.
Quick decision for you is to change number of FTP threads in Preferences - see attached screenshot.
Please note: if you have 120 000 products - Store Manager needs to delete 120 x 8 types of images also = 960 000 images (see img screenshot)
I didn't quite catch: do you want to replace delete to rewrite images ? Am I right ?
Thanks for post.
Quick decision for you is to change number of FTP threads in Preferences - see attached screenshot.
Please note: if you have 120 000 products - Store Manager needs to delete 120 x 8 types of images also = 960 000 images (see img screenshot)
I didn't quite catch: do you want to replace delete to rewrite images ? Am I right ?
Jul 01, 2015
Giuseppe Tripiciano
wrote
I already have 10 FTP thread, also i have deleted all the image types, so the images are x1 not x8.
I use a custom theme and i don't need the extra image sizes.
I mean to skip completely the delete process, making just the upload. That's enough for a rewrite of files.
There is no need to delete them first for a rewrite of image files.
I could do that with only 120000 operations instead of the 240000 needed for delete + upload.
I use a custom theme and i don't need the extra image sizes.
I mean to skip completely the delete process, making just the upload. That's enough for a rewrite of files.
There is no need to delete them first for a rewrite of image files.
I could do that with only 120000 operations instead of the 240000 needed for delete + upload.
Jul 02, 2015
Alex Pryshlivskiy
agent
wrote
Hello Giuseppe!
According to you info it's better for you to use SSH for quick image remove in this case.
Right now, we are working on PrestaShop Cloud support via HTTP request for images.
So, the operation speed will be in 7 times faster.
It's better for you to wait for new PrestaCloud Release and use this option.
The are a lot of tricks for this - but in this case you should by familiar with MySQL.
By the way, it's not good to leave all images on Hard drive after next update.
In this case after 6-7 months you'll get more 1 mln. images on drive.
According to you info it's better for you to use SSH for quick image remove in this case.
Right now, we are working on PrestaShop Cloud support via HTTP request for images.
So, the operation speed will be in 7 times faster.
It's better for you to wait for new PrestaCloud Release and use this option.
The are a lot of tricks for this - but in this case you should by familiar with MySQL.
By the way, it's not good to leave all images on Hard drive after next update.
In this case after 6-7 months you'll get more 1 mln. images on drive.
Jul 02, 2015
Giuseppe Tripiciano
wrote
In fact I'm not caching images on HD.
I'm familiar with mysql and ssh.
But that wouldn't solve my problem, since even if i delete them in ssh (as i already do), the ftp tasks are still created because the image are in the db.
I don't know all the images related tables in mysql for deletion, can you provide a mysql script for such task?
I'm familiar with mysql and ssh.
But that wouldn't solve my problem, since even if i delete them in ssh (as i already do), the ftp tasks are still created because the image are in the db.
I don't know all the images related tables in mysql for deletion, can you provide a mysql script for such task?
Jul 02, 2015
Alex Pryshlivskiy
agent
wrote
Have you tried to start Store Diagnostics to fix missed images ?
See screenshot Store-Diagnostics-Presta.png
See screenshot Store-Diagnostics-Presta.png
Jul 02, 2015
Giuseppe Tripiciano
wrote
I don't have problem with missed images. And that would take 48h or more with 120000 products.
My problem is that sometimes store manager uploads the wrong image for a product (probably a wrong management of the cache when too many product, a bug i reported some time ago but never looked into).
Back to the original problem, can this checkbox to skip delete be added?
There is no reason to delete an image if you are going to overwrite it anyway. If someone really needs to delete images, that could be a new diagnostic operation.
My problem is that sometimes store manager uploads the wrong image for a product (probably a wrong management of the cache when too many product, a bug i reported some time ago but never looked into).
Back to the original problem, can this checkbox to skip delete be added?
There is no reason to delete an image if you are going to overwrite it anyway. If someone really needs to delete images, that could be a new diagnostic operation.
Jul 02, 2015
Alex Pryshlivskiy
agent
wrote
You asked: "Back to the original problem, can this checkbox to skip delete be added?"
We have scheduled development plan for Store Manager for July and August.
So it's hard to implement such feature in future Releases.
One more thing: According to our Policy, we implement a new features according to the volume of customer votes.
Right now we have 1 comment and 1 vote for this suggestion.
We have scheduled development plan for Store Manager for July and August.
So it's hard to implement such feature in future Releases.
One more thing: According to our Policy, we implement a new features according to the volume of customer votes.
Right now we have 1 comment and 1 vote for this suggestion.
Jul 02, 2015
Giuseppe Tripiciano
wrote
I guess there aren't many PrestaShop users who manage huge products numbers.
Anyway, there is not really a need for adding a checkbox, it could be just the default behaviour.
As I said, there is no purpose in deleting images first, if they are going to be overwritten.
It's an useless process.
Anyway, there is not really a need for adding a checkbox, it could be just the default behaviour.
As I said, there is no purpose in deleting images first, if they are going to be overwritten.
It's an useless process.
Jul 03, 2015
Alex Pryshlivskiy
agent
wrote
Hm... all the same for rewrite process... in this case we need FTP connection and create it again.
So we have bottleneck - FTP thread for those operations.
So we have bottleneck - FTP thread for those operations.
Jul 03, 2015
Giuseppe Tripiciano
wrote
I would cut number of operation in half, instead of delete+upload you have only upload. There is no need to delete if you do upload to overwrite.
Jul 03, 2015
Alex Pryshlivskiy
agent
wrote
Well, in this case it's not so easy to identify images in this case.
From my side I'll try to consult with our team.
From my side I'll try to consult with our team.
Jul 03, 2015
Giuseppe Tripiciano
wrote
What do you mean "is not so easy to indentify images"?
Images are listed in its csv field.
That's why I suggested a checkbox, you shouldn't have to identify them, you just overwrite all when checkbox is checked.
Images are listed in its csv field.
That's why I suggested a checkbox, you shouldn't have to identify them, you just overwrite all when checkbox is checked.
Jul 06, 2015
Alex Pryshlivskiy
agent
wrote
to replace images we need to read whole folder path - and rewrite it successively.
How about this quick variant?
1. Select all product and clear product data - images
2. So you have products without images (in DB).
3. Import csv file with new images.
in this case you don't need wait for deleting.
please note! all old images still on image folder.
Thanks again for suggestion.
Right now we have scheduled development plan. The implementation of this suggestion will depend on number of user votes and comments for this suggestion
How about this quick variant?
1. Select all product and clear product data - images
2. So you have products without images (in DB).
3. Import csv file with new images.
in this case you don't need wait for deleting.
please note! all old images still on image folder.
Thanks again for suggestion.
Right now we have scheduled development plan. The implementation of this suggestion will depend on number of user votes and comments for this suggestion
Jul 06, 2015
Giuseppe Tripiciano
wrote
Ok, this solution seems fine for me. Till now I manually deleted all "DELETE" tasks in ftp tasks.
Jul 06, 2015
Alex Pryshlivskiy
agent
wrote
Please don't forget to fix "dead" images on HDD after that - just run Store Diagnostics and check files.
After that you'll be able to remove images after import in any time.
After that you'll be able to remove images after import in any time.
Jul 06, 2015
Giuseppe Tripiciano
wrote
Yes I wrote a bash script and put it in crontab to do that, which is faster
Jul 06, 2015
Alex Pryshlivskiy
agent
wrote
As an quick solution - it works.
Jul 11, 2015
System
wrote
Hello,
We haven't heard back from you for last 5 days, please confirm that all questions were answered and issues are resolved. In case you haven't received an answer, please check your spam folder or check the status of ticket online at:
https://support.emagicone.com
Maybe we are waiting for some information from your side? In this case please get back to us.
In case we haven't replied you back or in case of any misunderstanding, please reply to this mail with all details so we could proceed.
If you do not reply us back, the ticket will be automatically closed within 24 hours.
With kind regards,
The eMagicOne Administration Team
We haven't heard back from you for last 5 days, please confirm that all questions were answered and issues are resolved. In case you haven't received an answer, please check your spam folder or check the status of ticket online at:
https://support.emagicone.com
Maybe we are waiting for some information from your side? In this case please get back to us.
In case we haven't replied you back or in case of any misunderstanding, please reply to this mail with all details so we could proceed.
If you do not reply us back, the ticket will be automatically closed within 24 hours.
With kind regards,
The eMagicOne Administration Team