Rating 0 stars - 0 votes

Magento Import of Products Lasts Forever? A Few Tips to Speed It Up

Magento import errors
Magento import errors

Magento is highly stable eCommerce system, but when it comes to bulk operations like Magento import, the procedure of upload can be really slow and take almost forever, making you guess whether it hanged or how much more you should wait. You what’s even worse? Finding the reason of this delay. In most cases it is much more difficult task than actions aimed at improving of import performance optimization.

Generally, Magento import speed depends upon server resources, settings you have and number of goods existing at your store. Speaking of resources and limitations, they should be enough to handle operations you perform - by that is meant that server with high performance and extended memory limit will contribute greatly to overall performance of the procedure. In terms of settings, you might find useful for example enabling automatic logs clearing. But be careful, since in case you will need to check logs because something went wrong, you might not find necessary ones, so you may copy them from time to time (or at least before mass operations). Finally, the more goods you already have, the more records are in your database.

Respectively, the larger it becomes, the heavier is input or update of products.

Luckily, there are a few techniques to speed the procedure up. We will not ask you to delete or clear some database tables, which by the way, is potentially unsafe unless you are 100% sure what you are doing. Separating the files in portions and import in chunks can be way-out, but think - you will have to run it a few times, so what’s the point?

Slow import to Magento can be optimized in performance by using more flexible tools for data upload, like Store Manager for Magento. This useful tool allows you to work directly from your PC. Moreover, with bridge type of database connection you will be able to work with the local copy of your database and then only post changes to your live website. This way, there will be the less load on your server, comparing to direct changes, at which each time requests to server are made.

There are a few more hints to make Magento import via Store Manager even more speedy:

Magento import errors
Magento import errors

- Select appropriate import option

For example, in case if your file for import there are only new goods, select only option “Just Add”. This way the software will not lookup for already existing products with the same information and will append all goods as new. Please note, that in case there are some goods that you have previously added to your shop, they will be added as new and you will have duplicates. Thus, this option will not be suitable for regular updates.

- Uncheck "Reindex product data" checkbox

Re-index is the procedure that allows to re-new indices of your goods when there are some changes performed at your storefront. This definitely good option, but during import, index of each product takes considerable amount of time (approximately 60% of whole time). We advise you to uncheck this option and then perform the procedure from Magento admin and in bulk refresh all the indices after import finishes.

- Have the option "Accelerate import by increasing memory usage" checked.

Usually this option is checked by default and good at low memory amount available at your disposal. It is recommended to use it when you have up to 10 00 of products and would like to add couple of thousands more. With bigger databases, the effect from this option may be opposite and retrieving of information can take even more time.

- Cached import for direct connections.

In case you are using direct connection to database, this option will greatly boost performance in case you are uploading spreadsheets with considerable amount of goods listed. Please note, that it does not affect the procedure in case you are using bridge connection.

- Important images settings: Starting from version 1.9.x Magento requires unique image names for all the images. For the mentioned purposes, in Store Manager were added option to regenerate image name if the same already exists in database. However, since this option checks all the folders with images at your FTP, import might take more time than expected. If you completely sure that your image names are unique you can uncheck this option to speed up the upload.

Magento import orders
Magento import orders

Read more on what else can affect your Magento import speed -


Accelerate product import with Store Manager for Magento Accelerate Import Now!

Related Articles:

Card image

Magento Import: 101 Questions&Answers

Frequently asked questions about Magento import (general questions, errors, categories/images import issues etc). Read More...

Card image

Update Magento Inventory Having Product SKU and Quantity in the Import File

Find out how to update stock with only two columns in the import file and handle the inventory for products not included in the file. Read More...

Card image

Import Images With Store Manager for Magento

Full guidance on images import (local and remte images) and CSV import file sample. Read More...

Card image

How to Perform Automated Product Import

Schedule Magento import to be accomplished on hourly, daily or weekly basis using the saved configuration. Read More...

Be the first to comment.