Magento Import of Products Lasts Forever? A Few Tips to Speed It Up

Magento is highly stable eCommerce system, but when it comes to bulk operations like Magento import, the procedure of upload can be really slow and take almost forever, making you guess whether it hanged or how much more you should wait. You what’s even worse? Finding the reason of this delay. In most cases it is much more difficult task than actions aimed at improving of import performance optimization.

Generally, Magento import speed depends upon server resources, settings you have and number of goods existing at your store. Speaking of resources and limitations, they should be enough to handle operations you perform - by that is meant that server with high performance and extended memory limit will contribute greatly to overall performance of the procedure. In terms of settings, you might find useful for example enabling automatic logs clearing. But be careful, since in case you will need to check logs because something went wrong, you might not find necessary ones, so you may copy them from time to time (or at least before mass operations). Finally, the more goods you already have, the more records are in your database.

Respectively, the larger it becomes, the heavier is input or update of products.

Luckily, there are a few techniques to speed the procedure up. We will not ask you to delete or clear some database tables, which by the way, is potentially unsafe unless you are 100% sure what you are doing. Separating the files in portions and import in chunks can be way-out, but think - you will have to run it a few times, so what’s the point?

Slow import to Magento can be optimized in performance by using more flexible tools for data upload, like Store Manager for Magento. This useful tool allows you to work directly from your PC. Moreover, with bridge type of database connection you will be able to work with the local copy of your database and then only post changes to your live website. This way, there will be the less load on your server, comparing to direct changes, at which each time requests to server are made.

There are a few more hints to make Magento import via Store Manager even more speedy:

- Select appropriate import option

For example, in case if your file for import there are only new goods, select only option “Just Add”. This way the software will not lookup for already existing products with the same information and will append all goods as new. Please note, that in case there are some goods that you have previously added to your shop, they will be added as new and you will have duplicates. Thus, this option will not be suitable for regular updates.

- Uncheck "Reindex product data" checkbox

Re-index is the procedure that allows to re-new indices of your goods when there are some changes performed at your storefront. This definitely good option, but during import, index of each product takes considerable amount of time (approximately 60% of whole time). We advise you to uncheck this option and then perform the procedure from Magento admin and in bulk refresh all the indices after import finishes.

- Have the option "Accelerate import by increasing memory usage" checked.

Usually this option is checked by default and good at low memory amount available at your disposal. It is recommended to use it when you have up to 10 00 of products and would like to add couple of thousands more. With bigger databases, the effect from this option may be opposite and retrieving of information can take even more time.

- Cached import for direct connections.

In case you are using direct connection to database, this option will greatly boost performance in case you are uploading spreadsheets with considerable amount of goods listed. Please note, that it does not affect the procedure in case you are using bridge connection.

- Important images settings: Starting from version 1.9.x Magento requires unique image names for all the images. For the mentioned purposes, in Store Manager were added option to regenerate image name if the same already exists in database. However, since this option checks all the folders with images at your FTP, import might take more time than expected. If you completely sure that your image names are unique you can uncheck this option to speed up the upload.

Read more on what else can affect your Magento import speed -

Accelerate product import with Store Manager for Magento Accelerate Import Now!

    Free upgrade to Magento 2 supported version