How Many Products it is Possible to Import to Magento? Will it Work for a Million of Products?
Date: December 3, 2012
Magento is one of the most popular and asked-for e-commerce solutions. It provides multiple features useful for store owner. The platform is designed specially for online merchants who are planning to constantly develop their stores enriching them all the time adding more and more products. Naturally, there arise the questions: Is there any limit on Magento product import? How many products can Magento handle? Is it possible to perform Magento import of a million or so products?
To provide some clarity to the situation, Magento can handle millions of items, however there are some points need to be paid attention to. The problem comes down to server performance and how to manage that many products in a catalog from a business perspective.
First of all, it is a matter of memory. Magento import loads a large amount of data, thus the more stores and products you have the slower is the performance. As soon as you start adding large amounts of product data via Magento product import you will hit limits very quickly. Thus, considering store with huge product sets, make sure that your server memory limit is as big as it can possibly be.
Magento is unquestioningly a fully-featured platform, but it is either heavy-load one. It is happening because particularly during each change, the request to the server is made. In order to avoid server overload you should consider server with high performance. The main principle to obtain fast page loads is: the more products have been added to your multiple stores by means of Magento import, the larger the server resources should be.
Finally, cached content helps to reduce the number of server requests, but it is obviously pain for owners who make changes and need them to be reflected at the front-end. The processes of flushing cache and re-indexing are required after each bulk procedure, such as Magento product import. However, the problem with clear cache and re-index occurs after the products are imported. To tell the truth, getting back to the initial question, very often the issues emerge directly in the process of Magento import itself in case you upload huge amounts of products.
So how it is possible to improve the situation?
Basically, the main problem of Magento import is that Magento admin as well as any other import solution can hardly import thousands, let alone million of products. However, there is the software that supports such a functionality and handles import of 1 million products in one procedure from one file. The application is called Store Manager for Magento. Definitely, it will take long, but there will be no need to divide the file for Magento product import into portions running the process a couple of times. The software has the option to do clear cache and re-index right in the process of import, so there will be no need to do it manually.
Undoubtedly, server resources should be carefully thought about in advance. It is also possible to reduce server load to some extend. Store Manager for Magento is desktop application, not web-based solution, so the Magento import procedure can be executed with local PC resources rather than server resources.
To get to know more about Store Manager for Magento is possible - http://www.mag-manager.com
To conclude, being the realist, each understands that in any case Magento product import of million or so entities will take quite long. However, some improvements which have been already made bring us a step closer to managing huge data sets in more convenient way. Lets hope that very soon Magento import of tens millions of products will be possible in a flash.
By Oksana Semenyuk