Magento 1.5-alpha: Import, import like the wind!

Now that my blood sugar and cholesterol levels are somewhat back to normal after the Xmas feeding madness, I wanted to have a quick look at the new features Magento’s latest release brings to the world of eCommerce. Especially after my colleague Tobias Vogt twittered something very positive about the speed of the new import functionality, I just had to have a look myself.

It is true. Magento’s 1.5 version comes with a new core module called ImportExport that is fast. Amazingly fast. I have only tested is with simple products and a standard set of attributes so far, but I was able to import 1,000 products in under 4 seconds (!) on my Macbook Pro. I’m not sure whether other product types, more attributes etc. will drastically decrease performance or whether this type of import causes problems in other areas – this will have to be tested in more detail – but for now all I can say is: hats off to the core developers!

ImportExport in Magento 1.5

In order to test the import, the first thing I tried was to use a Dataflow import file which contained a decent amount of test products. Unfortunately, the new import format isn’t compatible to the old Dataflow format, so the module only threw errors. Thus, the next step was to manually insert a test product into my fresh install of 1.5-alpha and use the new export functionality to generate a CSV file that I could use as a template for a new import file.

Once the import file was prepared, I was given the choice of wanting either to append, replace or delete existing data – in my case products. I opted for Append Complex Data, hit the Check data button, got a validation in about 2 seconds, hit the import button and was very impressed about 4 seconds later: all products where there in the product management as well as in the respective database tables, very neat! I did the same a second time using the Delete Entities option, and within seconds all these products were deleted again. Those of you who know how painful it can be to get rid of products once they are in the Magento database will really appreciate this I’m sure.

The question now is: How on earth can this thing be do darn fast? The answer: Magento uses less Magento to get the job done. Rather than using the model-structure (in this case, mainly product_catalog), the new ImportExport module uses direct database access via Varien_Db_Adapter_Pdo_Mysql. This class is an extension of the respective class of the Zend Framework, ie. the “magic” happens deeper in the overall system. Of course this approach harbours considerable risks: If there’ s an error in this logic, an import could destroy the store database. But I’m sure Magento is very aware of this and will allow enough time for testing.

I’m happy that Magento addresses one of the most urgent problems in this manner, and if the importer works well in other scenarios yet to be tested, the last Magento release ends this year on a quite positive note.

PS: Further reviews of Magento 1.5-alpha have been produced by inchoo and Baobaz.

Update: At the Imagine eCommerce conference my buddy Vinai Kopp has given a talk on the Magento 1.5 import.

Roman Zenner

arbeitet als Autor und Berater im Bereich E-Commerce. Er hat mehrere Fachbücher zu aktuellen Shopsystemen veröffentlicht und unterstützt mittlere und große Unternehmen bei der Planung und Umsetzung ihrer digitalen Verkaufsstrategie.

    10 Antworten auf Magento 1.5-alpha: Import, import like the wind!

    1. At the end of the import you have to reindex all your product data. this could take a long long time.. nice idea but it’s just a good beginning..

    2. Pingback: LF01 – Endlich schnell? Magento 1.5-alpha – Import und Export |

    3. Pingback: Magento Stratus und die Entwicklungen 2011 » CodersX Blog

    4. Please Can you expalain more how to prepare import file. I want import product from 1.4.2 to 1.5.

    5. Looks good. I got to try tonight for a client.

    6. And I expect, Magento Team works out something for reindex function.

      For example, when you have more than 5000 products, the reindex is a must for important steps and then it just doesnt work and hangs.

      Thats stops me from recommending Magento to my clients many a times.

    7. I prefer unirgy’s extension uRapidFlow Pro, though.

      It’s capable of doing imports lightning-fast, too, and a lot more interesting things.

    8. the only thing i don’t like is the , as separate mark do someone know how i make this a ;


    9. I thought it would be great to set indexes to manual mode while you importing the products, it can be helpful to speed up the import process. Not long ago I purchased Store Manager extension hoping to fill lack of functionality of DataFlow needed for proper work of my Magento store. In regards to price, it might seem pricey but it’s a bargain. This module works perfectly and is a real timesaver. In my store there is about 80k total SKU’s and it would be almost impossible to manage without this extension.

    10. Pingback: Magento Stratus und die Entwicklungen 2011 - codesprint GmbH

    Hinterlasse eine Antwort

    Deine E-Mail-Adresse wird nicht veröffentlicht. Erforderliche Felder sind markiert *

    Du kannst folgende HTML-Tags benutzen: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>