SQL Server Business Intelligence

SQL SERVER 2005 & 2008 IS THE MAIN THEME OF THIS BLOG

Tuesday, February 14, 2006

Performance When Loading Data into Oracle Using SSIS

It is a known fact that the Microsoft OLE DB for Oracle / Oracle's their own OLE DB drivers does not perform well during data load. They are extremly slow.

You can see vaious people have difficulties with this provider(s).
http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=130786&SiteID=1
http://forums.microsoft.com/msdn/showpost.aspx?postid=117014&siteid=1
http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=124921&SiteID=1&mode=1

Donald has written a blog about the stance within Microsoft. You might find it surprising what are about to read:
http://www.sqljunkies.com/WebLog/donald_farmer/archive/2005/03/13/8819.aspx

The solution is provided by a company called Persistent Systems. The numbers are impressive with their Oracle Bulk Load Connector. Check how impressive the numbers compares for yourself at http://www.persistentsys.com/products/ssisoracleconn/ssisoracleconn.htm

I am putting all these in here for my furture reference.

Thanks
Sutha

3 Comments:

  • At 10:04 PM, Blogger Subhash Subramanyam said…

    Hi Thiru,
    I'd like to know if you've bought this Oracle Bulk Load Connector from Persistent. If yes, How is the Pricing ? Or alternatively did you use the workaround suggested by Donald farmer for loading data into oracle.

    Thanks
    Subhash Subramanyam

     
  • At 2:37 AM, Blogger Sutha Thiru said…

    NO I didnt buy the Persistent provider. I did some testing on it and it was really good. In the end I didnt need to connect to Oracle (Extract / Load) so far. If you have to from what I have tested Persistent Provider seems very good.

    Thanks
    Sutha

     
  • At 7:27 PM, Blogger Subhash Subramanyam said…

    Thiru, Thanks for your reply. I used another method and it did a big trick. Using SSIS I dumped the data to a flatfile from SQl Server Source and then used Oracle SQL *Loader for the Import, the performance of overall load saved nearly 80% of its time.

     

Post a Comment

<< Home