Load the Staging DB


1) Create the "US County Business Patterns - Staging" DB + Tables.
 
(If you have not created the DB + Tables...Please refer to Download - Source text files + Table creation scripts + SSIS Packages page)
     
     
2) Here is a pictorial representation of loading source text files to Staging DB..


3) Master package:

   

            Loading text files: 2008_1998

   


4) Key highlights are in the video

           
      


 Minor correction in video: While describing one of the packages, i mentioned "For Each Loop Container" as a "Sequence container." I apologize for the oversight.


5) Score Card:

                 Number of records loaded: 30+ million rows

                 Time taken to load: under 6 minutes

                 System: MacBook Pro
                              Dual booting with Windows 8 & Mac OS
                              500 GB SSD
                              8GB RAM




No comments:

Post a Comment