Issues while loading in parallel into a partitioned table
Hi there,
We have a Fact table that gets loaded monthly with 410 Millions rows. We therefore, decided to create a partitioned table having its partition key the week_of_Year.
Process: performed using SSIS one package.
We first load the data from staging in parallel using 4 different connections into 4 weekly work tables, about 108 Millions each; and during this process we perform all the lookups and transformations.
The next step we load from the 4 work tables into the partitioned Fact Table. We still use 4 different connections, and data flows that run in parallel to perform this task. However, if we do not drop all the indexes we receive a Lock error.
We hoped to be able to load in parallel into a partitioned table without having to drop at list the Primary Key index. However, it seams that this is not possible.
Any idea why?
Thanks
-Walter
