OLE DB Destination issue in ForEach Data Flow
Has anyone encountered the following problem:
I have a ForEach container with a single task in it - a Data Flow. The Data Flow uses a Source Script transformation to read each file and writes out to several output streams, each of which is connected to a OLE DB Destination.
The ForEach executes for each file (in my example 3 times) but only the data from the last execution is in the DB tables.
This from is my output window:
SSIS package "PIF.dtsx" starting. The tables only have the data from the final execution. An interesting side note is that I also have another Data Flow that reads a single file input of a different layout which executes first and that data still resides in the table. So I have the data from the first file (non-ForEach) and the data from the last execution of the ForEach Data Flow. Any clues?
Information: 0x4004300A at ETL Audit, DTS.Pipeline: Validation phase is beginning.
Information: 0x4004300A at Load V6 Policy, DTS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at Load V6 Policy, DTS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Load V6 Policy, DTS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at Load V6 Policy, DTS.Pipeline: Execute phase is beginning.
Information: 0x402090DF at Load V6 Policy, stg_RiskLocation [5449]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_PDMRFeed [5277]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_Policy [5208]: The final commit for the data insertion has started.
Information: 0x402090E0 at Load V6 Policy, stg_RiskLocation [5449]: The final commit for the data insertion has ended.
Information: 0x402090DF at Load V6 Policy, stg_PolicyCoverage [5519]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_RiskUnit [5484]: The final commit for the data insertion has started.
Information: 0x402090E0 at Load V6 Policy, stg_PolicyCoverage [5519]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_Policy [5208]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_RiskUnit [5484]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_PDMRFeed [5277]: The final commit for the data insertion has ended.
Information: 0x40043008 at Load V6 Policy, DTS.Pipeline: Post Execute phase is beginning.
Information: 0x40043009 at Load V6 Policy, DTS.Pipeline: Cleanup phase is beginning.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_Policy" (5208)" wrote 480 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_RiskLocation" (5449)" wrote 0 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_RiskUnit" (5484)" wrote 924 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_PolicyCoverage" (5519)" wrote 6802 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_PDMRFeed" (5277)" wrote 6768 rows.
Information: 0x4004300A at Load V6 Policy, DTS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at Load V6 Policy, DTS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Load V6 Policy, DTS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at Load V6 Policy, DTS.Pipeline: Execute phase is beginning.
Information: 0x402090DF at Load V6 Policy, stg_PolicyCoverage [5519]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_RiskLocation [5449]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_Policy [5208]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_PDMRFeed [5277]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_RiskUnit [5484]: The final commit for the data insertion has started.
Information: 0x402090E0 at Load V6 Policy, stg_RiskUnit [5484]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_PDMRFeed [5277]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_RiskLocation [5449]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_PolicyCoverage [5519]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_Policy [5208]: The final commit for the data insertion has ended.
Information: 0x40043008 at Load V6 Policy, DTS.Pipeline: Post Execute phase is beginning.
Information: 0x40043009 at Load V6 Policy, DTS.Pipeline: Cleanup phase is beginning.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_Policy" (5208)" wrote 546 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_RiskLocation" (5449)" wrote 73 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_RiskUnit" (5484)" wrote 997 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_PolicyCoverage" (5519)" wrote 7021 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_PDMRFeed" (5277)" wrote 6985 rows.
Information: 0x4004300A at Load V6 Policy, DTS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at Load V6 Policy, DTS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Load V6 Policy, DTS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at Load V6 Policy, DTS.Pipeline: Execute phase is beginning.
Information: 0x402090DF at Load V6 Policy, stg_RiskLocation [5449]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_Policy [5208]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_PDMRFeed [5277]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_RiskUnit [5484]: The final commit for the data insertion has started.
Information: 0x402090DF at Load V6 Policy, stg_PolicyCoverage [5519]: The final commit for the data insertion has started.
Information: 0x402090E0 at Load V6 Policy, stg_RiskLocation [5449]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_PDMRFeed [5277]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_RiskUnit [5484]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_Policy [5208]: The final commit for the data insertion has ended.
Information: 0x402090E0 at Load V6 Policy, stg_PolicyCoverage [5519]: The final commit for the data insertion has ended.
Information: 0x40043008 at Load V6 Policy, DTS.Pipeline: Post Execute phase is beginning.
Information: 0x40043009 at Load V6 Policy, DTS.Pipeline: Cleanup phase is beginning.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_Policy" (5208)" wrote 551 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_RiskLocation" (5449)" wrote 73 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_RiskUnit" (5484)" wrote 1005 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_PolicyCoverage" (5519)" wrote 7068 rows.
Information: 0x4004300B at Load V6 Policy, DTS.Pipeline: "component "stg_PDMRFeed" (5277)" wrote 7032 rows.
SSIS package "PIF.dtsx" finished: Success.
The program '[304] PIF.dtsx: DTS' has exited with code 0 (0x0).

