Which method should I choose?!

Greetings SSIS friends

I want to implement the following query using SSIS Data flow Source component :

SELECT * FROM someTable WHERE someColumn = 'H'

How do I restrict the data coming from my data source? By that I mean how do I apply the WHERE clause in SSIS?! Should I use a conditional Split component?! but that would mean retrieving all records first then adding the split component (not the most efficient method surely).

Any suggestions would be much appreciated.

[509 byte] By [dreameR.78] at [2007-12-21]
# 1

Write a SQL statement in teh source adapter rather than just selecting a table from teh drop-down.

-Jamie

JamieThomson at 2007-9-10 > top of Msdn Tech,SQL Server,SQL Server Integration Services...
# 2

Hi Jamie,

You've done it again. You've exposed me for what I am - SSIS newbie

Thanks once again.

I have another question. I have been asked to implement one of our numerous Data Warehouse transformation processes as an exercise to further my SSIS knowledge. The current process is a SQL Server 2000 DTS package containing various tasks/steps. The main ETL work is carried out by a rather long stored procedure. I want to convert that stored procedure in to a SSIS package but I am struggling to break it down to the components I need to use. The select list is very long and there are between 15-20 joins between a series of real and derived tables.

What is the best way to go about converting this in to a SSIS components?

Your advice would be much appreciated.

dreameR.78 at 2007-9-10 > top of Msdn Tech,SQL Server,SQL Server Integration Services...
# 3

Well, its hard to say. There is no process to follow here. You have just got to understand where you are trying to get from and where you aretrying to get to - and then build a SSIS data-flow to do the same.

Can't give much help here I'm afraid.

-Jamie

JamieThomson at 2007-9-10 > top of Msdn Tech,SQL Server,SQL Server Integration Services...
# 4
MHO is, u better continue to use the stored procedure instead of createing 15-20 'Merge join' components which requires its inputs to be sorted first.
Thiru at 2007-9-10 > top of Msdn Tech,SQL Server,SQL Server Integration Services...
# 5

Hi SSIS friend,

Yes, you are probably right. If I am to convert all the joins in to merge join components then I would have to sort the input for each data source. But this exercise is mainly to further my SSIS knowledge. I doubt that we will use the new package for the real transformation.

I am going to go ahead and convert the sproc to a series of merge joins and whatever else I need to use and will let you guys know how far I get. I am sure I will have loads of questions to ask when I get to the complicated stuff.

Thanks for all your suggestions.

dreameR.78 at 2007-9-10 > top of Msdn Tech,SQL Server,SQL Server Integration Services...

SQL Server

Site Classified