Lookup task run very slow when hitting big tables

I try to convert a Procedure that join 8 tables with INNER AND OUTER JOIN, my understanding is that the Lookup task is the one to use and I should break these joins into smaller block, it takes a long time to load when I do this, since each of these tables had 10-40mill. rows and I have 8 tables to go thru, currently this Stored Procedure took 3-4min to run, by converting this to 8 Lookup tasks, it ran for 20min. has anyone run into this issue before and know a work around for this.

Thanks

[676 byte] By [tm9t9] at [2008-2-14]

«« OLE DB or ODBC error: [DBNETLIB][ConnectionOpen (Connect()).]SQL Server does not exist or access
»» pushsource clock selection

# 1

Dear

tm9t9,

I haven’t tried

this (with 10 to 40 mil. rows) before, but according to my experience

natural-join (just use “table1.row1 = table2.row1”) is easier and less complex;

Or you can just INDEX the tables; but this is also difficult

for transaction/processing files/tables.

SupunLiyanage at 2007-8-31 >

top of Msdn Tech,Architecture,Modeling and Tools...

# 2

This Is Right, But Slow

HassanAyoub at 2007-8-31 >

Architecture Hot Topic

Architecture New Topic

Architecture

Java / MSDN / Linux Tech / PHP Tech / MSDN DotNet / MSDN TECH / Health Library / Programmers Tech / visual basic Tech / Developer Tech / Ipod faqs / Msdn China Tech