Glad you got it working! A dictionary would indeed be a good approach for speed, assuming your lookup codes don't bloat too terribly much. For what it is worth, we have similar requirements on our automated conversion program (converts all the VFP data in our medical app to the appropriate SQL data/structures) and for that application we used SQL bulk copies as Edhy mentioned to get the data into SQL, then we play with it from there. 

I wasn't invovled with the development of that conversion program, so I couldn't tell you why they opted for bulk copies over SSIS, but SSIS is something I do need to become more familiar with regardless.  I've used it several times for one-time deals, and have been impressed with the speed and cabailities. I haven't ever followed all the way through to make a re-usable package, so thanks for reminding me to take a look, Charles .

I think you went with bulk copy over DTS. Lots of people did, for good reason. DTS was pretty clunky in a lot of ways and very hard to tweak. SSIS 2005 was better but the tools were still a bit lacking in the IDE. I think with SSIS 2008 it is really worth a look.



It is worth signing up for the $50 a month access to the LearnDevNow.com videos ( AppDev videos minus the coursebooks etc ) just for the SSIS lessons. I think one trip through the 12 hour training material there and you pretty much have what you need to figure out what you need for a project.