Bulk Saving?


Author
Message
Edhy Rijo
E
StrataFrame VIP (4.6K reputation)StrataFrame VIP (4.6K reputation)StrataFrame VIP (4.6K reputation)StrataFrame VIP (4.6K reputation)StrataFrame VIP (4.6K reputation)StrataFrame VIP (4.6K reputation)StrataFrame VIP (4.6K reputation)StrataFrame VIP (4.6K reputation)StrataFrame VIP (4.6K reputation)
Group: StrataFrame Users
Posts: 2.4K, Visits: 23K
Hi guys,



I have an import process of CSV files with more than 300 thousand records, I have to read each one and compare against my records and then insert them in another table for future reference with other imports.



My approach is to loop through the imported records collection and then add them to the BO using BO.NewRow(), so far so good, the problem comes when I need to save them using BO.Save(), it takes a long time to actually insert those 300+K records.



I am using the DDT for all my data modeling, and this table is setup to use Store Procedures for all Insert/Update/Delete and also is using an AutoIncrement PK.



In the BO I have turn off the Update/Delete ConcurrencyType and there is no value in the RowVersionOrTimestampColumn.



Is there anything else I may need to do to save those records faster?




Edhy Rijo

GO

Merge Selected

Merge into selected topic...



Merge into merge target...



Merge into a specific topic ID...




Threaded View
Threaded View
Edhy Rijo - 15 Years Ago
Keith Chisarik - 15 Years Ago
Keith Chisarik - 15 Years Ago
Edhy Rijo - 15 Years Ago
Keith Chisarik - 15 Years Ago
Edhy Rijo - 15 Years Ago
Edhy Rijo - 15 Years Ago
Keith Chisarik - 15 Years Ago
Edhy Rijo - 15 Years Ago
Keith Chisarik - 15 Years Ago
Edhy Rijo - 15 Years Ago
Keith Chisarik - 15 Years Ago
             Bulk copies....can't live without'em! :D
Trent L. Taylor - 15 Years Ago
Edhy Rijo - 15 Years Ago
                     Trent,

Talking about concurrency, in this same process,...
Edhy Rijo - 15 Years Ago
                         Yes. There are a number of ways to make sure that there is not any...
Trent L. Taylor - 15 Years Ago
                             Thanks for the info.

I believe the AutoHandleCollisions...
Edhy Rijo - 15 Years Ago
                                 That is the only place that the dialog is fired from. So if you want...
Trent L. Taylor - 15 Years Ago
ChanKK - 14 Years Ago
Dustin Taylor - 14 Years Ago

Similar Topics

Reading This Topic

Login

Explore
Messages
Mentions
Search