SQLBulkCopy and ES


Author
Message
Marcel Heitlager
Marcel Heitlager
StrataFrame User (164 reputation)StrataFrame User (164 reputation)StrataFrame User (164 reputation)StrataFrame User (164 reputation)StrataFrame User (164 reputation)StrataFrame User (164 reputation)StrataFrame User (164 reputation)StrataFrame User (164 reputation)StrataFrame User (164 reputation)
Group: StrataFrame Users
Posts: 84, Visits: 835
Can SQLBulkCopy be implemented with ES? Something tells me I can't because of a connection string issue. But if it is possible, how?



I'm looking for a way to speed up bulk insert in a table in server database (2000 + records)



Thanks as always,



Marcel



Trent Taylor
Trent Taylor
StrataFrame Developer (8.5K reputation)StrataFrame Developer (8.5K reputation)StrataFrame Developer (8.5K reputation)StrataFrame Developer (8.5K reputation)StrataFrame Developer (8.5K reputation)StrataFrame Developer (8.5K reputation)StrataFrame Developer (8.5K reputation)StrataFrame Developer (8.5K reputation)StrataFrame Developer (8.5K reputation)
Group: StrataFrame Developers
Posts: 6.6K, Visits: 6.9K
Well, technically no. The ES connection (EsDataSourceItem) connections you to the ES server which in turn connects to the SQL Server. EVen if you could, you would not necessarily want to do this as you are looking to consume a lot of bandwidth. SqlBulkCopy is generally for use when you are trying to update a database/table with a lot of records for initial or static use (or synchronizations). In other words, a massive number of records for whatever the intent may be. There are some options, dependign on how your ES server is deployed and implemented.



One idea, in this case, would be to add another web server that accepts a ZIP file (or whatever) that has the XML file contents within it. The web service would then do the SqlBlukCopy. This would be pretty fast since you would only be copying up a single file at that point, then the web service would dump all of the records into the table.

GO

Merge Selected

Merge into selected topic...



Merge into merge target...



Merge into a specific topic ID...




Similar Topics

Reading This Topic

Login

Explore
Messages
Mentions
Search