Edhy - You are normally very fast in posting your results, so I would like to know if You got it working ?

/Teddy

Hmmmm, that must be a bad habit just kidding



Seriously, I am still working on this but I went a different approach based on the application requirements which are as follows:

1.- The CSV data saved in the varbinary field is used once or twice. The data is imported into a table and once the records are imported this CSV data is not used anymore unless there is a problem with the imported records and the CSV needs to be imported again.



2.- Based on number 1, I don't need this big field value being loaded in any way during normal operations unless I need to read the CSV again to re-import the records.



So this is what I did:



1.- Create a new table related to the main table. This new table will have the varbinary field.

2.- In the main table BO, create a new property to read the varbinary field from the related table. This will free the main table from this field and speed up the loading process of forms using the main table.

3.- I added a new child form dialog to manage the request for getting the varbinary field via the BO property.



During this process, I am also playing with compressing the CSV data once it is converted to a byte array using System.Text.Encoding.UTF8.GetBytes(value), the compression looks pretty good since one of the CSV file has 9.3 million bytes and when compressed will have 2.6 million bytes. I am not using the .Net compression classes since I have a 3rd party library to handle many things, but I am sure the plain .Net class could do the same.



I am still in the process of refining the custom field property to properly handle getting the varbinary field, decompress it and convert it back to text to be shown in the child form dialog so when I am done I could post some code.



Trent's suggestion here is pretty good and would work for me if I would have to show the CSV data all the time when opening the form, but that is not my case for now

Edhy Rijo

OK - thanks, was just curious on what route You choose.

I will probably later try to implement Trents technique to see if I can improve my form with the XML files.

/Teddy

That technique it will give you the impression of loading the data faster and in fact it will do that because all other fields will be loaded first and then it will go get the varbinary field's data.



What worried me more was the fact that my main table is being used in several other forms as a parent table and all those form where suffering from slow loading and searching for records because when using the Browse Dialog all fields would be included in the search including the varbinary even though this field was not shown in the browse dialog, by removing this field from main table and putting it in a child table fixed my problem.

Edhy Rijo

This is all good stuff. One other thing I thought I would mention is well is that you can also pull from a VarBinary field asynchronously as well. So this isn't just for saving, but retrieving also. This is also what we do in our medical app for images. Most times you don't even seen the progress bar come up. But when a large file is being retrieved over a slow connection, then the end-user will see the progress bar and know that it is being downloaded. Once we added this functionality a year or two ago in the app, it made a huge difference to our users. Just another item for thought here.

OK - i tried to get this to work, but am apparently missing something, because i get this error:

BusinessLayerException
  The field could not be truncated.

Source     : MicroFour StrataFrame Business

Stack Trace:
   ved MicroFour.StrataFrame.Business.BusinessLayer.TruncateBlobField(PrimaryKeyValue pk, String fieldName)
   ved MicroFour.StrataFrame.Business.BusinessLayer.PushBlobFieldThread(Object parameters)

Any hints?

Teddy, are you referring to the PullBlob or PushBlob here?

It was the PushBlob, but I have it working now.

I had a null value issue on my test BO.

It's pretty cool.

Thx.

/Teddy

Great....glad you got it going! Yeah, it is really nice when you want to save or retrieve data asynchronously. Especially when dealing with larger data saves.