How to Improve DownloadS

[Coldguru]

HI ,

I have 20K-40K records(20-60) columns data ,which i am putting on my web site
for the user to download (in excel format). And it's taking lot of time for
them to download ( first it will retrieve the data from a database table and
displayin table format ,and then using <cfcontent converting into excel,.....
This is all happening in a single page.)

What are my options, how can I improve the speed.

Thanks

[Stressed_Simon]

Does the content change much?

[Coldguru]

New data Gets added everyday, so let me know whatever you got.

[Coldguru]

I probably need something, where i can generate this excel file and zip it and keep it ready for them to download, Do I have an option to all these programetically rather than manual.

[Stressed_Simon]

Does the old data ever get updated? Or does it remain the same once it has been set?

[Coldguru]

No, my old data never get updated,stays the same once it's there.

[GeorgeWS]

I go like this:

<cfcontent type="application/vnd.ms-excel"> above the output (tables) and for
great speed I use the cachedwithin feature in the cfquery. use the schedule
part in the CF admin and run it in the early morning; then it will be cashed
and when someone calles the data to excel the data is already cached and
generates the page. I am this for very large record sets, looping through
millions of records. Hope this help

[Mr Black]

Every time you get records from the database and format them into a table, save
your generated content (HTML) in a flat file. Next time, just select new
records and append them. Save the new file. This will greatly reduce the
rendering process. Of course, there is nothing you can do about sending the
data, unless you zip them, which may be inconvenient on the other end.

You may enable GZIP compression on the server, if your server has this
feature. So the content you are sending will be 4-10 times smaller. Browser
will decompress it on the fly.

[MattRobertson]

Stay away from using gratuitous dynamic generation for this. You're using a
ton more resources than you need to. Write a physical file to disk and then
call it as much as you like. That will wipe out the server side of the load,
mostly.

Next you have to deal with client side. First thing to do is make sure you
optimize your table and html output so it needs the minimum number of
characters to display. Use styles and no FONT commands. If you can, write
your styles so they apply to the TD element and don't need a div or style
attribute to the td. That will save a boatload of characters right there. Get
rid of any extra line breaks that you can manage as well.

Once you've minimized your server side, and output, you need to minimize the
amount of time needed to pump it down the wire. You can add gzip compression
to your CF-generated pages very easily. Go to the Macromedia Exchange and look
up CFX_GZIP and CF_GZipPage. The compression you can get out of it is
gigantic, which in turn will significantly reduce the time it takes to send the
data down the pipe.

Hope this helps,

--Matt--
MSB Web Systems... [url]http://mysecretbase.com[/url]
"When in doubt, mumble. When in trouble, delegate. When in charge, ponder."
- Senator. David Boren