Strange behavior after reading big file

[J Krugman]

I have a piece of code that looks something like this:

my %hash;
my $i = 0;
open HUGE, 'Huge_File' or die '>*choke*<';
$| = 1; print "\n";
for my $x (<HUGE>) {
chomp $x;
$hash{$x} = $i++ if some_test($x);
print "\rProcessed up to line $i " unless $i % 10000;
}
close HUGE;
print "Done reading Huge_File\n";

# ... do something with %hash

When I run this code, it dutifully reports processing the total
number of lines (to the nearest 10000), but it never prints "Done
reading ... ". As far as I can tell it just hangs. The code works
fine if the input file is of a "normal" size (1000 lines, say),
but I need to run it on a file that is 25 million lines long, and
it is in this case that I observe the hanging behavior I've just
described.

Any suggestions would be most welcome. FWIW the OS is Linux, and
I'm running Perl 5.6.1, and have 0.5G of RAM.

Thanks!

-Jill

Huge_File has about 25 million lines. The reporter statement

I have created a table from my CGI program with data coming from Postgres
and I want to now display this table as an Excel file. How can this be done?
Thanks!

Kevin

[Tad McClellan]

J Krugman <jill_krugman@yahoo.com> wrote:

> for my $x (<HUGE>) {

> but I need to run it on a file that is 25 million lines long,

Then don't read the entire thing into memory:

while ( my $x = <HUGE> ) {


--
Tad McClellan SGML consulting
[email]tadmc@augustmail.com[/email] Perl programming
Fort Worth, Texas

[John Bokma]

[email]kbass@midsouth.rr.com[/email] wrote:

> I have created a table from my CGI program with data coming from Postgres
> and I want to now display this table as an Excel file. How can this be done?
> Thanks!

Turn it into csv or tsv (tab separated values) which can be imported
into Excel.

--
Kind regards, feel free to mail: mail(at)johnbokma.com (or reply)
virtual home: [url]http://johnbokma.com/[/url] ICQ: 218175426
John web site hints: [url]http://johnbokma.com/websitedesign/[/url]

[J Krugman]

In <slrnblkmrq.76h.tadmc@magna.augustmail.com> [email]tadmc@augustmail.com[/email] (Tad McClellan) writes:

>J Krugman <jill_krugman@yahoo.com> wrote:

>> for my $x (<HUGE>) {

>> but I need to run it on a file that is 25 million lines long,

>Then don't read the entire thing into memory:

> while ( my $x = <HUGE> ) {

Yikes. What a whopper.

Thank you so much!

-Jill