[fpc-pascal] Caching a big file on memory

Eduardo nec556 at retena.com
Mon Sep 11 18:09:41 CEST 2006


Hello:

	I have a little problem, i participe in the 'Large Compression 
Benchmark' (http://cs.fit.edu/~mmahoney/compression/text.html) and 
need to cache the whole enwik8 file (100MB) on memory but when i try 
to  allocate space for it i get a compiler error, saying that maximum 
is 64MB (67108864). I tried to use $MEMORY 200000000,500000000 (200MB 
stack and 500MB heap) and the compiler switches, but no success.

	I need all the file on RAM beacause i want to do a BWT, which 
implies a sort of the 100MB and uses 400 more MB, and doing so from 
hard disk is very slow. The contest has a time limit of 10 hours on a 
1Ghz machine, but i need all speed at BWT/sort phase, so i can spend 
the time on getting better compression.

	Must i touch the system, rtl etc... files and recompile compiler? Or 
is there another, and simpler, way?

P.D. Of course, my pc has more than 100 MB (1.25 GB)




More information about the fpc-pascal mailing list