ExifTool Forum

ExifTool => Developers => Topic started by: obetz on July 15, 2019, 02:57:12 AM

Title: Large EPS sample file for testing?
Post by: obetz on July 15, 2019, 02:57:12 AM
Hi Phil,

the "known problems" section lists "[2013-04-21] Memory available to ExifTool in the Windows EXE version is limited to a few hundred MB. This limitation has been known to cause unreasonably long processing times (almost 7 minutes) for some large EPS files (> 200 MB) which are processed much faster by the Perl version (< 6 seconds)"

The related thread seems to be https://exiftool.org/forum/index.php/topic,4971 and there has been a similar report in 2010: https://exiftool.org/forum/index.php/topic,1415

The files mentioned in both threads are no more available, can you provide a (a link to) such a large EPS?

I would like to check this issue with the "non-PAR" version I prepared.

The next step would be to use a 64 bit Perl but I don't think it's really needed.

Oliver
Title: Re: Large EPS sample file for testing?
Post by: Phil Harvey on July 19, 2019, 06:56:42 AM
Hi Oliver,

I looked, but I couldn't find those files.  Sorry.

- Phil
Title: Re: Large EPS sample file for testing?
Post by: obetz on July 19, 2019, 09:05:51 AM
no problem, maybe I can construct one, or ask a friend with Adobe Illustrator to create it.
Title: Re: Large EPS sample file for testing?
Post by: obetz on July 19, 2019, 11:43:19 AM
even with a 340MB eps file I created by adding two large tiff files to a page in Illustrator CS2, I couldn't reproduce the problem with the standalone executable ExifTool back to 7.76.

Special preconditions seem to be needed to create an eps file which "changes newline characters mid way through". I'm neither a spe*02*t (again the ... filter) for Illustrator nor file formats, so I give up testing this.

Oliver
Title: Re: Large EPS sample file for testing?
Post by: Phil Harvey on July 19, 2019, 11:53:41 AM
I seem to remember that the problem EPS had a very large embedded TIFF image.

- Phil
Title: Re: Large EPS sample file for testing?
Post by: obetz on July 19, 2019, 01:31:20 PM
Yes, embedding large TIFF files seemed the straightforward way to generate huge eps.

I made two >100MB TIFF files and put them it in a Illustrator document together with some text and vector graphics, the exported eps is 340MB in size.

The standalone executable ExifTool 7.76 processed it in 12s. 11.55 took 9s (both "standard exiftool.exe" and the Strawberry based version).

Maybe the original posters from https://exiftool.org/forum/index.php/topic,4971 and https://exiftool.org/forum/index.php/topic,1415 did something special to create tiff files with changing newline characters.

It doesn't seem too be very important.

I was just curious about a test case for your observation that the PAR-packed ExifTool "seems constrained to about 200 MB of RAM" as you wrote in the 2013 thread.

The pp runtime invokes Perl somewhat different to "perl.exe", but I couldn't see how this would result in different menory limits.

Oliver