ExifTool Forum

ExifTool => Bug Reports / Feature Requests => Topic started by: henrySz on December 28, 2018, 12:47:38 AM

Title: is there a limit to size of -csv output file
Post by: henrySz on December 28, 2018, 12:47:38 AM
Hello, I was trying to make a database of the metadata of my photos using the line command:
exiftool -csv -r Z:\MYPICT~1 > outZ.csv
However, exiftool (version 9.8.8 ) stopped working and asked to be closed. This seems to occur when the size of the file reached 2,016,052 Kb as shown in Windows Task Manager. This occurred twice. Is there a 2 Gb size limit that exiftool can handle? I run it from a DOS window in Win 7. With many thanks,
henry
Title: Re: is there a limit to size of -csv output file
Post by: Phil Harvey on December 28, 2018, 07:43:41 AM
Hi Henry,

From the -csv option documentation:

            Note that this option is fundamentally different than all other
            output format options because it requires information from all
            input files to be buffered in memory before the output is written.
            This may result in excessive memory usage when processing a very
            large number of files with a single command.  [...]

This may be your problem.  I suggest using -json or -xmlOutput formatting instead if you are dealing with a large number of files.

- Phil
Title: Re: is there a limit to size of -csv output file
Post by: henrySz on December 28, 2018, 09:36:48 AM
Many thanks for your quick response, Phil! Much appreciated and best wishes for a Happy New Year!
henry