ExifTool Forum

ExifTool => Developers => Topic started by: SarahC on May 24, 2015, 02:22:34 AM

Title: Please help! Excel file/media cataloger - hangs when scanning lots of files.
Post by: SarahC on May 24, 2015, 02:22:34 AM

Hi!

I've written a totally free open source file cataloger which outputs the file list to Excel.
What makes it different is that it uses the awesome ExifTool to do a deep scan of the files, and provides much more information.

It's tailored for video, e-books, and audio, and the spreadsheet output is set up to be searchable, and filterable.

Perfect for an extensive media collection!

The program can be run in a Window, or via the command line/batch file - so it's easy to set up a schedule to output several spreadsheets for different folders, or file types.

All the details are here, along with the source: http://untamed.co.uk/filecatalogue/ (http://untamed.co.uk/filecatalogue/)

It works well, but there's one major sticking problem!

When it scans large folders (1,000+ files) the ExifTool program freezes.
I'm unable to discover the cause, it appears to be a memory issue, and only triggered by some files. In other words, when a large list is reduced to a small list, the file that would freeze the program no longer freezes it.

I use the excellent wrapper from brain2cpu https://exiftool.org/forum/index.php?topic=5262.0 (https://exiftool.org/forum/index.php?topic=5262.0), and looking through the code I can't see anything there that may be causing the issue.

This file in the source is called : ExifToolWrapper.vb

To try and mitigate the hanging, I added a destroy/recreate sequence that runs on the ExifTool process after X number of files. It doesn't work very well, on big runs it needs to be refreshed after only a couple of hundred file scans, which slows the scanning down considerably.


I know this is a big ask - but it's a very useful program for people with lots of media they want to keep track of.
I don't get any money for it, it's for everyone!

I really want to get a solidly working program out there, and I'm frustrated I've not been able to.

Thanks for your time!

Title: Re: Please help! Excel file/media cataloger - hangs when scanning lots of files.
Post by: Phil Harvey on May 24, 2015, 06:10:17 AM
It sounds to me as if it is a problem in the VB wrapper, and not ExifTool.  I recommend posting this problem in the thread with the VB wrapper and hope that brain2cpu is monitoring that thread.

- Phil
Title: Re: Please help! Excel file/media cataloger - hangs when scanning lots of files.
Post by: SarahC on May 27, 2015, 04:00:29 AM
Hi Phil!

I will, thank you!