Hi
Using GeoSetter and when saving a LOT of photos, it takes forever (5min/photo). But when I save only one or two images - it saves in seconds. Why? In Geosetter help it says it is because of ExifTool - found something about Pearl limitations. Earlier, some months ago, usually it saves quicker.
Beyond that I am very happy with what the ExifTool do for me!
And sometimes it says ..."hourly limit of 2000 credits" ...that stops the location procession.. even if I have geotagged under 100 photos during an hour.
Sincerly Per
It seems that the ActivePerl memory handling isn't very good, so ExifTool for windows may slow down when processing large images, or maybe lots of images containing lots of metadata. This problem doesn't occur on other systems.
However, 5min/photo is extreme. I have never seen something that slow.
How much RAM does your system have? What version of exiftool are you using? How big are the images, and what format are they? If I could reproduce this problem maybe I could figure out what is going on.
- Phil
Thanks, yes it took the whole night for 100 photo or something, I think it says 250 s each image.
I use Canon raw files from 5DII. Maybe I should convert to dng? I have been using both before. Do not remember if that makes difference.
i7 processor, 12Gb RAM, Vista
Everything updated to the latest version, even ExifTools (yesterday).
And ...the hourly limit of 2000 credits... comes up after geocoded only 3 photos now, so I can not test any more.
The problem was not there a few months ago.
Sincerely Per
Strange.... now it save fast again only 1 s per photo! Did you do anything?.. but still can not use the Geonames service Per
My guess is that the geonames service is causing the slowdown. Either that, or the geonames service is being called hundreds of times for each image, which would explain the hourly limit problem.
But exiftool doesn't access the geonames service, so if this the problem it is not exiftool related.
- Phil
Hi again
Now I think i got it... it is slow only when it have to save DNG format - When it is in Sony, Pentax or Canon format it is quick - aprox 1 sek each image, but DNG takes somewhat 100 times longer - at least a minute per image.
Per
Hi Per,
I just tried on my (rather slow) Mac system here, and writing 35 DNG images (average size 16.7 MB per image) takes 36 seconds. That's very close to 1 second per image.
How big are your DNG images, how were they created, and what camera did the orginal raw images come from? I would like to reproduce your problem if I can.
- Phil
Yes strange.. I think I have used DNG both from Sony (conv from .ARW) , Pentax (.PEF) and Canon (.CR2). All SLR cameras. Converted in Lightroom 3.2. But it is quick if you save 1 or even 10 images. Even if 10 images takes more than 10 times longer than one photo. Not a big problem for me.. because now I convert to dng after I have geocoded the photos.
Per
Hi Phil
I have conducted a little test here:
Used 7 jpgs to geotag through Geosetter when exifitool 8.50 was installed. It took roughly 90 seconds to complete (writing the geo info back into the files) which means about 13secs per shot. Then I installed exiftool 8.49 and repeated the test and it was less than a second per shot!
As you know I have had trouble with Norton AV when istalling 8.50 and got it to work only by putting exiftools on the NAV exclusion list. It works now, but still there seem to be problems with the NAV because of the the checking process (my guess).
For the time being I will revert back to 8.49. Any other ideas or things that I could test for you?
Alfred
Hi Alfred,
Interesting, but very unfortunate that NAV is causing such a problem. The only thing I can think of is to try 8.51 when it is released and keep my fingers crossed that this was an isolated incident.
- Phil
Hello again.
The same problem again but now on .CR2 files from Canon 5DII. Have not used GeoSetter more than a two times last month. It takes more than a night to save 300 photos. Before the problem only occured on DNG files but now even CR2. When I save only one or up to 4 or maybe 5 files it take only seconds. It is only when I saving many it takes several minutes (!) each photo. And the computer have to work quite hard (the fan goes fast)
Use Dell Studio XPS 435MT i7 920, 12Gb
Is it some flushing/swapping problem processing many photos? I am not so familiar with programming.
Updated with last Geosetter and ExifTool. And the geotagging moment is quick. Only saving is sloooow.
Noticed there are a Geosetter beta. Will try that tomorrow.
Per
There should be no problem processing any number of photos.
Do you have Norton Antivirus installed? What happens if you disable it?
For some reason, NAV didn't like ExifTool 8.50, and I'm wondering if this is related to the slow-down.
- Phil
Hi,
just as I see this thread some non precise input from myself:
I just tagged 2.000+ DNGs. Using the normal built in features of Geotagger (geotagging itself and metadata you can config in Geosetter) was reasonably "fast" - obviously the harddisk hat something to do on the 50 GB of data.
For the first time ever I tried using the post processing option in Geosetter to do some extra metadatawrangling and then it also came to a grinding halt, I had to kill the process. The disk access was wild but progress scary slow.
Running the same commands via exiftoolGUI was normal fast then.
I use no NAV and run it on i7/8GB Win 7 64bit.
When I have some more time I'll run a test.
I suspect the extra processing options in Geosetter are extra slow. Maybe it's about how exiftool is invoked there.
By the way the geonaming thing should be easy to explain: all users share the same default user from default if they don't create one of their own. If somebody else just tagged 1.999 pictures within the given time then a second user will run into to limit.
Hi,
I don't have GeoSetter installed right now... I am just curious:
QuoteFor the first time ever I tried using the post processing option in Geosetter to do some extra metadatawrangling...
...I suspect the extra processing options in Geosetter...
-what are this "extra processing" options for?
Bogdan
Quote from: BogdanH on June 19, 2011, 02:59:35 AM
-what are this "extra processing" options for?
... exactly what I was going to ask. Some details about the processing options would be useful.
- Phil
Hi,
first comment : I am not able to replicate the "slowness" now. I think I'll try some more later on.
First to your question: Usually I use Geosetter just in "the GUI way" meaning that I only use it to change metadata whichcan be done by its GUI functionality. Just last week I stumbled upon the feature in the menu under "file / settings / exiftool", where the user can add "normal" exiftool commands in the typical exiftool syntax. I wasn't aware of this before and thought I might help to do everything in one go in Geosetter since I now knwo the comands I need.
I just did a test run - as I said with no speical result, but here it is:
Test Setup:
Intel core i//840, 8 GB RAM, Windows 7 64bit Ultimate, Harddrive defragmented Samsung HD103UJ (1 TB)
Using 50 DNG-picture files created by Pentax K-5, total file size 1,04 GB
Geosetter:
Initial read to display in Geosetter GUI: 3 Seconds.
What do I do?
1. Assign star marks evaluations to all
2. apply preconfigured set of metadata via GUI-button (Template contains copyright. artitst, contact, author, name).
3. geotagging against .gpx track file (size 18 MB, 81.000 trackpoints, 53 tracks) including assignment of names via internet service
Tagging (changes not yet saved to files): 2 Seconds.
Run 1:
only the changes applicable from Geosetter-GUI as above:
Saving changes to disk: 18 Seconds.
Run 2:
in addition to the abovementioned Geosetter-GUI-based changes now I add some custom exiftool command via "file / settings / exiftool".
Now using "extra exiftool-commands AFTER Geosetter-command":
-exif:LensModel<makernotes:LensType
-XMP:Lens<makernotes:LensType
-exif:LensInfo<LensID
-exif:LensMake<LensManufacturer
-exif:FocalLength<copy2:FocalLength
-exif:FocalLengthIn35mmFormat<Calc35mm
To be able to do this the config-file of exiftool in the Geosetter directories had to be extended to look like this (the first two parts were already there provided by Geosetter, I just added two combined tags:
# exiftool config file
%Image::ExifTool::UserDefined = (
'Image::ExifTool::XMP::Main' => {
geosetter => {
SubDirectory => {
TagTable => 'Image::ExifTool::UserDefined::geosetter',
},
},
},
);
%Image::ExifTool::UserDefined::geosetter = (
GROUPS => { 0 => 'XMP', 1 => 'XMP-geosetter', 2 => 'Other' },
# (use whatever URI you want in the next line)
NAMESPACE => { 'geosetter' => 'http://ns.geosetter.com/1.0/' },
WRITABLE => 'string',
ForeignKeys => {
Name => 'ForeignKeys', # (specified only to get proper capitalization)
Writable => 'string',
List => 'Bag',
},
);
%Image::ExifTool::UserDefined = (
'Image::ExifTool::Composite' => {
Calc35mm => {
Require => 'copy2:FocalLength',
ValueConv => '$val * 1.5'},
LensManufacturer => {
Require => 'LensID',
ValueConv => '$prt[0] =~ /(pentax|tamron|sigma)/i ? $1 : undef',},
},
);
1; #end
Saving to disk: 18 Seconds.
I dont know why it took so long last week. I think I'll try again with a big amount of files later.
PS:
For now I enjoy the life of a happy windows user. Me fool dared to think it was possible to install a second windows on a separate drive, since I own a old Vista license and needed some non virtualised test environment. Hahaha.
I had (not have) a truecrypted 1 TB drive in the box (having had burglars in the house last year made me rethink some things about privacy).
Guess what I found out the hard way: Vista installer (without asking anything) seems to buffer some of its install data (>130 MB) on the first "empty" drive it finds (doing a little formatting up front) even though the user explicitly told it the install destination for windows to be something else.
Ever tryed out what is left of a encrypted drive after NTFS formatting and writing over the first 130 MB? I can now tell you : not much.
Thanks god I do have a backup strategy and can recover from a week ago, but re-encrypting 1 TB plus copying back 1 TB plus loosing some work (of the week), is not really what I love. That is what is stopping me from doing more tests for now. Drives are busy...
Sorry for this offtopic, but I am in a bad mood for windows. >:(
Thanks for running these tests, and for all of the details. Let me know if you can figure out what was causing the slow-down.
Sorry to hear about your Windows problems. Wow. That's just crazy.
- Phil
Hi again
I have not Norton Utilities, Use Avira AntiVir.
And yes, still the same problem, slow saving and using Geosetter beta. Each photo takes minutes to save when saving many photos. No other programs open. I tried to enlose a jpeg, screendump showing what processes that are running.. but it did not accept the file.
per