Copy data from JPG to RAW?

[neil40]

Hi,

I'm after a bit of guidance please.
My camera (Fujifilm Finepix S200EXR) is set to store JPG and RAW (RAF files)
It has no GPS, so following a recent trip to the USA, I found that I could map my pictures (I chose to do the JPG's) in Geosetter, which of course uses exiftool under the bonnet.
As there are a lot of pictures, it would be quite a task to go through all the RAW files in this way, so I started to look at exiftool as a method to do this.

I wonder if others have done this, by reading the location data from the (modified) JPG file then writing it to the RAW file
I'd be most grateful for some tips on doing this if it's possible.

Many thanks
Neil

[Phil Harvey]

Hi Neil,

The command to copy GPS from JPG to RAF would be:

exiftool -tagsfromfile %d%f.JPG -gps:all -ext raf DIR

But I don't know how much support there will be out there for reading GPS from RAF files.

- Phil

[neil40]

Brilliant, thanks.

In the interim I was searching through posts and was 'almost' at this answer, apart from the last part, I had seen the -tagsformfile and -gps:all mentioned.

Now to test.

Thanks again.
Neil

[neil40]

Hmm. What am I doing wrong?!!

I opened a Command prompt in the folder where the JPG files are. The RAF files are in a sub-directory called RAF Files

I issued the command

Code Select Expand

exiftool -tagsfromfile %d%f.jpg -gps:all -ext raf "E:\New England 2\2016-10-24\RAF Files"

and each file gives the error:
Warning: Error opening file - E:/New England 2/2016-10-24/RAF Files/DSCF1509.jpg (IE one error for each JPG file)

[Phil Harvey]

Does the JPG file exist?  If you are on a case-sensitive filesystem you may need a capital "JPG" in your command.

- Phil

Edit: Oh, right.  Backslashes.  You're on Windows, so probably not case sensitive.

[neil40]

Does the JPG file exist?  If you are on a case-sensitive filesystem you may need a capital "JPG" in your command.

- Phil

Edit: Oh, right.  Backslashes.  You're on Windows, so probably not case sensitive.

Just tried that, same error! Yes, the files exist, so JPG files in the 2016-10-24 folder and RAF files in 2016-10-24\RAF files folder. Executing the exiftool command from the JPG folder
I wonder, they are on an external hard drive, so I wonder if there is a write permission problem.

[Phil Harvey]

My command assumed they were in the same folder.  Use this command if the JPG's are one level up:

exiftool -tagsfromfile %-:1d%f.jpg -gps:all -ext raf "E:\New England 2\2016-10-24\RAF Files"

or if you had already "cd"-d to the JPG directory, then this would work:

exiftool -tagsfromfile %f.jpg -gps:all -ext raf "RAF Files"

- Phil

[neil40]

My command assumed they were in the same folder.  Use this command if the JPG's are one level up:

exiftool -tagsfromfile %-:1d%f.jpg -gps:all -ext raf "E:\New England 2\2016-10-24\RAF Files"

or if you had already "cd"-d to the JPG directory, then this would work:

exiftool -tagsfromfile %f.jpg -gps:all -ext raf "RAF Files"

- Phil

Bingo! Thanks so much

[neil40]

One further question if I may.

I used Geosetter to get Altitude and 'Location' using it's 'Get From Web' buttons for example, on a location in Boston Decimal 42.35738200, -71.06080400 it returns me:
Country Code USA
Country United States
State/Province Massachusetts
City Boston
Sublocation Boston

Are these written to the JPG file too, or are they unique to Geosetter perhaps?
IE could I also use exiftool arguments to pull these to the RAF file too?

[Phil Harvey]

Use this command to see all metadata available in the file:

exiftool -a -G1 -s FILE

You can use ExifTool to copy any of this.

- Phil

[neil40]

Use this command to see all metadata available in the file:

exiftool -a -G1 -s FILE

You can use ExifTool to copy any of this.

- Phil

Ah, brilliant, yes, I see it wrote it to sections in [IPTC] and [XMP].
I need to get reading your website to find the correct arguments now.

[Phil Harvey]

It's easy.  Just add all of the tags you want to copy, like this:

exiftool -tagsfromfile %f.jpg -gps:all -TAG1 -TAG2 -TAG3 ... -ext raf "RAF Files"

- Phil

[neil40]

 

[neil40]

It's easy.  Just add all of the tags you want to copy, like this:

exiftool -tagsfromfile %f.jpg -gps:all -TAG1 -TAG2 -TAG3 ... -ext raf "RAF Files"

- Phil

Phil, trying to find the right options to use to achieve what I want as my previous reply and found there is a -all:all option for -tagsfromfile

Is this a sensible option to use to copy data from JPG to RAF file, or could there be some data that isn't right to copy?

Thanks
Neil

edit - mmm, it seems that this might not be a great idea as it crashed geosetter on a test image

[Phil Harvey]

NO.  Don't do that!

Be careful what you copy to a RAW file.  It is not advisable to change any of the maker notes because they may contain information necessary for proper rendering of the image (WhiteBalance for example).

Something like -xmp:all and -iptc:all would be more reasonable.

- Phil

[neil40]

NO.  Don't do that!

Be careful what you copy to a RAW file.  It is not advisable to change any of the maker notes because they may contain information necessary for proper rendering of the image (WhiteBalance for example).

Something like -xmp:all and -iptc:all would be more reasonable.

- Phil

OK, so I tried

Code Select Expand

exiftool -tagsfromfile %-:1d%f.jpg -gps:all -xmp:all -iptc:all -ext raf "E:\New England 2\2016-10-24\RAF Files" and it only wrote the GPS data to the RAF files. Do I need to do 3 separate passes?

I'm also curious at the datestamps given to the modified RAF files, which all seem to be 26/1/2017 22:00 when I ran this at about 10:00 on 27/1/2017!
Not a huge issue, but surprised.

[Edit] Curious, I just ran the exiftool -a -G1 -s FILE command on a single file I ran the exiftool -tagsfromfile %-:1d%f.jpg -gps:all -xmp:all -iptc:all -ext raf command on and find that this reports the XMP and IPTC tags are there.
Perhaps it's a problem with Geosetter as it still doesn't show them!

[Phil Harvey]

OK, so I tried

Code Select Expand

exiftool -tagsfromfile %-:1d%f.jpg -gps:all -xmp:all -iptc:all -ext raf "E:\New England 2\2016-10-24\RAF Files" and it only wrote the GPS data to the RAF files. Do I need to do 3 separate passes?

No.  It should do it in one pass.

[Edit] Curious, I just ran the exiftool -a -G1 -s FILE command on a single file I ran the exiftool -tagsfromfile %-:1d%f.jpg -gps:all -xmp:all -iptc:all -ext raf command on and find that this reports the XMP and IPTC tags are there.
Perhaps it's a problem with Geosetter as it still doesn't show them!

Perhaps.  I think Geosetter uses its own routines for reading.

- Phil

[StarGeek]

Perhaps it's a problem with Geosetter as it still doesn't show them!

Hit F5 or Images menu -> Refresh and it should show the new data.

[neil40]

Perhaps it's a problem with Geosetter as it still doesn't show them!

Hit F5 or Images menu -> Refresh and it should show the new data.

It's odd, I've done a refresh but although the Geosetter Info panel shows identical info for JPG and RAF files, on the Thumbnail view it doesn't show the Location in the RAF files
Attached some screenshots, I know it's not really 'topic' though.

[neil40]

Interesting to note that in Geosetter, if I 'Get from Web' the locations, it fills them in as per the JPG, but then creates a .xmp file when I save the changes.
Copying the data from JPG to RAF using exiftool in a command shell, doesn't create such a file (xmp)

What is the difference in what's happening in each process?
Thanks

[StarGeek]

Check the File menu->Settings->File Options tag

I think the default is to create xmp files for RAF.

Geosetter has a lot of options on how to save the data and does a lot of processing of the locations and time stamps to get everything correct.

To see what the exact command Geosetter is using, go to Images menu->Show Save Report.

[neil40]

Check the File menu->Settings->File Options tag

I think the default is to create xmp files for RAF.

Geosetter has a lot of options on how to save the data and does a lot of processing of the locations and time stamps to get everything correct.

To see what the exact command Geosetter is using, go to Images menu->Show Save Report.

Thanks for this. As I am using the command

Code Select Expand

exiftool -tagsfromfile %-:1d%f.jpg -gps:all -xmp:all -iptc:all -ext raf "E:\New England 2\2016-10-24\RAF Files" to copy data from the JPG to the RAF files, can I include an option to write a xmp file for each file, such that the information is then visible in Geosetter?

Thanks again

[Phil Harvey]

Hi Neil,

Assuming you want to write the XMP file to the same directory as the RAF image, this will do it:

Code Select Expand

exiftool -tagsfromfile %-:1d%f.jpg -srcfile %d%f.xmp -xmp:all -ext raf "E:\New England 2\2016-10-24\RAF Files"

(yes, ExifTool can do just about anything)

- Phil

[neil40]

Hi Neil,

Assuming you want to write the XMP file to the same directory as the RAF image, this will do it:

Code Select Expand

exiftool -tagsfromfile %-:1d%f.jpg -srcfile %d%f.xmp -xmp:all -ext raf "E:\New England 2\2016-10-24\RAF Files"

(yes, ExifTool can do just about anything)

- Phil

Phil,

Fabulous, that's perfect. I now see the RAF file location data in Geosetter as per the JPG versions.
Indeed, exiftool can do most anything!

Thanks once again.
Neil

[msandersen]

Thanks, this is just what I needed.
In my use case, I used a Geotagging app on my phone called Geotag Photos 2 while out taking photos, it displays the time with seconds on the start screen which I take a photo of with my camera for reference, then start my log. After I'm done, it uploads the log, and later on my computer the Desktop version downloads the log and tags my photos. But before I do, I import with Photo Mechanic, apply a template and add keywords, and adjust the CreateDate time of all the photos based on my reference photo with the time stamp, so the GPS log will sync correctly.
Now, while all this works as it should and looks fine in Photo Mechanic (showing jpg and raf files in a unified dialog), I noticed a couple of things while looking at the files with Exiftool. I shoot both jpg and raf files, and using Photo Mechanic to change metadata, only the jpg was changed, the raf file was unchanged while all the added metadata and the changed CreateDate was written to the accompanying xmp file. But in the jpg file, only xmp:CreateDate was changed, exif:CreateDate was not. Which might not be a problem as long as all apps read the xmp value; in this case, not so important as the time was only out by a minute and a bit, I just needed to sync the log.
But I also found malformed GPS data in some XMP and Raf files (indicating it was shot in the middle of the ocean at 0 deg and 11m underwater for example), not sure if that was from the Geotag Photos app. The Jpgs were fine.
For the sake of archiving and retaining all metadata in the raf file even if separated from the xmp and jpgs which are superseded by processed raf files anyway, I wanted to write the jpg metadata to the raf files.
Thankfully, I found this thread which gave me the answer.

The command I've gone with is

Code Select Expand

exiftool -tagsfromfile %d%f.jpg -gps:all -xmp:all -iptc:all --iptc:Category '-xmp:CreateDate>exif:CreateDate' -overwrite_original -ext raf /directory/path
where the jpg and raf files are in the same directory.

I'm gonna have to examine some of my older files for similar issues where I might have used the Geotagging app, and whether it is different with my Canon cr2 files.
Which leaves one question: For some of the folders, I have camera jpgs and rafs in 2 different folders, and was wondering about the syntax.
/raf
/jpg
What would be the syntax for reading from the jpg directory and writing to the raf directory?

[StarGeek]

Which leaves one question: For some of the folders, I have camera jpgs and rafs in 2 different folders, and was wondering about the syntax.
/raf
/jpg
What would be the syntax for reading from the jpg directory and writing to the raf directory?

You would need to change the %d in
-tagsfromfile %d%f.jpg
to something to represent the path to the jpgs.  It can be a relative path to the one being processed, an absolute path to the jpgs, or you can use the advanced features of the %d variable to get the right path (see the -w (textout) option for details).

[msandersen]

Right, so can you simply use

Code Select Expand

-tagsfromfile ../jpg/%f.jpgwhere your directory is /directory/Raf/ and you want to copy from the jgs in /directory/jpg/ ?

[StarGeek]

Yes

[msandersen]

Thanks, but unfortunately that produces an error:

Warning: Error opening file - ../jpg/Image0001-[2020-07-01].jpg

Edit:
I managed to make it work with

Code Select Expand

-tagsfromfile %-:1d/jpg/%f.jpg
Still don't know why the other way doesn't work, though I'm glad this way works.

[StarGeek]

Hmmm... not sure why it didn't work for you, works here.  But at least you got it working.

Code Select Expand

Y:\!temp\cccc\B>exiftool -description ../A .
======== ../A/06-07-_2020_19-04-02.jpg
Description                     : Test desc
======== ./06-07-_2020_19-04-02.jpg
    2 directories scanned
    2 image files read

Y:\!temp\cccc\B>exiftool -P -overwrite_original -TagsFromFile ../A/%f.%e -description .
    1 directories scanned
    1 image files updated

Y:\!temp\cccc\B>exiftool -description ../A .
======== ../A/06-07-_2020_19-04-02.jpg
Description                     : Test desc
======== ./06-07-_2020_19-04-02.jpg
Description                     : Test desc
    2 directories scanned
    2 image files read