Help modifying geotiff information

Started by salleman, March 04, 2020, 10:36:46 AM

Previous topic - Next topic
Print
Go Down Pages1 2 All
User actions

salleman

March 04, 2020, 10:36:46 AM
I've read through a few threads and tried copying the geotiff exif data from a known good file to one with an incorrect projection.

I used the following command:

exiftool -tagsfromfile SC_02_correctEPSG.tif  -GeoTiffDirectory -GeoTiffDoubleParams -GeoTiffAsciiParams SC_02.tif

that I found in a thread in this forum:

https://exiftool.org/forum/index.php?topic=10685.msg56716#msg56716

The problem is that exif happily reads the updated file and shows me exactly what I want to see... but if I open up SC_02.tif in a hex editor or GlobalMapper, it appears that the exif data is corrupted.

Here's the exif data from the original SC_02.tif:

ExifTool Version Number         : 11.90
File Name                       : SC_02.tif_original
Directory                       : .
File Size                       : 67 MB
File Modification Date/Time     : 2020:03:02 13:19:21-06:00
File Access Date/Time           : 2020:03:02 13:19:21-06:00
File Inode Change Date/Time     : 2020:03:04 07:31:13-06:00
File Permissions                : rwxrwxrwx
File Type                       : TIFF
File Type Extension             : tif
MIME Type                       : image/tiff
Exif Byte Order                 : Little-endian (Intel, II)
Image Width                     : 4190
Image Height                    : 4190
Bits Per Sample                 : 8 8 8 8
Compression                     : Uncompressed
Photometric Interpretation      : RGB
Strip Offsets                   : (Binary data 37042 bytes, use -b option to extract)
Orientation                     : Horizontal (normal)
Samples Per Pixel               : 4
Rows Per Strip                  : 1
Strip Byte Counts               : (Binary data 25139 bytes, use -b option to extract)
Planar Configuration            : Chunky
Extra Samples                   : Unassociated Alpha
Pixel Scale                     : 0.0128746620000136 0.0120559770000436 1
Model Tie Point                 : 0 0 0 531697.611622669 4269956.09045799 0
Geo Tiff Version                : 1.1.0
GT Model Type                   : Projected
GT Raster Type                  : Pixel Is Area
GT Citation                     : GCS_North_American_1983
Geographic Type                 : NAD83
Geog Angular Units              : Angular Degree
Geog Ellipsoid                  : GRS 1980
Geog Semi Major Axis            : 6378137
Geog Semi Minor Axis            : 6356752.31414036
Geog Inv Flattening             : 298.257222101
Projected CS Type               : NAD83 UTM zone 18N
PCS Citation                    : NAD_1983_UTM_Zone_18N
Proj Linear Units               : Linear Meter
Image Size                      : 4190x4190
Megapixels                      : 17.6


Here is the update exif info:

ExifTool Version Number         : 11.90
File Name                       : SC_02.tif
Directory                       : .
File Size                       : 67 MB
File Modification Date/Time     : 2020:03:04 09:19:40-06:00
File Access Date/Time           : 2020:03:04 09:19:40-06:00
File Inode Change Date/Time     : 2020:03:04 09:19:41-06:00
File Permissions                : rwxrwxrwx
File Type                       : TIFF
File Type Extension             : tif
MIME Type                       : image/tiff
Exif Byte Order                 : Little-endian (Intel, II)
Image Width                     : 4190
Image Height                    : 4190
Bits Per Sample                 : 8 8 8 8
Compression                     : Uncompressed
Photometric Interpretation      : RGB
Strip Offsets                   : (Binary data 37052 bytes, use -b option to extract)
Orientation                     : Horizontal (normal)
Samples Per Pixel               : 4
Rows Per Strip                  : 1
Strip Byte Counts               : (Binary data 25139 bytes, use -b option to extract)
Planar Configuration            : Chunky
Extra Samples                   : Unassociated Alpha
Pixel Scale                     : 0.0128746620000136 0.0120559770000436 1
Model Tie Point                 : 0 0 0 531697.611622669 4269956.09045799 0
Geo Tiff Version                : 1.1.0
GT Model Type                   : Projected
GT Raster Type                  : Pixel Is Area
GT Citation                     : GCS_NAD_1983_2011
Geographic Type                 : Unknown (6318)
Geog Angular Units              : Angular Degree
Geog Ellipsoid                  : GRS 1980
Geog Semi Major Axis            : 6378137
Geog Semi Minor Axis            : 6356752.31414036
Geog Inv Flattening             : 298.257222101
Projected CS Type               : Unknown (6347)
PCS Citation                    : NAD83_2011_UTM_zone_18N
Proj Linear Units               : Linear Meter
Image Size                      : 4190x4190
Megapixels                      : 17.6

I'm attaching pictures of before and after views of that file in a hex editor...



Phil Harvey

#1
March 04, 2020, 10:39:33 AM
Try looking at the exiftool -htmldump output in a web browser instead of using the hex editor:

exiftool -htmldump FILE > out.html

- Phil
...where DIR is the name of a directory/folder containing the images.  On Mac/Linux, use single quotes (') instead of double quotes (") around arguments containing a dollar sign ($).

salleman

#2
March 04, 2020, 10:48:23 AM
It looks fine in html... but GlobalMapper is not recognizing the projection data... Any idea why that might be? Also, the projection info went from the end of the file to near the beginning...

salleman

#3
March 04, 2020, 10:51:19 AM
Here's a diff between the old and new files:

< Directory                       : .
---
> Directory                       : test
5,7c5,7
< File Modification Date/Time     : 2020:03:02 13:21:06-06:00
< File Access Date/Time           : 2020:03:02 13:21:06-06:00
< File Inode Change Date/Time     : 2020:03:03 18:01:23-06:00
---
> File Modification Date/Time     : 2020:03:04 07:36:26-06:00
> File Access Date/Time           : 2020:03:04 07:36:26-06:00
> File Inode Change Date/Time     : 2020:03:04 07:36:41-06:00
18c18
< Strip Offsets                   : (Binary data 36400 bytes, use -b option to extract)
---
> Strip Offsets                   : (Binary data 36410 bytes, use -b option to extract)
30,31c30,31
< GT Citation                     : GCS_North_American_1983
< Geographic Type                 : NAD83
---
> GT Citation                     : GCS_NAD_1983_2011
> Geographic Type                 : Unknown (6318)
37,38c37,38
< Projected CS Type               : NAD83 UTM zone 18N
< PCS Citation                    : NAD_1983_UTM_Zone_18N
---
> Projected CS Type               : Unknown (6347)
> PCS Citation                    : NAD83_2011_UTM_zone_18N

Phil Harvey

#4
March 04, 2020, 10:54:02 AM
Could you email me SC_02_correctEPSG.tif so I can try this myself?  philharvey66 at gmail.com

- Phil
...where DIR is the name of a directory/folder containing the images.  On Mac/Linux, use single quotes (') instead of double quotes (") around arguments containing a dollar sign ($).

Phil Harvey

#6
March 04, 2020, 11:31:19 AM
Everything works fine when I use your command (and ExifTool 11.90) to copy the geotiff tags from your SC_02.tif.bak file:

Code Select
> exiftool tmp/* -geotiff:all
======== tmp/SC_02.tif
TEST 0 0
Geo Tiff Version                : 1.1.0
GT Model Type                   : Projected
GT Raster Type                  : Pixel Is Area
GT Citation                     : GCS_NAD_1983_2011
Geographic Type                 : Unknown (6318)
Geog Angular Units              : Angular Degree
Geog Ellipsoid                  : GRS 1980
Geog Semi Major Axis            : 6378137
Geog Semi Minor Axis            : 6356752.31414036
Geog Inv Flattening             : 298.257222101
Projected CS Type               : Unknown (6347)
PCS Citation                    : NAD83_2011_UTM_zone_18N
Proj Linear Units               : Linear Meter
======== tmp/SC_02.tif.bak
TEST 0 0
Geo Tiff Version                : 1.1.0
GT Model Type                   : Projected
GT Raster Type                  : Pixel Is Area
GT Citation                     : GCS_North_American_1983
Geographic Type                 : NAD83
Geog Angular Units              : Angular Degree
Geog Ellipsoid                  : GRS 1980
Geog Semi Major Axis            : 6378137
Geog Semi Minor Axis            : 6356752.31414036
Geog Inv Flattening             : 298.257222101
Projected CS Type               : NAD83 UTM zone 18N
PCS Citation                    : NAD_1983_UTM_Zone_18N
Proj Linear Units               : Linear Meter
======== tmp/SC_02_correctEPSG.tif
TEST 0 0
Geo Tiff Version                : 1.1.0
GT Model Type                   : Projected
GT Raster Type                  : Pixel Is Area
GT Citation                     : GCS_NAD_1983_2011
Geographic Type                 : Unknown (6318)
Geog Angular Units              : Angular Degree
Geog Ellipsoid                  : GRS 1980
Geog Semi Major Axis            : 6378137
Geog Semi Minor Axis            : 6356752.31414036
Geog Inv Flattening             : 298.257222101
Projected CS Type               : Unknown (6347)
PCS Citation                    : NAD83_2011_UTM_zone_18N
Proj Linear Units               : Linear Meter
    3 image files read

Code Select

> exiftool -tagsfromfile tmp/SC_02.tif.bak -GeoTiffDirectory -GeoTiffDoubleParams -GeoTiffAsciiParams tmp/SC_02.tif
    1 image files updated

Code Select

>exiftool tmp/* -geotiff:all
======== tmp/SC_02.tif
TEST 0 0
Geo Tiff Version                : 1.1.0
GT Model Type                   : Projected
GT Raster Type                  : Pixel Is Area
GT Citation                     : GCS_North_American_1983
Geographic Type                 : NAD83
Geog Angular Units              : Angular Degree
Geog Ellipsoid                  : GRS 1980
Geog Semi Major Axis            : 6378137
Geog Semi Minor Axis            : 6356752.31414036
Geog Inv Flattening             : 298.257222101
Projected CS Type               : NAD83 UTM zone 18N
PCS Citation                    : NAD_1983_UTM_Zone_18N
Proj Linear Units               : Linear Meter
======== tmp/SC_02.tif.bak
TEST 0 0
Geo Tiff Version                : 1.1.0
GT Model Type                   : Projected
GT Raster Type                  : Pixel Is Area
GT Citation                     : GCS_North_American_1983
Geographic Type                 : NAD83
Geog Angular Units              : Angular Degree
Geog Ellipsoid                  : GRS 1980
Geog Semi Major Axis            : 6378137
Geog Semi Minor Axis            : 6356752.31414036
Geog Inv Flattening             : 298.257222101
Projected CS Type               : NAD83 UTM zone 18N
PCS Citation                    : NAD_1983_UTM_Zone_18N
Proj Linear Units               : Linear Meter
======== tmp/SC_02.tif_original
TEST 0 0
Geo Tiff Version                : 1.1.0
GT Model Type                   : Projected
GT Raster Type                  : Pixel Is Area
GT Citation                     : GCS_NAD_1983_2011
Geographic Type                 : Unknown (6318)
Geog Angular Units              : Angular Degree
Geog Ellipsoid                  : GRS 1980
Geog Semi Major Axis            : 6378137
Geog Semi Minor Axis            : 6356752.31414036
Geog Inv Flattening             : 298.257222101
Projected CS Type               : Unknown (6347)
PCS Citation                    : NAD83_2011_UTM_zone_18N
Proj Linear Units               : Linear Meter
======== tmp/SC_02_correctEPSG.tif
TEST 0 0
Geo Tiff Version                : 1.1.0
GT Model Type                   : Projected
GT Raster Type                  : Pixel Is Area
GT Citation                     : GCS_NAD_1983_2011
Geographic Type                 : Unknown (6318)
Geog Angular Units              : Angular Degree
Geog Ellipsoid                  : GRS 1980
Geog Semi Major Axis            : 6378137
Geog Semi Minor Axis            : 6356752.31414036
Geog Inv Flattening             : 298.257222101
Projected CS Type               : Unknown (6347)
PCS Citation                    : NAD83_2011_UTM_zone_18N
Proj Linear Units               : Linear Meter
    4 image files read

- Phil
...where DIR is the name of a directory/folder containing the images.  On Mac/Linux, use single quotes (') instead of double quotes (") around arguments containing a dollar sign ($).

salleman

#7
March 04, 2020, 11:58:58 AM
Right, it looks fine in the exif output. I'm not sure what's happening, but GlobalMapper can open the SC_02_correctEPSG.tiff and knows where in the world that data is, but when it opens SC_02.tiff after copying the metadata to it from SC_02_correctEPSG.tiff, it no longer can identify where the data should be. Is it possibly because there's a size mismatch between the two projection strings? Is that perhaps causing some sort of corruption?

Phil Harvey

#8
March 04, 2020, 12:19:44 PM
I don't know why GlobalMapper has problems with the ExifTool-copied file, but as far as I can tell
GeoTiff information looks good.  However, there are a few values in SC_02_correctEPSG.tiff that aren't valid according to the GeoTiff specification that ExifTool follows (the Unknown values).

- Phil
...where DIR is the name of a directory/folder containing the images.  On Mac/Linux, use single quotes (') instead of double quotes (") around arguments containing a dollar sign ($).

salleman

#9
March 04, 2020, 12:54:24 PM
For the past few minutes, I've been trying to use listgeo and geotifcp... I'm not having any luck copying the data that I need, but here's the output of listgeo from SC_02.tif and SC_02_correctEPSG.tif immediately after running:
exiftool -tagsfromfile SC_02_correctEPSG.tif  -GeoTiffDirectory -GeoTiffDoubleParams -GeoTiffAsciiParams SC_020.tif

PS G:\alleman\SSS_Geotif> G:\alleman\SSS_Geotif\listgeo.exe .\SC_02.tif
.\SC_02.tif: Warning, wrong data type 7 for "GeoKeyDirectory"; tag ignored.
.\SC_02.tif: Warning, wrong data type 7 for "GeoDoubleParams"; tag ignored.
Geotiff_Information:
   Version: 1
   Key_Revision: 1.0
   Tagged_Information:
      ModelTiepointTag (2,3):
         0                0                0
         531697.612       4269956.09       0
      ModelPixelScaleTag (1,3):
         0.012874662      0.012055977      1
      End_Of_Tags.
   Keyed_Information:
      End_Of_Keys.
   End_Of_Geotiff.


Corner Coordinates:
Upper Left    ( 531697.612,4269956.090)
Lower Left    ( 531697.612,4269905.576)
Upper Right   ( 531751.556,4269956.090)
Lower Right   ( 531751.556,4269905.576)
Center        ( 531724.584,4269930.833)

-----------------------
PS G:\alleman\SSS_Geotif> G:\alleman\SSS_Geotif\listgeo.exe .\SC_02_correctEPSG.tif
Geotiff_Information:
   Version: 1
   Key_Revision: 1.0
   Tagged_Information:
      ModelTiepointTag (2,3):
         0                0                0
         531697.612       4269956.09       0
      ModelPixelScaleTag (1,3):
         0.012055977      0.012055977      1
      End_Of_Tags.
   Keyed_Information:
      GTModelTypeGeoKey (Short,1): ModelTypeProjected
      GTRasterTypeGeoKey (Short,1): RasterPixelIsArea
      GTCitationGeoKey (Ascii,18): "GCS_NAD_1983_2011"
      GeographicTypeGeoKey (Short,1): Unknown-6318
      GeogAngularUnitsGeoKey (Short,1): Angular_Degree
      GeogEllipsoidGeoKey (Short,1): Ellipse_GRS_1980
      GeogSemiMajorAxisGeoKey (Double,1): 6378137
      GeogSemiMinorAxisGeoKey (Double,1): 6356752.31
      GeogInvFlatteningGeoKey (Double,1): 298.257222
      ProjectedCSTypeGeoKey (Short,1): Unknown-6347
      PCSCitationGeoKey (Ascii,24): "NAD83_2011_UTM_zone_18N"
      ProjLinearUnitsGeoKey (Short,1): Linear_Meter
      End_Of_Keys.
   End_Of_Geotiff.

PCS = 6347 (name unknown)
GCS: 6318/(unknown)
Ellipsoid: 7019/GRS 1980 (6378137.00,6356752.31)
Projection Linear Units: 9001/metre (1.000000m)

Corner Coordinates:
Upper Left    ( 531697.612,4269956.090)
Lower Left    ( 531697.612,4269905.576)
Upper Right   ( 531751.562,4269956.090)
Lower Right   ( 531751.562,4269905.576)
Center        ( 531724.587,4269930.833)

salleman

#10
March 04, 2020, 12:57:25 PM
I also just noticed that it's copying the coordinates of the four corners... That is a problem. Essentially, I just need to get the correct projection from SC_02_correctEPSG.tif and put it into SC_02.tif without changing anything else.

Phil Harvey

#11
March 04, 2020, 01:06:20 PM
OK.  There is another difference that your output revealed:

Your SC_02.tif_original has the wrong EXIF format type for these tags (undef instead of double, etc):

Code Select
> exiftool SC_02.tif_original -validate -warning
Validate                        : 5 Warnings
Warning                         : Non-standard format (undef) for IFD0 0x87af GeoTiffDirectory
Warning                         : Non-standard format (undef) for IFD0 0x87b0 GeoTiffDoubleParams
Warning                         : Missing required TIFF IFD0 tag 0x011a XResolution
Warning                         : Missing required TIFF IFD0 tag 0x011b YResolution
Warning                         : Missing required TIFF IFD0 tag 0x0128 ResolutionUnit

When you use ExifTool to copy to this file, the format isn't changed, so it remains incorrect.  But if you first delete the geotiff tags before copying them, like this:

exiftool -GeoTiffDirectory= -GeoTiffDoubleParams= -GeoTiffAsciiParams= SC_02.tif

the formats will be set correctly when the tags are subsequently copied using ExifTool.

- Phil
...where DIR is the name of a directory/folder containing the images.  On Mac/Linux, use single quotes (') instead of double quotes (") around arguments containing a dollar sign ($).

salleman

#12
March 04, 2020, 01:16:14 PM
Great! Is there a commandline argument to tell exiftool to not copy the corner coordinates? Or to extract those coordinates and put them back in after the copy?

Phil Harvey

#13
March 04, 2020, 01:20:22 PM
Ah.  Those are determined by the PixelScale, ModelTiePoint and ModelTransform tags, which you weren't copying.

- Phil
...where DIR is the name of a directory/folder containing the images.  On Mac/Linux, use single quotes (') instead of double quotes (") around arguments containing a dollar sign ($).

salleman

#14
March 04, 2020, 01:43:04 PM
Good, that's great!

Print
Go Up Pages1 2 All
User actions