How to convert MP4 files to Canon encoding and file structure?

[NUES VXUFV]

First of all, thank you Phil for the wonderful work!

For a long time I have been trying to watch external video clips that I insert from my computer through my camera. It is very important to me that my camera be a tool for watching videos instead of the computer, but despite all my efforts, the camera does not recognize the file, even though I converted the files to the same format as the camera, and also gave the file the same name. I was successful with photos, but not with movies. Recently I was told that the problem may be because Canon has its own unique file structure, and I will explain a little about file structure to make it clear:
File structure:

header

Many file types have an opening that is an identifier where the file begins
For example, jpg begins (HEX) with.. .. FF D8

Footer

Some file types have a bracket that is an identifier where the file ends
In the above example (jpg) ends (HEX) with FF D9

There are other identifiers in file types such as CS, size, data location, and more (hereinafter Metadata or MD$ for short) that ACM

And Data of course

Unlike The vast majority of existing files have a file structure of:

Header
MD$
Data
(MD$
Data
and so on)
Footer
Canon videos have a different structure (and vice versa) first the Data and then the MD$

After this explanation, it is clear that the camera will not show me the external MP4 files because it is a different file structure.

Now I ask if I can use your tool to change the external file structure to perfectly match the camera?

This is a Canon SX720 HS camera

And thank you again for everything!!!
A million likes!

[Phil Harvey]

The actual structure of the file probably doesn't matter as long as it conforms to the MP4 specification.  The problem will be differences in the encoding and/or available metadata.  ExifTool can only help with part of the metadata, but it can't be used to change the encoding.  Try using this command to compare a file that works in the camera with one that doesn't:

exiftool FILE1.mp4 -diff FILE2.mp4

- Phil

[wywh]

watch external video clips that I insert from my computer through my camera

Did I understand correctly that you transfer the images and movies to the camera's memory card and view them with the camera's software?

If yes, do the file names and folder structure follow DCIM directory and file structure spec like below. Otherwise the camera might ignore those files.

DCIM
    100MEDIA
        DJI_0628.DNG
        DJI_0629.DNG
        DJI_0630.MP4
        DJI_0631.MP4
        etc

- Matti

[NUES VXUFV]

Did I understand correctly that you transfer the images and movies to the camera's memory card and view them with the camera's software?

I already know that, thanks, and as I already mentioned, I was able to insert unlimited photos. As of today, I am viewing hundreds of external photos that came from the computer inside the camera, and as you wrote, I change the name and location to be in the same big place as the other photos, and it works great! Only in the video did I repeat all these steps and it didn't help even though the name was the same as the rest of the video.

The actual structure of the file probably doesn't matter as long as it conforms to the MP4 specification.

Thank you for your answer, if I may ask, I would love to know what your source is for the answer that the Canon camera does not specifically need the Canon file structure?
Because I asked an expert in file recovery to help me, and he firmly claimed that he had many years of experience with Canon files, and their structure is different as I quoted his example and this is his language:
Unlike the vast majority of existing files whose file structure is:

Header
MD$
Data
(MD$
Data
and God forbid)
Footer
Canon videos have a different (and reversed) structure first the Data and then the MD$

The problem will be differences in the encoding and/or available metadata

Do you mean elements like: frame rate, bit rate, resolution, and other such elements? If so, then it's an easy job to change the encoding in programs like Format Factory, right?

Try using this command to compare a file that

Sorry, I'm a beginner, it's not clear to me how to run the command, do you intend to run it in the command line terminal, or in the ExifTool software?

[Phil Harvey]

The actual structure of the file probably doesn't matter as long as it conforms to the MP4 specification.

Thank you for your answer, if I may ask, I would love to know what your source is for the answer that the Canon camera does not specifically need the Canon file structure?

I just know that from a software point of view it makes sense to use standard MP4 reading code.

Thinking about this now, the existence of the Canon ThumbnailImage in the MP4 is certainly crucial, and I don't know anything that will create this for you.

Sorry, I'm a beginner, it's not clear to me how to run the command, do you intend to run it in the command line terminal, or in the ExifTool software?

You run the command in a terminal after installing ExifTool.

- Phil

[NUES VXUFV]

The actual structure of the file probably doesn't matter as long as it conforms to the MP4 specification.

Thank you for your answer, if I may ask, I would love to know what your source is for the answer that the Canon camera does not specifically need the Canon file structure?

I just know that from a software point of view it makes sense to use standard MP4 reading code.

Thinking about this now, the existence of the Canon ThumbnailImage in the MP4 is certainly crucial, and I don't know anything that will create this for you.

Sorry, I'm a beginner, it's not clear to me how to run the command, do you intend to run it in the command line terminal, or in the ExifTool software?

You run the command in a terminal after installing ExifTool.

- Phil

I also inserted images without a thumbnail, so it seems that it is not critical, assuming that I want to manually change the file structure. Can you guide me on how a Canon file is structured in HXD?

[Phil Harvey]

I don't know what you mean by "how a Canon file is structured in HXD".

But I don't have time to explain the MP4 structure to you, if that is what you are asking.

- Phil

[NUES VXUFV]

Thanks I understand,
I would be happy if someone could do the comparison for me [my computer does not have terminal access permissions]
Here is a file from my camera.   MP4 1
And this is an external file, which I'm asking for help checking to see how it differs from the previous file. MP4 2

Does anyone see a difference in their coding?


I also use the HXD software and I would like to change the structure of the file. Has anyone tried this?

[Phil Harvey]

Here are the differences.  As I guessed, the most notable difference is a lack of the Canon ThumbnailImage which contains all of the Canon metadata.

Code Select Expand

> exiftool MVI_5574.MP4 -diff ניסוי.mp4
======== diff < MVI_5574.MP4 > ניסוי.mp4
< [System]        File Name                       : MVI_5574.MP4
>                                                 : ניסוי.mp4
< [System]        File Size                       : 12 MB
>                                                 : 212 MB
< [System]        File Modification Date/Time     : 2025:01:21 14:24:10-05:00
>                                                 : 2025:01:21 14:24:30-05:00
< [System]        File Access Date/Time           : 2025:01:21 14:24:05-05:00
>                                                 : 2025:01:21 14:23:48-05:00
< [System]        File Inode Change Date/Time     : 2025:01:21 14:24:28-05:00
>                                                 : 2025:01:21 14:24:33-05:00
< [File]          Exif Byte Order                 : Little-endian (Intel, II)
< [File]          Image Width                     : 160
< [File]          Image Height                    : 120
< [File]          Encoding Process                : Baseline DCT, Huffman coding
< [File]          Bits Per Sample                 : 8
< [File]          Color Components                : 3
< [File]          Y Cb Cr Sub Sampling            : YCbCr4:2:2 (2 1)
< [QuickTime]     Major Brand                     : MP4 v2 [ISO 14496-14]
>                                                 : MP4 Base Media v1 [IS0 14496-12:2003]
< [QuickTime]     Minor Version                   : 0.0.1
>                                                 : 0.2.0
< [QuickTime]     Compatible Brands               : mp42, avc1, CAEP
>                                                 : isom, iso2, avc1, mp41
< [QuickTime]     Create Date                     : 2016:02:06 21:19:21
>                                                 : 0000:00:00 00:00:00
< [QuickTime]     Modify Date                     : 2016:02:06 21:19:21
>                                                 : 0000:00:00 00:00:00
< [QuickTime]     Time Scale                      : 30000
>                                                 : 1000
< [QuickTime]     Duration                        : 4.00 s
>                                                 : 0:06:18
< [QuickTime]     Media Data Size                 : 12139622
>                                                 : 211297402
< [QuickTime]     Media Data Offset               : 98312
>                                                 : 414818
> [QuickTime]     Handler Type                    : Metadata
> [QuickTime]     Handler Vendor ID               : Apple
< [Canon]         Compressor Version              : CanonMP4_002/05.00.00/00.00.02
< [Canon]         Macro Mode                      : Normal
< [Canon]         Self Timer                      : Off
< [Canon]         Quality                         : Light (RAW)
< [Canon]         Canon Flash Mode                : Off
< [Canon]         Continuous Drive                : Movie
< [Canon]         Focus Mode                      : Single
< [Canon]         Record Mode                     : MP4
< [Canon]         Canon Image Size                : 1920x1080 Movie
< [Canon]         Easy Mode                       : Manual
< [Canon]         Digital Zoom                    : None
< [Canon]         Contrast                        : Normal
< [Canon]         Saturation                      : Normal
< [Canon]         Sharpness                       : 0
< [Canon]         Camera ISO                      : Auto
< [Canon]         Metering Mode                   : Evaluative
< [Canon]         Focus Range                     : Auto
< [Canon]         AF Point                        : Manual AF point selection
< [Canon]         Canon Exposure Mode             : Program AE
< [Canon]         Lens Type                       : n/a
< [Canon]         Max Focal Length                : 172 mm
< [Canon]         Min Focal Length                : 4.3 mm
< [Canon]         Focal Units                     : 100/mm
< [Canon]         Max Aperture                    : 4
< [Canon]         Min Aperture                    : 8
< [Canon]         Flash Bits                      : (none)
< [Canon]         Focus Continuous                : Continuous
< [Canon]         Image Stabilization             : On (2)
< [Canon]         Zoom Source Width               : 2586
< [Canon]         Zoom Target Width               : 2586
< [Canon]         Spot Metering Mode              : Center
< [Canon]         Manual Flash Output             : n/a
< [Canon]         Auto ISO                        : 800
< [Canon]         Measured EV                     : 5.00
< [Canon]         Target Exposure Time            : 1
< [Canon]         Exposure Compensation           : 0
< [Canon]         White Balance                   : Cloudy
< [Canon]         Slow Shutter                    : Off
< [Canon]         Shot Number In Continuous Burst : 0
< [Canon]         Optical Zoom Code               : 10
< [Canon]         Flash Guide Number              : 0
< [Canon]         Flash Exposure Compensation     : 0
< [Canon]         Auto Exposure Bracketing        : Off
< [Canon]         AEB Bracket Value               : 0
< [Canon]         Control Mode                    : Camera Local Control
< [Canon]         Focus Distance Upper            : 65.53 m
< [Canon]         Focus Distance Lower            : 0 m
< [Canon]         Bulb Duration                   : 0
< [Canon]         Camera Type                     : Compact
< [Canon]         Auto Rotate                     : Rotate 90 CW
< [Canon]         ND Filter                       : Off
< [Canon]         Self Timer 2                    : 0
< [Canon]         Flash Output                    : 0
< [Canon]         Canon Image Type                : MVI:PowerShot SX720 HS Movie
< [Canon]         Canon Firmware Version          : Firmware Version 1.01
< [Canon]         File Number                     : 879-5574
< [Canon]         Camera Temperature              : 29 C
< [Canon]         Canon Model ID                  : PowerShot SX720 HS
< [Canon]         Thumbnail Image Valid Area      : 0 159 15 104
< [Canon]         Date Stamp Mode                 : Off
< [Canon]         My Color Mode                   : Off
< [Canon]         Firmware Revision               : 1.01 rev 1.00
< [Canon]         Categories                      : (none)
< [Canon]         Intelligent Contrast            : Off
< [Canon]         Image Unique ID                 : 207d0b331fc54529be064f4353379455
< [Canon]         Faces Detected                  : 65535
< [Canon]         Time Zone                       : +00:00
< [Canon]         Time Zone City                  : (not set)
< [Canon]         Daylight Savings                : Off
< [Canon]         AF Area Mode                    : Single-point AF
< [Canon]         Num AF Points                   : 9
< [Canon]         Valid AF Points                 : 1
< [Canon]         Canon Image Width               : 1920
< [Canon]         Canon Image Height              : 1080
< [Canon]         AF Image Width                  : 5184
< [Canon]         AF Image Height                 : 3888
< [Canon]         AF Area Widths                  : 933 142 24624 71 83 -5536 1 60 71
< [Canon]         AF Area Heights                 : 524 21771 -1 8417 142 497 21701 0 8355
< [Canon]         AF Area X Positions             : 0 536 536 24560 71 83 -5536 24884 71
< [Canon]         AF Area Y Positions             : 0 536 536 -1 8417 142 518 21701 8355
< [Canon]         AF Points In Focus              : (none)
< [Canon]         Aspect Ratio                    : 16:9
< [Canon]         Cropped Image Width             : 1920
< [Canon]         Cropped Image Height            : 1080
< [Canon]         Cropped Image Left              : 0
< [Canon]         Cropped Image Top               : 0
< [Canon]         VRD Offset                      : 0
< [Canon]         Thumbnail Image                 : (Binary data 33046 bytes)
< [IFD0]          Image Description               :
< [IFD0]          Make                            : Canon
< [IFD0]          Camera Model Name               : Canon PowerShot SX720 HS
< [IFD0]          Orientation                     : Horizontal (normal)
< [IFD0]          X Resolution                    : 180
< [IFD0]          Y Resolution                    : 180
< [IFD0]          Resolution Unit                 : inches
< [IFD0]          Modify Date                     : 2016:02:06 21:19:21
< [IFD0]          Y Cb Cr Positioning             : Co-sited
< [ExifIFD]       Exposure Time                   : undef
< [ExifIFD]       F Number                        : undef
< [ExifIFD]       Sensitivity Type                : Standard Output Sensitivity and Recommended Exposure Index
< [ExifIFD]       Exif Version                    : 0230
< [ExifIFD]       Date/Time Original              : 2016:02:06 21:19:21
< [ExifIFD]       Create Date                     : 2016:02:06 21:19:21
< [ExifIFD]       Components Configuration        : Y, Cb, Cr, -
< [ExifIFD]       Compressed Bits Per Pixel       : 3
< [ExifIFD]       Shutter Speed Value             : 0
< [ExifIFD]       Aperture Value                  : 4.0
< [ExifIFD]       Exposure Compensation           : 0
< [ExifIFD]       Max Aperture Value              : 4.0
< [ExifIFD]       Metering Mode                   : Multi-segment
< [ExifIFD]       Flash                           : Off, Did not fire
< [ExifIFD]       Focal Length                    : 7.1 mm
< [ExifIFD]       User Comment                    :
< [ExifIFD]       Sub Sec Time                    : 27
< [ExifIFD]       Sub Sec Time Original           : 27
< [ExifIFD]       Sub Sec Time Digitized          : 27
< [ExifIFD]       Flashpix Version                : 0100
< [ExifIFD]       Color Space                     : sRGB
< [ExifIFD]       Exif Image Width                : 160
< [ExifIFD]       Exif Image Height               : 120
< [ExifIFD]       Sensing Method                  : One-chip color area
< [ExifIFD]       File Source                     : Digital Camera
< [ExifIFD]       Custom Rendered                 : Normal
< [ExifIFD]       Exposure Mode                   : Auto
< [ExifIFD]       White Balance                   : Manual
< [ExifIFD]       Digital Zoom Ratio              : 1
< [ExifIFD]       Scene Capture Type              : Standard
< [ExifIFD]       Owner Name                      :
< [InteropIFD]    Interoperability Index          : THM - DCF thumbnail file
< [InteropIFD]    Interoperability Version        : 0100
< [InteropIFD]    Related Image Width             : 1920
< [InteropIFD]    Related Image Height            : 1080
< [GPS]           GPS Version ID                  : 2.3.0.0
< [UserData]      Make                            : Canon
< [UserData]      Camera Model Name               : Canon PowerShot SX720 HS
< [UserData]      User Rating                     : 0
< [Track1]        Track Create Date               : 2016:02:06 21:19:21
>                                                 : 0000:00:00 00:00:00
< [Track1]        Track Modify Date               : 2016:02:06 21:19:21
>                                                 : 0000:00:00 00:00:00
< [Track1]        Track Duration                  : 4.00 s
>                                                 : 0:06:18
< [Track1]        Media Create Date               : 2016:02:06 21:19:21
>                                                 : 0000:00:00 00:00:00
< [Track1]        Media Modify Date               : 2016:02:06 21:19:21
>                                                 : 0000:00:00 00:00:00
< [Track1]        Media Duration                  : 4.00 s
>                                                 : 0:06:18
< [Track1]        Media Language Code             : eng
>                                                 : und
< [Track1]        Color Primaries                 : BT.709
>                                                 : BT.601
< [Track1]        Transfer Characteristics        : BT.709
>                                                 : BT.601
< [Track1]        Matrix Coefficients             : BT.709
>                                                 : BT.601
< [Track1]        Video Full Range Flag           : Full
>                                                 : Limited
> [Track1]        Handler Description             : VideoHandler
> [Track1]        Pixel Aspect Ratio              : 1:1
> [Track1]        Buffer Size                     : 0
> [Track1]        Max Bitrate                     : 4175828
> [Track1]        Average Bitrate                 : 4175828
< [Track2]        Track Create Date               : 2016:02:06 21:19:21
>                                                 : 0000:00:00 00:00:00
< [Track2]        Track Modify Date               : 2016:02:06 21:19:21
>                                                 : 0000:00:00 00:00:00
< [Track2]        Track Duration                  : 3.99 s
>                                                 : 0:06:18
< [Track2]        Media Create Date               : 2016:02:06 21:19:21
>                                                 : 0000:00:00 00:00:00
< [Track2]        Media Modify Date               : 2016:02:06 21:19:21
>                                                 : 0000:00:00 00:00:00
< [Track2]        Media Duration                  : 3.99 s
>                                                 : 0:06:18
< [Track2]        Media Language Code             : eng
>                                                 : und
> [Track2]        Handler Description             : SoundHandler
> [Track2]        Buffer Size                     : 0
> [Track2]        Max Bitrate                     : 384000
> [Track2]        Average Bitrate                 : 290796
< [Composite]     Drive Mode                      : Continuous Shooting
< [Composite]     Lens                            : 4.3 - 172.0 mm
< [Composite]     Shooting Mode                   : Program AE
< [Composite]     Aperture                        : undef
< [Composite]     Lens ID                         : Unknown 4-172mm
< [Composite]     Shutter Speed                   : undef
< [Composite]     Create Date                     : 2016:02:06 21:19:21.27
< [Composite]     Date/Time Original              : 2016:02:06 21:19:21.27
< [Composite]     Modify Date                     : 2016:02:06 21:19:21.27
< [Composite]     Avg Bitrate                     : 24.3 Mbps
>                                                 : 4.47 Mbps
< [Composite]     File Extension                  : MP4
>                                                 : mp4
< [Composite]     Physical Image Size             : 26.7x15.0 inches
< [Composite]     Lens                            : 4.3 - 172.0 mm
< [Composite]     Focal Length                    : 7.1 mm
- Phil

[NUES VXUFV]

Here are the differences.  As I guessed, the most notable difference is a lack of the Canon ThumbnailImage which contains all of the Canon metadata.

Thank you very much!! It's good that there are experts like you!

In light of this, I have 2 questions,
1] Can I change these differences using exiftool and the like, so that there is no difference? And the best thing is if someone is willing to change it for me, so that the MP4 2 file will be like the file that came from the MP41 camera and I will check if it entered the camera?
2] Did you also check the difference in the atomic structure of the file, or is that irrelevant?

[Phil Harvey]

1) No

2) I didn't, but that should be irrelevant as I have said.

- Phil

[NUES VXUFV]

1] Thank you again from the bottom of my heart, what did you mean by "no"? That it is not possible to change? Please enlighten me as to why the following command will not work:
exiftool -m input.mp4 output.mp4


2] Another question: Is there an opposite option, namely injecting the video into the Canon file, so that we use all of Canon's metadata themselves? [After all, just as your software recognizes all of the metadata and knows how to extract it from the binary location in the file, it also apparently knows how to understand which bytes to keep and which I can replace with bytes from another movie]

[Phil Harvey]

Thinking about this now, the existence of the Canon ThumbnailImage in the MP4 is certainly crucial, and I don't know anything that will create this for you.

This includes ExifTool.

[NUES VXUFV]

And what do you think about the last idea I'm holding on to, injecting the video as I wrote earlier

2] Another question: Is there an opposite option, namely injecting the video into the Canon file, so that we use all of Canon's metadata themselves? [After all, just as your software recognizes all of the metadata and knows how to extract it from the binary location in the file, it also apparently knows how to understand which bytes to keep and which I can replace with bytes from another movie]

[Phil Harvey]

I don't know any software that will do this.

- Phil