Extract radiometric frames from msx video (FLIR Lepton 3.5 + Sony CMOS HDR)

[Effe]

Hi,
Im using the parrot anafi thermal, the thermal camera is FLIR Lepton 3.5
I am able to split msx images in rgb and radiometric using python + exiftool, and I would like to achieve the same result, but with the msx videos.

using ffmpeg i found these streams:

Code Select Expand


Stream #0:0(eng): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt709), 1440x1080 [SAR 1:1 DAR 4:3], 16140 kb/s, 9.08 fps, 9 tbr, 9 tbn, 18 tbc (default)
Metadata:
  creation_time   : 2020-07-02T14:14:58.000000Z
  handler_name    : DefaultVideo
 
Stream #0:1(eng): Data: none (mett / 0x7474656D), 8 kb/s (default)
Metadata:
  creation_time   : 2020-07-02T14:14:58.000000Z
  handler_name    : ParrotVideoMetadata
 
Stream #0:2(eng): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt709), 1440x1080 [SAR 1:1 DAR 4:3], 3071 kb/s, 9.07 fps, 9 tbr, 9 tbn, 18 tbc
Metadata:
  creation_time   : 2020-07-02T14:14:58.000000Z
  handler_name    : ParrotThermalVideo
 
Stream #0:3(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 384 kb/s (default)
Metadata:
  creation_time   : 2020-07-02T14:14:58.000000Z
  handler_name    : DefaultAudio
 
Stream #0:4: Video: mjpeg (Baseline), yuvj420p(pc, bt470bg/unknown/unknown), 240x180 [SAR 1:1 DAR 4:3], 90k tbr, 90k tbn, 90k tbc (attached pic)


I can get the RGB video stored in Stream #0:2 using this command:

Code Select Expand

ffmpeg -i .\P0720438.MP4 -map 0:2 -vcodec copy -an rgb.mp4

But I have no idea how to get the radiometric thermal video, or better radiometric frame by frame.

I asked it to parrot team and they told me that thermal information are stored in Stream #0:2 as serialized data.
Is there a way to extract this information with exiftool?

Here e test video:
https://drive.google.com/file/d/1WGC1SOjeyMZpZ6uolob4USjI_u9EZZ3n/view?usp=sharing

Thanks
- F

[Phil Harvey]

ExifTool really isn't designed to extract video streams, so I'm not sure I will be able to do what you ask, but I'll take a look at this when I get a chance (it may be a couple of weeks)

- Phil

[Effe]

Thank you very much for your response and for your time!

- F