Copy PNG metadata via Regex to import into Lightroom Hierarchical tags?

[TushyBhutt]

Hi,

I've looked through the forums but I cannot find an answer, or my search skills suck (likely the latter).  I have a PNG file created by an AI image generator that writes info in the "parameters" tag.

I'd like to import as hierarchical keywords into Lightroom.  Unfortunately, there are no easy tag separators and I need to use commas, colons, and periods to classify the structure properly, so the code below won't work

Code Select Expand

-sep "," -XMP-LR:HierarchicalSubject<Parameters

Using the Regex101 website, I was able to wrangle the 835 characters into 27 groups and need to put most of them into LR.  Ten or eleven will become parent keywords, the rest go in as children.

How can I get Exiftool to export the data in the PNG Parameters via a regex expression and import it into Lightroom keywords?  Here is some sample output for you to review, if it helps:

Current PNG data:

professional [digital airbrush:photo:0.5] art of an imp with wearing old cloak, curly pale red-blonde hair, with few tattoos, dynamic bright atmospheric lighting.Negative prompt: logo, text, signature, (bad art).Steps: 75, Sampler: DPM++ 2M Karras, CFG scale: 12, Seed: 3334373882, Size: 768x1152, Model hash: 81761151, Model: Stable 1.5, Denoising strength: 0.7, Eta: 0.89, First pass size: 0x0


Regex mask:

(.*)((\.)(Negative prompt:)) (.*)((\.)(Steps:)) (\d+), (Sampler:)(.*), (CFG scale:) (\d+), (Seed:) (\d+), (Size:) (.*), (Model hash:) (.*), (Model:)(.*), (Denoising strength:) (.*), (Eta:) (.*), (First pass size:) (.*)


Desired outcome for LR keywords

Prompt|professional [digital airbrush:photo:0.5] art of an imp with wearing old cloak, curly pale red-blonde hair, with few tattoos, dynamic bright atmospheric lighting
Negative prompt|logo, text, signature, (bad art)
Steps|75
Sampler|DPM++ 2M Karras
CFG scale|12
Seed|3334373882
Size|768x1152
Model hash|81761151
Model|Stable 1.5
Denoising strength|0.7
Eta|0.89
First pass size|0x0



I am using Exiftool 12.5 on Windows 10 64-bit with the ExifToolGui front end.  Thanks for any help you can provide!

TB

[Phil Harvey]

Can you post the binary output of the "PNG data" (the output with the ExifTool -b) option?  I suspect some of the periods are probably newlines, and we will need the exact data to test things out.  Use this command:

exiftool -b -Parameters FILE > out.txt

- Phil

[TushyBhutt]

First of all, thanks for an awesome tool!  Each time I ran the command you gave in ExifToolGui or JExifToolGui, I got a file not found error, but here's the output from ExifToolGUI log:

professional [digital airbrush:photo:0.5] art of an imp with sword, wearing old cloak, curly pale red-blonde hair, with few tattoos, dynamic bright atmospheric lighting
Negative prompt: logo, text, signature, (bad art)
Steps: 75, Sampler: DPM++ 2M Karras, CFG scale: 12, Seed: 3334373882, Size: 768x1152, Model hash: 81761151, Model: Stable1.5, Denoising strength: 0.7, Eta: 0.89, First pass size: 0x0, aesthetic_score: 6.6, sampler: DPM++ 2M Karras, cfg_scale: 12, sd_model_hash: 81761151, seed: 3334373882
Error: File not found - out.txt
<-END-

Looks like some of the "." are newline indicators for sure, but not read properly in the GUItool (see first screenshot).

 Also, I've attached the PNG itself (the list above and the metadata are slightly different from my first post because I reran the image in the generator)

[StarGeek]

I'm assuming this is with Stable Diffusion?  Is that what is setting the PNG:Parameters tag?

Here is a RegEx101 example for parsing the data. I removed the capture of the static strings because you know what they are and capturing just complicates the regex.  Also the substitution is using new lines \n to make it easier to read.  For your actual command you would use something else with the -sep option.

Phil, if Stable Diffusion is creating the PNG:Parameters tag, you might consider adding it to exiftool.  I'll dig around deeper to make sure.  SD is becoming very popular, especially among table top RPGs such as D&D, for it's ability to generate images like this.

[TushyBhutt]

I'm assuming this is with Stable Diffusion?  Is that what is setting the PNG:Parameters tag?

Here is a RegEx101 example for parsing the data. I removed the capture of the static strings because you know what they are and capturing just complicates the regex.  Also the substitution is using new lines \n to make it easier to read.  For your actual command you would use something else with the -sep option.

Phil, if Stable Diffusion is creating the PNG:Parameters tag, you might consider adding it to exiftool.  I'll dig around deeper to make sure.  SD is becoming very popular, especially among table top RPGs such as D&D, for it's ability to generate images like this.

Hi, yes it is from Stable Diffusion, one of the localized front-ends adds the parameters in (few of them do as far as I know).

Thank you for the substitution output in Regex101, how do I use that in Exiftool to read back into the XMP-LR:HierarchicalSubject ? I'm OK with fiddling with Regex, however blindly, it's getting the output from PNG:Parameters into the other tag that I am not sure how to do

[StarGeek]

Try this, assuming Windows CMD.  If otherwise, change double quotes into single quotes.  I'm also using ## as a separator.  If that pattern is used as part of the Parameters data at some point, it would have to be changed

exiftool -Sep "##" "-HierarchicalSubject<${Parameters;s/(.*)\nNegative prompt: (.*)\nSteps: (\d+), Sampler:(.*), CFG scale: (\d+), Seed: (\d+), Size: (.*), Model hash: (.*), Model:(.*), Denoising strength: (.*), Eta: (.*), First pass size: (.*)/Prompt|$1##Negative prompt|$2##Steps|$3##Sampler|$4##CFG scale|$5##Seed|$6##Size|$7##Model hash|$8##Model|$9##Denoising strength|$10##Eta|$11##First pass size|$12/}" /path/to/files/

Example output.  The -b (-binary) option is used to make it clear that each item is a separate entry

Code Select Expand

C:\>exiftool -P -overwrite_original -Sep "##" "-HierarchicalSubject<${Parameters;s/(.*)\nNegative prompt: (.*)\nSteps: (\d+), Sampler:(.*), CFG scale: (\d+), Seed: (\d+), Size: (.*), Model hash: (.*), Model:(.*), Denoising strength: (.*), Eta: (.*), First pass size: (.*)/Prompt|$1##Negative prompt|$2##Steps|$3##Sampler|$4##CFG scale|$5##Seed|$6##Size|$7##Model hash|$8##Model|$9##Denoising strength|$10##Eta|$11##First pass size|$12/}" Y:\!temp\bbb\test.png
    1 image files updated

C:\>exiftool -G1 -a -s -b -HierarchicalSubject Y:\!temp\bbb\test.png
Prompt|professional [digital airbrush:photo:0.5] art of an imp with sword, wearing old cloak, curly pale red-blonde hair, with few tattoos, dynamic bright atmospheric lighting
Negative prompt|logo, text, signature, (bad art)
Steps|75
Sampler| DPM++ 2M Karras
CFG scale|12
Seed|3334373882
Size|768x1152
Model hash|81761151
Model| Stable1.5
Denoising strength|0.7
Eta|0.89
First pass size|0x0

[TushyBhutt]

Try this, assuming Windows CMD.  If otherwise, change double quotes into single quotes.  I'm also using ## as a separator.  If that pattern is used as part of the Parameters data at some point, it would have to be changed

exiftool -Sep "##" "-HierarchicalSubject<${Parameters;s/(.*)\nNegative prompt: (.*)\nSteps: (\d+), Sampler:(.*), CFG scale: (\d+), Seed: (\d+), Size: (.*), Model hash: (.*), Model:(.*), Denoising strength: (.*), Eta: (.*), First pass size: (.*)/Prompt|$1##Negative prompt|$2##Steps|$3##Sampler|$4##CFG scale|$5##Seed|$6##Size|$7##Model hash|$8##Model|$9##Denoising strength|$10##Eta|$11##First pass size|$12/}" /path/to/files/

Example output.  The -b (-binary) option is used to make it clear that each item is a separate entry

Code Select Expand

C:\>exiftool -P -overwrite_original -Sep "##" "-HierarchicalSubject<${Parameters;s/(.*)\nNegative prompt: (.*)\nSteps: (\d+), Sampler:(.*), CFG scale: (\d+), Seed: (\d+), Size: (.*), Model hash: (.*), Model:(.*), Denoising strength: (.*), Eta: (.*), First pass size: (.*)/Prompt|$1##Negative prompt|$2##Steps|$3##Sampler|$4##CFG scale|$5##Seed|$6##Size|$7##Model hash|$8##Model|$9##Denoising strength|$10##Eta|$11##First pass size|$12/}" Y:\!temp\bbb\test.png
    1 image files updated

C:\>exiftool -G1 -a -s -b -HierarchicalSubject Y:\!temp\bbb\test.png
Prompt|professional [digital airbrush:photo:0.5] art of an imp with sword, wearing old cloak, curly pale red-blonde hair, with few tattoos, dynamic bright atmospheric lighting
Negative prompt|logo, text, signature, (bad art)
Steps|75
Sampler| DPM++ 2M Karras
CFG scale|12
Seed|3334373882
Size|768x1152
Model hash|81761151
Model| Stable1.5
Denoising strength|0.7
Eta|0.89
First pass size|0x0

Ah clever, adding the "##" as a token to become a separator into the regex output!  It worked like a charm!  Thank you so much!

[blue-j]

Phil, if Stable Diffusion is creating the PNG:Parameters tag, you might consider adding it to exiftool.  I'll dig around deeper to make sure.  SD is becoming very popular, especially among table top RPGs such as D&D, for its ability to generate images like this.

I second this suggestion.  I'll create some DALL-E 2 images and look under the hood as well.

Also note the png:aesthetic_score field in the sample.  - J

[blue-j]

Attached is a sample of output from DALL-E 2.  It seems to have Maker Notes that are not recognized.  I wasn't able to get images out of GPT-3 at the moment, but will try again later when I have more time.

- J

[StarGeek]

Did some searching and I can't find any documentation on what tags are actually being added by the front ends. I think these tags would be better served as a config file for the time being.

[blue-j]

I'd personally like to be proactive, at least with Stable Diffusion.  Adding new PNG tags is silly and surely borne of a lack of knowledge about metadata.  Can we suggest a better option?  I'd be happy to be an ambassador.  Even a custom XMP or Maker Notes namespace would be better.  Do you have an idea of what would be best?

Regarding Dall-E 2 and OpenAI, I don't understand what is going on with their Maker Notes, so I can't judge their implementation.  Were you able to see any data?

- J

[blue-j]

Did some searching and I can't find any documentation on what tags are actually being added by the front ends. I think these tags would be better served as a config file for the time being.

I created a couple definitions... FWIW

CFG (Classifier-Free Guidance) Scale
The higher the value, the more the output will be in line with the input, but it will be at the expense of image quality; the lower the value, the more likely it is to be distant from the prompt or input image, but the output will be of higher quality

Seed
Seed is the unique representation of a specific image, a kind of master key making it possible to regenerate exactly the same image, with variations

I'll share more as I do more research.

- J

[blue-j]

On more research, the Stable Diffusion ecosystem is rather broad, and changing the fields for them would break a fair number of applications.  That might be worth it, but I'm unsure.  -J

[StarGeek]

Even a custom XMP or Maker Notes namespace would be better.  Do you have an idea of what would be best?

XMP would be best and easiest to deal with.  "Prompt" and "Negative Prompt" would be list type tags.  The rest could be simple strings or if you wanted to get technical, integer/real.

I'm hoping to upgrade my 10 year old computer real soon, and SD is on my list of things to try.

Going off (exiftool) topic, is Nvidia better for the CUDA stuff or is GPU ram better.  I was looking things over and the Nvidea GPUs in my price range were 10-12 gb ram, while there were some 16 gig Radeon GPUs in the same range.  Woefully ill-informed on things at the moment.

[blue-j]

I'm sorry to have to tell you that I have no idea!  I don't deal with that aspect of the work, and don't run it locally.  I know CUDA is highly recommended and NVIDIA is a leader in the field... I will ask my AI team for you.  - J