How can I refresh missing video metadata? (Z10Pro)

No, I was pointing out that the metadata refresh button is not available when NFOs are used but you didn't mention you were on old firmware (which doesn't have this function).

As @Netmask has suggested, try changing the name of the file so HT rescrapes to see if the badges appear in the new scrape. This will identify the problem and if you want to return to the original filename afterwards, you can do that by simply renaming back.

 

I've actually tried this, but the metadata update (which only sometimes happens) doesn't stick if I revert to my previous file name. I've downloaded and examined the Zidoo database and I've found that the DB retains entries for files that no longer exist. Apparently this old, cached data comes back into use if a previously missing file returns to existence again.

 

That's what I was trying to get to - so firstly, I've no idea why the original scrape would only show MKV and no other details - I've never seen that before, and I can't think of anything in the mechanism that would do that.

But as you've found, the database housekeeping is terrible, and pretty much everything that ever happens to it remains in there rather than being removed.

However, the metadata refresh button on the "More" screen was designed to overcome this (as is the Refresh option in the popup menu for scraping). Because this doesn't work for you, and of course the fact you only have an MKV badge seems to indicate database corruption.

Personally I'd completely reset HT and start again but as @Netmask says, renaming the file is the other option.

If you do start again, make a backup and export NFO/artwork so you have some choices in how to rebuild the database and can always go back to where you are now if it all goes Pete Tong.

 

I'm not absolutely sure about this, but I think most, if not all, of the loss of MKV metadata has happened after I've rematched movies that weren't matched correctly on the first automated pass.

Bahchess? We don need no steenkeen bahchess! (Okay, but we would like to have them.)

Having done such a reset two or three times already, I'll live without all of the badges I'd like to have and hope a future firmware update helps.

 

Would it be worthwhile posting a MediaInfo file report of one of the file/s ?

 

Sure.

{
"creatingLibrary": {
"name": "MediaInfoLib",
"version": "23.07",
"url": "https://mediaarea.net/MediaInfo"
},
"media": {
"@ref": "/Volumes/video/Ant-Man •/2 - Ant-Man and the Wasp/Ant-Man and the Wasp.mkv",
"track": [
{
"@type": "General",
"UniqueID": "74284437311326988723139137269643886767",
"VideoCount": "1",
"AudioCount": "6",
"TextCount": "6",
"FileExtension": "mkv",
"Format": "Matroska",
"Format_Version": "4",
"FileSize": "9045366800",
"Duration": "7086.585",
"OverallBitRate_Mode": "VBR",
"OverallBitRate": "10211256",
"FrameRate": "23.976",
"FrameCount": "169907",
"IsStreamable": "No",
"Title": "Ant-Man and the Wasp",
"Movie": "Ant-Man and the Wasp",
"Encoded_Date": "2023-06-01 21:01:45 UTC",
"File_Modified_Date": "2023-08-09 21:29:03 UTC",
"File_Modified_Date_Local": "2023-08-09 17:29:03",
"Encoded_Application": "HandBrake 1.6.1 2023012300",
"Encoded_Library": "Lavf59.27.100",
"extra": {
"ErrorDetectionType": "Per level 1"
}
},
{
"@type": "Video",
"StreamOrder": "0",
"ID": "1",
"UniqueID": "2477305505168217478",
"Format": "AVC",
"Format_Profile": "High",
"Format_Level": "4",
"Format_Settings_CABAC": "Yes",
"Format_Settings_RefFrames": "4",
"CodecID": "V_MPEG4/ISO/AVC",
"Duration": "7086.538000000",
"Width": "1920",
"Height": "804",
"Stored_Height": "816",
"Sampled_Width": "1920",
"Sampled_Height": "804",
"PixelAspectRatio": "1.000",
"DisplayAspectRatio": "2.388",
"FrameRate_Mode": "CFR",
"FrameRate_Mode_Original": "VFR",
"FrameRate": "23.976",
"FrameRate_Num": "24000",
"FrameRate_Den": "1001",
"FrameCount": "169907",
"ColorSpace": "YUV",
"ChromaSubsampling": "4:2:0",
"BitDepth": "8",
"ScanType": "Progressive",
"Delay": "0.025",
"Delay_Source": "Container",
"Encoded_Library": "x264 - core 164 r3100 ed0f7a6",
"Encoded_Library_Name": "x264",
"Encoded_Library_Version": "core 164 r3100 ed0f7a6",
"Encoded_Library_Settings": "cabac=1 / ref=2 / deblock=1:0:0 / analyse=0x3:0x113 / me=hex / subme=6 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-2 / threads=25 / lookahead_threads=4 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=3 / b_pyramid=2 / b_adapt=1 / b_bias=0 / direct=1 / weightb=1 / open_gop=0 / weightp=1 / keyint=240 / keyint_min=24 / scenecut=40 / intra_refresh=0 / rc_lookahead=30 / rc=crf / mbtree=1 / crf=20.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00",
"Default": "Yes",
"Forced": "No",
"colour_description_present": "Yes",
"colour_description_present_Source": "Container / Stream",
"colour_range": "Limited",
"colour_range_Source": "Container / Stream",
"colour_primaries": "BT.709",
"colour_primaries_Source": "Container / Stream",
"transfer_characteristics": "BT.709",
"transfer_characteristics_Source": "Container / Stream",
"matrix_coefficients": "BT.709",
"matrix_coefficients_Source": "Container / Stream"
},
{
"@type": "Audio",
"@typeorder": "1",
"StreamOrder": "1",
"ID": "2",
"UniqueID": "10665159842306186469",
"Format": "DTS",
"Format_Commercial_IfAny": "DTS-HD Master Audio",
"Format_Settings_Mode": "16",
"Format_Settings_Endianness": "Big",
"Format_AdditionalFeatures": "XLL",
"CodecID": "A_DTS",
"Duration": "7086.539000000",
"BitRate_Mode": "VBR",
"Channels": "8",
"ChannelPositions": "Front: L C R, Side: L R, Back: L R, LFE",
"ChannelLayout": "C L R LFE Lb Rb Lss Rss",
"SamplesPerFrame": "512",
"SamplingRate": "48000",
"SamplingCount": "340153872",
"FrameRate": "93.750",
"BitDepth": "24",
"Compression_Mode": "Lossless",
"Delay": "0.025",
"Delay_Source": "Container",
"Video_Delay": "0.000",
"Title": "English DTS-HD MA 7.1",
"Language": "en",
"Default": "Yes",
"Forced": "No"
},
{
"@type": "Audio",
"@typeorder": "2",
"StreamOrder": "2",
"ID": "3",
"UniqueID": "5330729191136871204",
"Format": "MPEG Audio",
"Format_Version": "1",
"Format_Profile": "Layer 3",
"Format_Settings_Mode": "Joint stereo",
"CodecID": "A_MPEG/L3",
"Duration": "7086.550000000",
"BitRate_Mode": "CBR",
"BitRate": "192000",
"Channels": "2",
"SamplingRate": "44100",
"SamplingCount": "312516855",
"Compression_Mode": "Lossy",
"Delay": "0.000",
"Delay_Source": "Container",
"Video_Delay": "-0.025",
"StreamSize": "170077200",
"Title": "English Dolby PL2",
"Encoded_Library": {
"@dt": "binary.base64",
"#value": "TEFNRTMuMTAHZ3bClnfCj8O3w7/DmV5two4="
},
"Language": "en",
"Default": "No",
"Forced": "No"
},
{
"@type": "Audio",
"@typeorder": "3",
"StreamOrder": "3",
"ID": "4",
"UniqueID": "14804763987673834645",
"Format": "AC-3",
"Format_Commercial_IfAny": "Dolby Digital",
"Format_Settings_Endianness": "Big",
"CodecID": "A_AC3",
"Duration": "7086.560000000",
"BitRate_Mode": "CBR",
"BitRate": "320000",
"Channels": "2",
"ChannelPositions": "Front: L R",
"ChannelLayout": "L R",
"SamplesPerFrame": "1536",
"SamplingRate": "48000",
"SamplingCount": "340154880",
"FrameRate": "31.250",
"Compression_Mode": "Lossy",
"Delay": "0.025",
"Delay_Source": "Container",
"Video_Delay": "0.000",
"StreamSize": "283462400",
"Title": "English DA",
"Language": "en",
"ServiceKind": "CM",
"Default": "No",
"Forced": "No",
"extra": {
"bsid": "6",
"dialnorm": "-31",
"compr": "-0.86",
"dynrng": "-0.86",
"dsurmod": "1",
"acmod": "2",
"lfeon": "0",
"dialnorm_Average": "-31",
"dialnorm_Minimum": "-31",
"compr_Average": "1.62",
"compr_Minimum": "-3.25",
"compr_Maximum": "5.16",
"compr_Count": "297",
"dynrng_Average": "1.83",
"dynrng_Minimum": "-1.97",
"dynrng_Maximum": "5.31",
"dynrng_Count": "300"
}
},
{
"@type": "Audio",
"@typeorder": "4",
"StreamOrder": "4",
"ID": "5",
"UniqueID": "14059416332932794471",
"Format": "AC-3",
"Format_Commercial_IfAny": "Dolby Digital",
"Format_Settings_Endianness": "Big",
"CodecID": "A_AC3",
"Duration": "7086.560000000",
"BitRate_Mode": "CBR",
"BitRate": "192000",
"Channels": "2",
"ChannelPositions": "Front: L R",
"ChannelLayout": "L R",
"SamplesPerFrame": "1536",
"SamplingRate": "48000",
"SamplingCount": "340154880",
"FrameRate": "31.250",
"Compression_Mode": "Lossy",
"Delay": "0.025",
"Delay_Source": "Container",
"Video_Delay": "0.000",
"StreamSize": "170077440",
"Title": "Commentary",
"Language": "en",
"ServiceKind": "CM",
"Default": "No",
"Forced": "No",
"extra": {
"bsid": "6",
"dialnorm": "-27",
"compr": "5.74",
"dynrng": "5.46",
"dsurmod": "1",
"acmod": "2",
"lfeon": "0",
"dialnorm_Average": "-27",
"dialnorm_Minimum": "-27",
"compr_Average": "4.37",
"compr_Minimum": "0.53",
"compr_Maximum": "5.74",
"compr_Count": "199",
"dynrng_Average": "3.49",
"dynrng_Minimum": "-0.28",
"dynrng_Maximum": "5.88",
"dynrng_Count": "281"
}
},
// Some content dropped for length
]
}
}

 

Can you send me a 30s clip of that file by PM? Upload to Mega.nz or something like that...

I'm curious to get to the bottom of this - I don't think it's a firmware issue.

Use MKVToolnix to split the file into 30s clips and abort the process once a couple of clips have been produced.

 

Here's a sample: https://shetline.com/ant-man-wasp-30sec.mkv

By the way, there's an easier way to get a 30-second sample like that: Choose "By parts based on timestamps" and then enter "00:00:00-00:00:30". You get one chunk, no fuss, no muss, no bother interrupting an endless stream of output.

 

Thanks for the tip - I didn't think of that

I'll test this later and come back to you...

 

Ok, as expected it's a file problem.

I get the same issue as you if I just throw the file into HT:


However, looking at a debug log I can see MediaInfo failing and it's to do with PGS subtitle framerate being non standard.

If you remux without the subtitles, the MediaInfo runs correctly and the metadata is shown:

 

Interesting. Thank you for the detailed analysis.

At least this tells me it would be a big waste of time doing my third or forth reset of the DB to try to clear up the problem. I'm not going to go stripping out subtitles either, so I'll just have to hope the handling of subtitles improves in the future.

 

Weird one - never seen this before.

One thought I had was to use TSMuxer to create an ISO of the file and then back to MKV with MakeMKV but TSmuxer doesn't like the file either...

 

I'm curious now which debug log you're referring to here. If I run the mediainfo command line tool (v23.07), it runs smoothly without any failures. The main difference I can see between the subtitle tracks in my sample video, and other subtitle tracks, is that these fields are missing from what mediainfo reports about the subtitles:

MuxingMode
FrameRate
FrameCount
ElementCount

There is also, I should note, no problem with playing back my subtitles, even if the way the Zidoo tries to extract metadata from them is stumbling.

 

Just running a standard debug log (http://forum.zidoo.tv/index.php?threads/how-to-create-a-debug-log.93595/)