IMDB search not working

[PedroDePacus]

Symptom
When searching IMDB no program details are show

When I search for The Godfather part III movie for example it finds the initial information, but when you select details it comes back with no details found it has been working upto a couple of weeks ago. There has been no networking changes e.g. firewall or hardware or internet provider. It doesn’t matter what the show, it finds a list of comparable shows but won’t show the details.

Network – LAN
I can access the box with FTP, HTTP and SAMBA.

Network – WAN
I can check for updates, but there are none, the check works
In Kodi I can update a programs details from the internet
In the you tube plugin I can find and play videos

So I’m pretty sure it’s not the network

Software
I un-installed the IMDB plugin, restarted, then reinstalled the plugin

OS
I re-flashed with the production 2019 version
I flashed in the current beta 20210704

I’m out of ideas, has anyone else had this problem?

[PedroDePacus]

Damn put it in How to instead of general, moderator can you move it please?

[MrQuade]

Yea, I only just noticed last night that IMDB scraping wasn't working. I was going to make a post, but since you beat me to it

Title search works, but no content returned.

IMDB seems to be in a similar boat as YouTube. The data format on the website keep changing and it confuses the plugin scraper.

The plugin has "broken" a couple of times in the past. I think last time, Adoxa was kind enough to make the required changes.

[prl]

Moved to Beyonwiz T2 / T3 / T4 / U4 / V2 > General Topics because it's almost certainly not a V2-specific problem.

I get the same result as you on an IMDB search for The Godfather III. I get a list of title matches, but the details page for TGF III is empty. I get the same for other IMDB searches.

IMDb search is a screenscraper. Whenever IMDb changes the way that their Content Management System works (e.g. updating to a new version), IMDb search is likely to break.

None of the things you tried (which are all reasonable) would work if the screenscraping is failing.

I'll have a look at it in the next couple of days. I think that the problem may be that it's not extracting the URL of the IMDb's main page for the show when it gets the search result. If it's that, it should be fairly easy to fix, though if it is that, it's likely to be more than just that.

[prl]

I think that the problem may be that it's not extracting the URL of the IMDb's main page for the show when it gets the search result.

That's not the problem. It downloads the details page for the selected title, but can't extract any of the the information it wants to display.

[adoxa]

It was fixed last month in OpenPLi, which got added to OE-Alliance, but peteru hasn't got it in Beyonwiz, yet. I'm tweaking it a bit, because it was really slow on the T2, taking about 40s; currently got it down to 10-20s, but should be able to get it down a bit more (haven't tried those changes on the box, yet). I'll also add an episode count.

[prl]

OK, if you're already looking at it, I'll stop.

[MrQuade]

it was really slow on the T2, taking about 40s; currently got it down to 10-20s,

!!!? Thats insane!

[adoxa]

Here's an updated IMDb (patch). In addition to working with the "new version":

• don't show "Plot Outline" if it's the same as the start of "Storyline" (possibly "new" only, "old" may have continuation characters I haven't tested);
• add "Episodes" ("new") or "Episode Guide" ("old");
• "new" seasons is only a count, not a list;
• "new" quotes use newlines;
• review puts the title/author on the same line as "User review", with text below.

One more thing I'd like to do is turn the cast list into a menu, to view an actor's page.

Install: unzip where the Wiz can see it, run imdb/setup.sh, restart. Repeat to remove.

[Zebedee]

I applied the patch, rebooted and tried to use it. The status line near bottom of screen above the [Exit] button showed:
Query IMDb: <title>
then
IMDb Download failed: 'module' object has no attribute 'ensure_str'
I'm running a T4 with software Release 19.3 Build 20191106

[Star6key]

Thanks Adoxa. Works well on my U4.

[MrQuade]

I'm running a T4 with software Release 19.3 Build 20191106

The patch is probably only valid to use on the up to date beta firmware. (patches are generally version specific, and should not be left applied when performing online updates)

You should uninstall the patch to return your firmware to a vanilla state.


I would recommend that you update your firmware to the latest beta via USB update too. Lots of fixes there, and there is no telling when the "official" release will be at this stage.

[adoxa]

I'm running a T4 with software Release 19.3 Build 20191106

The patch is probably only valid to use on the up to date beta firmware.

I don't think there'll be any problems with that, it only replaces the IMDb plugin. ... But now I go back, see I've missed a message and there is a problem. Oh.

[adoxa]

I applied the patch, rebooted and tried to use it. The status line near bottom of screen above the [Exit] button showed:
Query IMDb: <title>
then
IMDb Download failed: 'module' object has no attribute 'ensure_str'
I'm running a T4 with software Release 19.3 Build 20191106

Here's a version without that (untested, but, famous last words, it should work).

[Zebedee]

I tried the second patch but it didn't work either. Same symptoms. I've dropped back to Release 19.3 Build 20191106.
I'm intrigued at the prospect of trying the latest beta via USB update as suggested, but I don't know where to get it.

[adoxa]

Oops, looks like the hard link I used broke, so the file I modified is not the file I compiled. Should be right, now (updated the previous attachment).
The latest USB beta is here.

[PedroDePacus]

I’m on the beta 2021.07.04, applied the patch and IMDB is working fine. I didn’t realise how much I used it to help sort the wheat from the chaff.
Thanks to all who helped fix it

[Zebedee]

All good now. Thank you all.