Site
Home / Forum / General Discussion / Some music videos just do not scrape

Some music videos just do not scrape


Posted: 11 Jan 2022 02:22
Damorsoft
Posts: 20
Joined: 2020-08-14

The following music videos are causing my KODI to not scrape
manual editing of songs in KODI library takes care of the ? and / issues.

However these Just will not scrape
Bee Gees - New York Mining Disaster 1941.mp4
Gary Puckett & The Union Gap - Young Girl.mp4
Guns N' Roses - Since I Don't Have You.mp4
Supertramp - It's Raining Again.mp4
maybe it is something I'm doing wrong..

? will not scrape.
Charles & Eddie - Would I lie to you?.mp4
Deana Carter - Did I Shave My Legs For This?.mp4
Enya - How Can I Keep From Singing?.mp4
Linda Ronstadt - When Will I Be Loved?.mp4
Shania Twain - Whose Bed Have Your Boots Been Under?.mp4
Toby Keith - How Do You Like Me Now?!.mp4
Toby Keith - Who's Your Daddy?.mp4

/ will not scrape
The Spinners - Working My Way Back to You / Forgive Me Girl
Linda McCartney - Uncle Albert/Admiral Halsey.mp4
The New Seekers - Pinball Wizard / See Me Feel Me.mp4

+ will not scrape
Mike + The Mechanics - All I Need Is A Miracle.mp4
Mike + The Mechanics - Silent Running.mp4

One more thing.. this music video is a one off from a concert is there anyway to add this one to theAudiodb.
Miley Cyrus - Landslide.mp4


Not so bad as over 1800 music videos did scrape..

Thanks for any help.


👍 zag
Posted: 11 Jan 2022 11:14
zag
Posts: 229
Joined: 2020-07-14

Yeh known issue with the Kodi scraper....

Basically the Kodi scraper is not encoding the characters correctly during its search with the searchtrack.php API method.

As an example you can type the search into the URL bar and it will give you what characters its using.

https://theaudiodb.com/api/v1/json/##API KEY##/searchtrack.php?s=Guns%20N%27%20Roses&t=Since%20I%20Don%27t%20Have%20You

See how the apostrophe character has been encoded into %27 and spaces into %20. I'm unsure how python does it but this is the issue.

Posted: 11 Jan 2022 11:18
zag
Posts: 229
Joined: 2020-07-14

Track - Bee Gees - New York Mining Disaster 1941


https://theaudiodb.com/api/v1/json/#API KEY#/searchtrack.php?s=Bee Gees&t=New York Mining Disaster 1941
Result - Works as expected and returns this track:
https://www.theaudiodb.com/track/32727488

Suspected issue - Kodi scraper (unknown)

Posted: 11 Jan 2022 11:24
zag
Posts: 229
Joined: 2020-07-14

Title - Gary Puckett & The Union Gap - Young Girl


https://theaudiodb.com/api/v1/json/##API KEY##/searchtrack.php?s=Gary%20Puckett%20&%20The%20Union%20Gap&t=Young%20Girl
Returns - OK
https://www.theaudiodb.com/track/34517798

Suspected issue - Kodi scraper (& Ampersand recognition)

Posted: 11 Jan 2022 11:30
zag
Posts: 229
Joined: 2020-07-14

Title - Guns N' Roses - Since I Don't Have You


https://theaudiodb.com/api/v1/json/##API KEY##/searchtrack.php?s=Guns 'N Roses&t=Since I Don't Have You
Returns - OK
https://www.theaudiodb.com/track/32730952

Suspected issue - Kodi scraper (' Hyphen recognition)

Posted: 11 Jan 2022 11:34
zag
Posts: 229
Joined: 2020-07-14

Title - Toby Keith - Who's Your Daddy?


https://theaudiodb.com/api/v1/json/#APIKEY#/searchtrack.php?s=Toby Keith&t=Who's Your Daddy?
Returns - OK
https://www.theaudiodb.com/track/32785918

Suspected issue - Kodi scraper (? question mark recognition)

Posted: 11 Jan 2022 11:37
zag
Posts: 229
Joined: 2020-07-14

Title - Toby Keith - Who's Your Daddy?


https://theaudiodb.com/api/v1/json/##API KEY##/searchtrack.php?s=The New Seekers&t=Pinball Wizard / See Me Feel Me
Returns - OK
https://www.theaudiodb.com/track/33977634

Suspected issue - Kodi scraper (/ Backslash recognition)


Posted: 11 Jan 2022 18:05
Damorsoft
Posts: 20
Joined: 2020-08-14

Track - Bee Gees - New York Mining Disaster 1941


https://theaudiodb.com/api/v1/json/#API KEY#/searchtrack.php?s=Bee Gees&t=New York Mining Disaster 1941
Result - Works as expected and returns this track:
https://www.theaudiodb.com/track/32727488

Suspected issue - Kodi scraper (unknown)


OK, so it is the fault of Kodi, any suggestions
I have had these issues for a year or more.
Am I the only will search for new scraper maybe??




Posted: 11 Jan 2022 18:06
Damorsoft
Posts: 20
Joined: 2020-08-14

Title - Guns N' Roses - Since I Don't Have You


https://theaudiodb.com/api/v1/json/##API KEY##/searchtrack.php?s=Guns 'N Roses&t=Since I Don't Have You
Returns - OK
https://www.theaudiodb.com/track/32730952

Suspected issue - Kodi scraper (' Hyphen recognition)


I have 7 other guns n roses songs, all scrape fine, this one title does not.
e.g.
Guns N' Roses - Sweet Child O' Mine.mp4
Guns N' Roses - Don't Cry.mp4

Guns N' Roses - Since I Don't Have You.mp4 does not, for some unknown reason



Posted: 11 Jan 2022 19:44
Damorsoft
Posts: 20
Joined: 2020-08-14

Title - Gary Puckett & The Union Gap - Young Girl


https://theaudiodb.com/api/v1/json/##API KEY##/searchtrack.php?s=Gary%20Puckett%20&%20The%20Union%20Gap&t=Young%20Girl
Returns - OK
https://www.theaudiodb.com/track/34517798

Suspected issue - Kodi scraper (& Ampersand recognition)


The Mamas & The Papas - California Dreamin'.mp4
Simon & Garfunkel - Homeward Bound.mp4
Brooks & Dunn - You Can't Take the Honky Tonk out of the Girl.mp4
Gary Puckett & The Union Gap - Lady Willpower.mp4
All above scrape fine so " &" maybe not be the issue


Posted: 11 Jan 2022 23:42
Damorsoft
Posts: 20
Joined: 2020-08-14

Title - Gary Puckett & The Union Gap - Young Girl


https://theaudiodb.com/api/v1/json/##API KEY##/searchtrack.php?s=Gary%20Puckett%20&%20The%20Union%20Gap&t=Young%20Girl
Returns - OK
https://www.theaudiodb.com/track/34517798

Suspected issue - Kodi scraper (& Ampersand recognition)

The Mamas & The Papas - California Dreamin'.mp4
Simon & Garfunkel - Homeward Bound.mp4
Brooks & Dunn - You Can't Take the Honky Tonk out of the Girl.mp4
Gary Puckett & The Union Gap - Lady Willpower.mp4
All above scrape fine so " &" maybe not be the issue


Just a followup I tried the html coding suggested elsewhere in forum
Supertramp - It's Raining Again.mp4 changed to
Supertramp%20%2D%20It%27s%20Raining%20Again.mp4

Still no go.


Posted: 12 Jan 2022 00:28
Damorsoft
Posts: 20
Joined: 2020-08-14

For Songs that do not scrape..into KODI.

Bee Gees - New York Mining Disaster 1941.mp4
Gary Puckett & The Union Gap - Young Girl.mp4
Guns N' Roses - Since I Don't Have You.mp4
Supertramp - It's Raining Again.mp4

Solved by using .nfo files
get url for song eg Gary Puckett & The Union Gap - Young Girl.mp4
eg https://www.theaudiodb.com/track/32730952
save the url as a text file with .nfo extension
Gary Puckett & The Union Gap - Young Girl.nfo
read the into library.

Posted: 12 Jan 2022 20:47
zag
Posts: 229
Joined: 2020-07-14

Yeh I was going to say, use NFO files in case of it not scraping, I know its annoying though.

Just needs someone with some python knowledge to fix the scraper, we can't do much here.

EDIT: I wonder if the guns and roses thing is the track name apostrophe...

Posted: 12 Jan 2022 21:36
Damorsoft
Posts: 20
Joined: 2020-08-14

Yeh I was going to say, use NFO files in case of it not scraping, I know its annoying though.

Just needs someone with some python knowledge to fix the scraper, we can't do much here.

EDIT: I wonder if the guns and roses thing is the track name apostrophe...


Not sure but I do have 8-9 other guns n roses and they all scrape fine.

I tried that alternate character set but could not find an alternate apostrophe

Well I got everything now but miley singing landslide, will have to wait for a concert dvd where she performs that one.




Posted: 13 Jan 2022 18:57
Damorsoft
Posts: 20
Joined: 2020-08-14

Yeh I was going to say, use NFO files in case of it not scraping, I know its annoying though.

Just needs someone with some python knowledge to fix the scraper, we can't do much here.

EDIT: I wonder if the guns and roses thing is the track name apostrophe...


Not sure but I do have 8-9 other guns n roses and they all scrape fine.

I tried that alternate character set but could not find an alternate apostrophe

Well I got everything now but miley singing landslide, will have to wait for a concert dvd where she performs that one.




👍 zag

Showing 0 to 15 (Total: 15)