How do I dig out the "video" address in this web site?

[ToddAndMargo via curl-users]

Hi All,

On this web site:

https://rumble.com/vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack.html

Using cURL, how do I dig out / find the "Video" web site of:

https://sp.rmbl.ws/s8/2/r/j/n/E/rjnEb.caa.1.mp4?u=3&b=0

as seen with Firefox's <ctrl><i>:

https://ibb.co/Mn3C6yC
?

I can not find it in the source code of the web site.

:'(

Many thanks,
-T


-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.haxx.se/mail/etiquett

[Dan Fandrich via curl-users]

Post by ToddAndMargo via curl-users
https://sp.rmbl.ws/s8/2/r/j/n/E/rjnEb.caa.1.mp4?u=3&b=0
https://ibb.co/Mn3C6yC
?
I can not find it in the source code of the web site.

If you can't find it in the source code, then it's likely dynamically generated
with JavaScript. You might be able to figure out how to download some JSON from
somewhere and stitch together the URL yourself, but that will be tricky and
fragile. Another technique is to use a headless browser to execute the
JavaScript, then you can snatch the URL from there, but there will be a steep
learning curve to do that. If you're really lucky, then there will be a nice
documented API that will give you exactly what you need.

Dan
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.haxx.se/mail/

[ToddAndMargo via curl-users]

Post by Dan Fandrich via curl-users

Post by ToddAndMargo via curl-users
https://sp.rmbl.ws/s8/2/r/j/n/E/rjnEb.caa.1.mp4?u=3&b=0
https://ibb.co/Mn3C6yC
?
I can not find it in the source code of the web site.

If you can't find it in the source code, then it's likely dynamically generated
with JavaScript. You might be able to figure out how to download some JSON from
somewhere and stitch together the URL yourself, but that will be tricky and
fragile. Another technique is to use a headless browser to execute the
JavaScript, then you can snatch the URL from there, but there will be a steep
learning curve to do that. If you're really lucky, then there will be a nice
documented API that will give you exactly what you need.
Dan

Hi Dan,

firefox-87.0-12.fc33.x86_64

--> Tools
--> Web Development
--> Network

to chase down JSON calls. But it disappeared from
Firefox.

:'(

-T

-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: http

[Daniel Stenberg via curl-users]

Post by ToddAndMargo via curl-users
firefox-87.0-12.fc33.x86_64
--> Tools
--> Web Development
--> Network
to chase down JSON calls. But it disappeared from Firefox.

No it didn't:

-> Browser Tools
-> Web Developer Tools

(or just go ctrl + shift + i)

... then select the "Network" tab and reload the page.

[Jeremy Nicoll via curl-users]

Post by ToddAndMargo via curl-users
--> Tools
--> Web Development
--> Network
to chase down JSON calls. But it disappeared from
Firefox.

You should perhaps read the release notes for each new version
of Firefox. Those mentioned recently a slight reorganisation of
the menu structure for developer tools.

If you don't have FF ask you when it suits you for updates to be
downloaded and installed (in which case there's always a "what's
new?" link) you can also reach the release notes from Help ->
About Firefox.

Note also that the latest release has introduced a new button to
choose whether JSON formatted HTTP response and raw data
is shown in JSON format or otherwise.

[ToddAndMargo via curl-users]

Post by Jeremy Nicoll via curl-users

Post by ToddAndMargo via curl-users
--> Tools
--> Web Development
--> Network
to chase down JSON calls. But it disappeared from
Firefox.

You should perhaps read the release notes for each new version
of Firefox. Those mentioned recently a slight reorganisation of
the menu structure for developer tools.
If you don't have FF ask you when it suits you for updates to be
downloaded and installed (in which case there's always a "what's
new?" link) you can also reach the release notes from Help ->
About Firefox.
Note also that the latest release has introduced a new button to
choose whether JSON formatted HTTP response and raw data
is shown in JSON format or otherwise.

Cool!
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: http

[Petite Abeille via curl-users]

Perhaps youtube-dl could help. [1]

Or not.

# youtube-dl https://rumble.com/vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack.html
[generic] vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack: Requesting header
WARNING: Falling back on generic information extractor.
[generic] vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack: Downloading webpage
[generic] vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack: Extracting information
ERROR: Unsupported URL: https://rumble.com/vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack.html

https://github.com/ytdl-org/youtube-dl/blob/master/docs/supportedsites.md
https://github.com/ytdl-org/youtube-dl#how-can-i-detect-whether-a-given-url-is-supported-by-youtube-dl


[1] https://github.com/ytdl-org/youtube-dl
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.

[ToddAndMargo via curl-users]

Post by Petite Abeille via curl-users
Perhaps youtube-dl could help. [1]
Or not.
# youtube-dl https://rumble.com/vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack.html
[generic] vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack: Requesting header
WARNING: Falling back on generic information extractor.
[generic] vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack: Downloading webpage
[generic] vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack: Extracting information
ERROR: Unsupported URL: https://rumble.com/vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack.html
https://github.com/ytdl-org/youtube-dl/blob/master/docs/supportedsites.md
https://github.com/ytdl-org/youtube-dl#how-can-i-detect-whether-a-given-url-is-supported-by-youtube-dl
[1] https://github.com/ytdl-org/youtube-dl

Add support for rumble.com:
https://github.com/ytdl-org/youtube-dl/issues/10785
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https

[Petite Abeille via curl-users]

Post by ToddAndMargo via curl-users
https://github.com/ytdl-org/youtube-dl/issues/10785

Ah. The trick is to retrieve the embedded url:

# youtube-dl https://rumble.com/embed/vc34wl/?pub=4
[RumbleEmbed] vc34wl: Downloading JSON metadata
[download] Destination: Yann Tiersen - Comptine d&apos;un autre été (Guitar cover) - Amelie movie soundtrack-vc34wl.mp4
[download] 100% of 49.48MiB in 00:14

Of course, the embedded url itself is obfuscated in layers upon layers of javascript:

# curl -s https://rumble.com/vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack.html | pup 'json{}' | gron | grep 'https://rumble.com/embed/vc34wl/'
json[0].children[0].children[0].children[12].text = "[{\"@context\":\"http://schema.org\",\"@type\":\"VideoObject\",\"name\":\"Yann Tiersen - Comptine d'un autre été (Guitar cover) - Amelie movie soundtrack\",\"playerType\":\"HTML5\",\"description\":\"Yann Tiersen - Comptine d'un autre été (Guitar cover) - Amelie movie soundtrack Learn Spanish guitar with one of my guitar courses: Songs for Spanish and Classical Guitar: Loading Image...\",\"uploadDate\":\"2021-03-16T12:07:17+00:00\",\"duration\":\"PT00H02M34S\",\"embedUrl\":\"https://rumble.com/embed/vc34wl/\",\"url\":\"https://rumble.com/vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack.html\",\"interactionStatistic\":{\"@type\":\"InteractionCounter\",\"interactionType\":{\"@type\":\"http://schema.org/WatchAction\"},\"userInteractionCount\":48},\"width\":1920,\"height\":1080,\"videoQuality\":\"Full HD\"},{\"@context\":\"http://schema.org\",\"@type\":\"WebSite\",\"url\":\"https://rumble.com/\",\"potentialAction\":{\"@type\":\"SearchAction\",\"target\":\"https://rumble.com/search/video?q={search}\",\"query-input\":\"required name=search\"}},{\"@context\":\"Loading Image...\",\"sameAs\":[\"https://www.facebook.com/rumblevideo/\",\"https://twitter.com/rumblevideo\"]}]";




-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.haxx.se

[Petite Abeille via curl-users]

# curl -s https://rumble.com/vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack.html | pup 'json{}' | gron | grep mp4
json[0].children[0].children[0].children[11].text = "var $$={};!function(l,a)...

Obfuscated in layers upon layers of javascript. Sigh. Oh well.
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Et

[ToddAndMargo via curl-users]

Post by Petite Abeille via curl-users
# curl -s https://rumble.com/vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack.html | pup 'json{}' | gron | grep mp4
json[0].children[0].children[0].children[11].text = "var $$={};!function(l,a)...
Obfuscated in layers upon layers of javascript. Sigh. Oh well.

That is what I though too. I was so hoping I was wrong.

:'(
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.haxx.se/mai

[ToddAndMargo via curl-users]

Post by ToddAndMargo via curl-users
Hi All,
https://rumble.com/vepb2p-yann-tiersen-comptine-dun-autre-t-guitar-cover-amelie-movie-soundtrack.html
    https://sp.rmbl.ws/s8/2/r/j/n/E/rjnEb.caa.1.mp4?u=3&b=0
    https://ibb.co/Mn3C6yC
    ?
I can not find it in the source code of the web site.
:'(
Many thanks,
-T

Figured it out.

It is not in a json. It is in an embedded url:

</script><script
type=application/ld+json>[{"@context":"http://schema.org","@type":"VideoObject","name":
# "The Piano Soundtrack (guitar
cover)","playerType":"HTML5","description":"The piano soundtrack (guitar
cover)
# Learn Spanish guitar with one of my guitar courses: Songs for
Spanish and Classical Guitar:
# https://www.thespanishguitarhub.com/book2/ Amazon USA:
https://amzn.to/2","thumbnailUrl":"
#
Loading Image...","uploadDate":"2021-03-11T15:21:52+00:00",
#
"duration":"PT00H02M52S","embedUrl":"https://rumble.com/embed/vbxbfr/","url":"https


This is the embedded url from the above:
https://rumble.com/embed/vbxbfr/


And it contains the address to the video:

<script type="text/javascript">!function(l,a){function d(){return(new
Date).getTime()/1e3}var t,r,o,n,i,u,e=
#
"Rumble",f={F:0};(a=l[e]=l[e]||function(){a._.push(arguments)})._=a._||[],f.f={},f.b={};f.f["vbxbfr"]=
# {"fps":29.97,"w":1920,"h":1080,"u":{"
#
mp4":{"url":"https:\/\/sp.rmbl.ws\/s8\/2\/J\/3\/k\/D\/J3kDb.caa.1.mp4","meta":
...


This is the address to the video:

https:\\sp.rmbl.ws/s8/2/J/3/k/D/J3kDb.caa.1.mp4

And yes, you have to dump a bunch of back slashes.

-T








-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette