how do I download from this web site?

Discussion:

ToddAndMargo

2018-08-18 07:54:07 UTC

Hi All,

I want to download

jre-8u181-windows-i586.exe

from

http://www.oracle.com/technetwork/java/javase/downloads/jre8-downloads-2133155.html

According to Firefox's cliget, the address is:

https://download.oracle.com/otn-pub/java/jdk/8u181-b13/96a7b8442fe848ef90c96a2fad6ed6d1/jre-8u181-windows-i586.exe?AuthParam=1534577721_2ae0bad94b6341c2907ebf82aa395171

But how do I get the "AuthParam"?

I am stumped. How do I do that?

Many thanks,
-T

-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users

Jeremy Nicoll

2018-08-18 13:37:13 UTC

Permalink

How did FF get it for the session in which you used Firefox's 'cliget' feature?

Is it what happens when (as a user) you acccept the software licence? If so, your curl process will
have to mimic that stage first.

In my limited experience of doing something complicated with curl, you need to start at the
beginning - so maybe going to the oracle website pretending you've never been there before,
then see what happens at each necessary interaction, then find a way to replicate that in
curl. In my case that's meant using a scripting language to build each successive curl
request, and also to check that what comes back from each one has the expected return
code, no unexpected headers (for example no redirects), the expected set of cookies (ie
their names if not their values), and also do to some sanity checking on the contents of
any html you get, before (perhaps) parsing values out of that to plug in to the next
request.

It might be impossible, if the website uses a lot of javascript and requires a human being
to interact with it. You might get on better using an automation scripting package (the
sort of thing used to test that GUI applications still work) which will simulate a person
pointing and clicking on various things on a series of pages being displayed in their
browser - something like AutoHotkey or AutoIt.

--
Jeremy Nicoll - my opinions are my own.
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etique

bruce

2018-08-18 14:39:42 UTC

Permalink

HI.

Take what I type with a grain on salt, your mileage might vary. I
haven't gone to the site, no clue how it works.

If you want to create an auto process to generate/download content,
you more or less need to replicate whst the client/browser does with
the backend server. (I know, basic stuff -- duh!!

If you're running FF, install livehttpheaders as a plugin to be able
to track/see the network traffic for the entire process. You can then
select/download the "stuff" from the browser/server and track the
steps you need from examining the network data from the liveheaders
app.

Basically, you'll need to craft the curl+cookies. However, if you run
into a situation where the serverside is generating the content via
dynamic javascript, you're going to need to either be crafty and
somehow figure out what the appropriate curl+cookie action would be to
replicate the javascript action(s)... or you're going to need to
implement some sort of headless (chrome+sel+py) soution to achieve
your goals.

-bruce

Post by ToddAndMargo
Hi All,
I want to download
jre-8u181-windows-i586.exe
from
http://www.oracle.com/technetwork/java/javase/downloads/jre8-downloads-2133155.html
https://download.oracle.com/otn-pub/java/jdk/8u181-b13/96a7b8442fe848ef90c96a2fad6ed6d1/jre-8u181-windows-i586.exe?AuthParam=1534577721_2ae0bad94b6341c2907ebf82aa395171
But how do I get the "AuthParam"?
I am stumped. How do I do that?
Many thanks,
-T
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.haxx.se/mail/etiquette.html

-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Et

ToddAndMargo

2018-08-19 06:00:03 UTC

Permalink

Post by bruce
HI.
Take what I type with a grain on salt, your mileage might vary. I
haven't gone to the site, no clue how it works.
If you want to create an auto process to generate/download content,
you more or less need to replicate whst the client/browser does with
the backend server. (I know, basic stuff -- duh!!
If you're running FF, install livehttpheaders as a plugin to be able
to track/see the network traffic for the entire process. You can then
select/download the "stuff" from the browser/server and track the
steps you need from examining the network data from the liveheaders

Which one of these are you talking about?

https://addons.mozilla.org/en-US/firefox/search/?platform=Linux&q=live%20http%20headers

-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: h

ToddAndMargo

2018-08-19 22:12:08 UTC

Permalink

Post by ToddAndMargo

Which one of these are you talking about?
https://addons.mozilla.org/en-US/firefox/search/?platform=Linux&q=live%20http%20headers

Live HTTP Headers
or a version that works with your FF version

No such animal. But there is a "HTTP Header Live"
https://addons.mozilla.org/en-US/firefox/addon/http-header-live/?src=search
I will try that one.
Thank you!

Live HTTP Headers
View HTTP headers of a page and while browsing.
Rated 4.4 out of 5
Daniel Savard
48,848 users
Live HTTP Headers (clone)
View HTTP headers of a page and while browsing. This is an unofficial
"Live HTTP headers" clone, mainly to fix the Replay feature!
Rated 3.9 out of 5
Earthling
3,770 users

Found it:
https://addons.mozilla.org/en-US/firefox/addon/live-http-headers/

"Not compatible with Firefox Quantum"

Poop!

I am running FF 61.0.2

-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquet

ToddAndMargo

2018-08-22 16:44:13 UTC

Permalink

Figured it out:

--cookie oraclelicense=accept-securebackup-cookie

-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etique