I'm trying to download a web page and store it locally to html file. I tried with wget (with hand without user agent):
wget -r -l1 -U "Mozilla/5.0 (X11; Linux i686 (x86_64)) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.75 Safari/537.36" https://www.hipercor.es/supermercado/0110120952600649-lays-gourmet-patatas-fritas-crujientes-original-sin-gluten-180-g/
but it got stuck to awaiting response...
Then I tried with curl, but I got:
curl -V www.hipercor.es/supermercado/0110120952600649-lays-gourmet-patatas-fritas-crujientes-original-sin-gluten-180-g
curl 7.54.0 (x86_64-apple-darwin18.0) libcurl/7.54.0 LibreSSL/2.6.4 zlib/1.2.11 nghttp2/1.24.1
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtsp smb smbs smtp smtps telnet tftp
Features: AsynchDNS IPv6 Largefile GSS-API Kerberos SPNEGO NTLM NTLM_WB SSL libz HTTP2 UnixSockets HTTPS-proxy
Any reason why it fails on this particular page? Thanks.
与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…