python - My kernel is stuck processing simple code (web-scraping)

Question

I'm trying to do some pretty simple web-scraping with beautifulsoup, and I am using the requests.get command, to fetch HTML data from a website. However, from this given website, my kernel can't seem to process the request, and my kernel gets stuck. Has anyone experienced this before and found a solution?

I'm simply trying the following:

r = requests.get('http://www.nasdaqomxnordic.com/etp/leverage-certifikat/info?Instrument=CSE192562')

question from:https://stackoverflow.com/questions/65541041/my-kernel-is-stuck-processing-simple-code-web-scraping

Answer 1

The problem is that, this website requires some headers to load , which you can pass in the request

as

>>>requests.get('http://www.nasdaqomxnordic.com/etp/leverage-certifikat/info?Instrument=CSE192562', headers={"User-Agent": "Mozilla/5.0 (X11; CrOS x86_64 12871.102.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.141 Safari/537.36"})
<Response [200]>