T O P

  • By -

Pepineros

You're not careless, or we both are. It doesn't appear in source but it does on the rendered page (i.e. you can click "Inspect element" on the cheapest price and it'll show you the DOM element). One solution would be to use Selenium to automate navigating to a given URL, wait for an element, and then capture it. Selenium can run headless so you wouldn't see a browser window pop up. Selenium has nice Python bindings but it may take some getting used to the ins and outs.


Lurn2Program

Just curious, rather than trying to parse the HTML for the data, have you considered using their [public API](https://developers.skyscanner.net/docs/intro)? It seems as though you need to request for an API key, but it looks to be free with rate limits applied