I need a piece of code that correctly emulates a http post using python to a specific website for web scraping. The website utilizes javascript to post the parameters. The program will use python 2.7 and I will supply the basic parameters (url and a sample search).
The end product must return the correct updated request.
The end product may only be 20 lines.
there are some browser modules that allow javascript to run on it. Actually they create real instances of browsers. Why not try to open the site with these browsers and run javascript on it?
I have done this for many times. I can provide working solutions.
I am looking forward for your consideration.
hello,
I have years of experience in python and web scrapers. (please check my profile)
I can do the task in an hour or a day (depends on how complex is the response!)
Let me know if you're interested