A parser for the site
Hello.
Is there a site with access by login and password - http://costar.com/.
There are 5 types of search, including 4 types with different structure of search results.
For parsing, this site has a ready-made script in Python, but the speed of his work less than is necessary.
The required speed is not more than 5 seconds to parsing 1 record. Now it turns out 8сек, because of the indirect parsing with URL and method of clicks and conversions.
To facilitate the task and the script decided to log in to the website and transition to the search results is done manually.
Automate need only part with parsing the data and saving in CSV or XLSX format(sample file attached).
To access the website need a VPN, or private paid proxies with location United States, Los Angeles.
Alternatively, access can be granted from my PC or remotely via Anydesk Teamviewer.
Welcome any programming language. Run only under Windows.
Here is a video of the work the Python parser now https://youtu.be/SCVxXKs19ak between the query interval is 8 sec, need 2-5sec.