I have experience in building web crawler or scrapers i do web scraping using Python and Regular Expressions.
My expertise:
- Web scraping, crawling
- Data manipulations
- Python bots, Scrapy
- Unix OS (Shell scripts, Linux (Debian/Ubuntu))
For my work reference you can check what I am did and for more clarity we can do a short skype call..
Delivered product & applied technologies:
As the product blueprint was already given by the client, I had to ensure that it works exactly how it was thought. And I am able to do that closest to their expectations. Over the time, I asked to build components such as:
1. Scrappers - To fetch job listing on job provider websites.
2. Information Fetcher - To get the details of the course existing on education content providers. Information so obtained was then translated as per requirements to inject it on the platform’s database. Details include Title, Duration, Cost, Content, Link etc.
Technologies Used: Python(requests, BeautifulSoup), MySQL, Django, Elasticsearch etc.
Looking Forward for your kind revert!
Nitin