In Progress

Scrapy web srcraper py modifications and enhancements

I have a Scrapy based scraper I need modified. I do not need you to do the actual crawling/scraping.

I only need you to modify it and make sure everything works perfectly.


1) Modify scraper to grab the correct website URL (currently pulling the wrong URL).

2) Once that is fixed, I need to scrape the website URL that the scraper found for an actual email address - then add the email address to the output file on the correct line.


1) Add error logs (all 5 levels in separate files).

2) Create additional final output file - sql (currently only csv).


1) Make sure everything is working and scraping properly.

2) Maybe one or two more mods but very very quick and minor adjustments. Will mainly depend on what I see when I test it.

Only very experienced with Scrapy need apply as I need this working perfectly. I am using Python 3.6 with Scrapy 1.3

Also, you won't be able to use this for your other projects or as a sample for your portfolio. It is confidential. If you have never worked on confidential projects and do not respect confidentiality, do not bid.

Lastly, do not send me a quote that is not real that you want to negotiate over chat. I will only consider a final project price.

Skills: Web Scraping

See more: web developer apply, web scrapy, how to greate web for apply google adsence, python, web scraping, scrapy python extract image web, web crawler modifications, python scrapy web scraping, web scrapy server, scrapy web, scrapy python web, writing web ad webside experienced programmer database environmentqualifications experience for , minor tableless css web page modifications, dear sir requirements web development company experienced php developers , dear sir requirements web development company experienced net developers , apply experienced transcriber, perl scrapy web, web caculator modifications, loan modifications web design, developing commerce web application security enhancements 2009

About the Employer:
( 1 review ) Beech Grove, United States

Project ID: #13046060

Awarded to:


I was working in a job recruiting company. my job was to crawl jobs from other job post the focus was to scrap employer's email for marketing purpose. my point is I am experienced in scrapy

$55 USD in 2 days
(0 Reviews)

12 freelancers are bidding on average $50 for this job


Dear Employer, I will scrape all the data for you using C#, Python, PHP, Nodejs, VBA, imacros etc. I have scrapped data and images from following website as well as APIs. I know how to bypass Captchas and how to More

$35 USD in 1 day
(122 Reviews)

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database More

$100 USD in 3 days
(63 Reviews)

Dear Sir/Ma'am, I am a Web research, Data Entry & Webs Scrapping expert. I checked and understood your requirements. I can handle this job very well to your appreciation. I can find and extract the informati More

$50 USD in 1 day
(155 Reviews)

looking forward to discuss further

$45 USD in 3 days
(62 Reviews)

Hello. I 've just read your post. I 'm very interested in your job and so I 'm sure I can do it perfectly. I 've enough programming experiences over 7 years. My skill is Web Scraping, C# programming. Let us kee More

$35 USD in 1 day
(57 Reviews)

Hello, how are you? Here is the best scrapper you are looking for. I've just read your project descryption and i am interested in it I have full experiences in web scrapping and i've already many scrapping projects s More

$50 USD in 1 day
(15 Reviews)
$60 USD in 1 day
(9 Reviews)

I have the required expertise for developing your project. Check my developed projects and reviews of my portfolio.

$30 USD in 5 days
(11 Reviews)

Hello, Your requirement match with my skills. I can provide you quality work. We are 3 people team and we will work for you with full dedication to give you good outcome on your project. We are new in freelancer so no More

$40 USD in 2 days
(0 Reviews)

Hi, I have 10+ years Python development experience. I am good at Python/Scrapy. please reply with full details for quick start. Regards, Michael

$50 USD in 1 day
(0 Reviews)

Check out my project. It is exactly as per your requirement. I assure that i will deliver your project within deadline. [login to view URL] Regards LOKESH

$55 USD in 2 days
(0 Reviews)