We need a program/script in PHP and MySql that can take out data from web pages (Web crawling -also known as web scraping) and verify if it’s a webshop/ecommerce site.
The system must be on our server and work from there. All data and images must be save on the server.
You must provide us first how the dataflow will be make. It's important that the program is very easy to use for not technical person.
We upload an excel file with fx 10,000 domain names. Once the file is uploaded, we click on start and the system creates a new file with all needed data and images. If the website is a plain website without any shopping option we don’t save is.
If the domain have a webshop/ecommerce solution the program/webcrawler create a screenshot of the website and save all needed data and images.
We need to know:
All metadata (Meta descriptions first) :
Domain: [url removed, login to view]
Forwarddomain: [url removed, login to view]
url: [url removed, login to view]
faviicon (link and images):
Logon (link and images):
We pay after the system is tested and approved by us on our server.
34 freelancers are bidding on average $482 for this job
Hi Dear Client. I am expert Data Miner and Web developer. I have experienced with data mining and site crawling and automatics uploading. I can complete your job quickly and perfectly. Thanks for your time.
Ready to start the work to make the script in python or PHP as needed for scrapping the data from another website, we can discuss more over chat, thanks regards Arjun S.
Hi, I'm proficient in web scrapping and read the description for the project. I think it would be good to use casperjs for scrap I'd like to know the site details and other information Kind Regards, Tian