CHE Version 9.0 Screen Scraper

Cancelled Posted 2 years ago Paid on delivery
Cancelled Paid on delivery

I am URGENTLY looking for a new version (Version 9.0) of software to be written to be able to extract information from a specific website ([login to view URL]) using the search facility - [login to view URL] where q= a number which increments by 1 each time.

I want to set the start and end numbers for each search.

We have a very good piece of software already but it needs to be updated. It searches using multi-threading and brings back 10, 50 or 100 records at a time, selected by the Entries Per Round value on the dropdown (depending on which we choose) and then writes them directly to SQL. Please see screenshot of existing software.

A dropdown box is needed for England & Wales where the Company numbers are an 8-digit number from 00000001 upwards (the leading zeros are important), Scotland where the Company numbers begin SC and then have 6 digits from SC600000 upwards e.g. SC600600 and Northern Ireland where the Company numbers begin NI and then have 6 digits from NI600000 upwards. The program needs to update the record in the database if it already exists – it must not delete and re-add the record, it must just amend.

Currently searching is undertaken with numeric values only and the NI and SC are added after.

I need a tick box along with two value boxes which will allow me to choose how many records to search for before stopping e.g. 400 and then the time in minutes to wait until continuing the search with the next 400 – this is because Companies House now stop bulk searches from a single IP address. If the fields are blank, then these fields should be ignored.

A manual lookup option is needed to just allow a list of numbers to be looked up which are manually entered in the command line below:

The extracted data needs to be written directly to our MySQL database in the correct fields. Screen shot of what the existing software looks like attached and SQL schema also attached (although not all fields are written to by the program).

I would like an option where I can tick a box and the search will only add records between the Start Value and End value where the record does NOT currently exist.

The extracted data which is written to SQL is as below:

• Company Number

• Company Name

• Incorporation Date

• Address (split across 4 fields)

• Postcode

• First Directors Name

• SIC

Directors’ names need to be formatted as “Firstname Surname”

You must make sure that postcode goes in the postcode field

We will provide a new SQL database table for you to write to to test, so once completed you will just be able to write to the live database.

MySQL Data Mining Software Architecture Software Development

Project ID: #32240262

About the project

18 proposals Remote project Active 2 years ago

18 freelancers are bidding on average £539 for this job

ayesha0124

Hi there, How r u? I have had a look and i am sure that i can handle this project well as i have experience in Data Mining and MySQL. I have worked on similar projects before too. Please initiate the chat and discuss i More

£750 GBP in 12 days
(9 Reviews)
5.6
libxml1

Hi, I'm happy to help. Will you provide the source code of existing software so that it can be updated? I'm a full stack web developer with 7 years of experience. See my clients' reviews to decide if I'm the right pe More

£500 GBP in 7 days
(28 Reviews)
5.7
KimKirill

Hi, I just read your description carefully and I think that I can do your project enough. I am a professional developer with 7 years of programming experience for a multitude of different technology projects. To be hon More

£500 GBP in 9 days
(2 Reviews)
3.8
Syedhammadhafeez

Hi, Hope you are doing well. Thank you for posting this amzong job. I saw you post and gone gone through from your attached files and description and understood all of your given requirements. Let's discuss the project More

£400 GBP in 3 days
(7 Reviews)
3.1
nikitayuzhalin2

Hello I checked the description and very interested in this project. I am a software developer having great experience in developing Websites and mobile app for 9 years more. MySQL and Data Mining are my major skills t More

£555 GBP in 7 days
(0 Reviews)
0.0
aniqakhan201580

Hi There...! Note : I give you 25% off on my all services. So grabs this special limited discount offer. Let’s get to the Project. I came to know that your Looking a developer which have rich knowledge about MySQL More

£250 GBP in 1 day
(0 Reviews)
1.0
shramko79

Hello Client, I read the description carefully and I am sure I can do the job very well and I am having 6+ years of decent experience in this field and I can definitely work on it. Let's have a Quick chat to discuss y More

£500 GBP in 7 days
(0 Reviews)
0.0
OthmenBraham

Hi, i'm an expert in highly responsive website with optimale web technologies, please check my feedback then you will know. i will work this project with heigh scaping technolgie online, with buttons, progress bar, mul More

£500 GBP in 7 days
(0 Reviews)
0.0