In Progress

Invoice Data Robot (data capturing with OCR, data processing and machine learning)

The objective for this service is to enable a user to snap a photo of a paper invoice and have the service pay the invoice for them. For this to work the service needs to capture the relevant data from the paper invoice for the service to create a payment on behalf of the user with the data required. The scope of this project is _not_ to deal with the payment, but to capture, analyze, process and store the data for further use by other services.

There are 4 main items we need to capture;

The amount due to be paid

The account number the amount should be paid to

The reference number for the payment

The due date

With this data captured the service has the data needed to initiate a payment (the payment part is out of scope for this project).

The objective for this project is to create the components needed to identify the invoice data, capture them and prepare the data for further use.

The delivery needs to consist of a simple mobile application written in react native or firebase that works as the user interface. A server side application that exposes the APIs needed for the app to send and receive data with the server. A data store or big query setup for data storage.

This is the proposed functional flow of the service:

1. The user fires up the app on their phone launching the camera to scan the invoice

2. Once the whole paper is inside the frame the camera automatically captures the document

3. The first thing we do is to look for language indicators, identifying what language is used to aid the OCR in identifying where the 4 elements are located on the invoice (this refers to a model where such indicators are stored, using ML to optimize how accurately we can find the 4 elements). Once language is identified we can assume all 4 elements are named in a logical way and look for variations of the names; amount, account, due date and payment reference or invoice number.

All such processing can and should happen on the server while the app waits for the server to finalize the analysis. There are 3 possible outcomes;

A. All data is found. In this case we serve them back to the app for the user to validate. The user click Approve (or can edit the captured data manually) and the data is posted to server as a payment ready to be made with the relevant data.

B. Some data is found. In this case we serve up the data found but leave the fields not found open. The user is promoted to tap the empty fields and can then do 3 things;

C. Enter the data manually

Skip the field (the payment will be posted to server without this field)

Scroll through the scanned image to find the data needed and choose it (effectively training the model by human intervention)

If no data is found we allow the user to scan again or scroll around in the captured image to show the server where the data is locates (one by one "where is the account number?", "Where is the amount?", "Where is the due date?", "Where is the invoice number?").

The intention is that this simple scanning and validating invoice data app can be used to train the model looking for the 4 data points in any paper invoice in any language. And we atribut the model with new data as we capture it.

The project needs to written in Python (server side), deployed on Google Cloud, and I will provide you with the development environment and a series of invoices for training.

Skills: Google Cloud Platform, Machine Learning (ML), OCR, Python, React.js

See more: learning data processing, data mining machine learning projects bids, web based data mining machine learning projects bids, machine learning data entry, invoice scanning and data capture, data entry scanning software, invoice extraction api, extracta new zealand, invoice data extraction, artificial intelligence for data entry, machine learning invoice recognition, machine learning image processing project, data classification machine learning matlab, data processing machine learning python, Data analysis, interpretation and processing for a regression (Machine learning) , machine learning data mining data science , machine learning, data analysis, machine learning, data scientist, C, C++, Android, Python, machine learning, data analytics, linux, device drivers, python, machine learning, data science

About the Employer:
( 7 reviews ) NØTTERØY, Norway

Project ID: #17962035

Awarded to:


I am a Machine Learning, Python developer and have professional skills in this Artificial Intelligence, Data Mining, Data Science with working experience of 4 years in it. Also i hold a degree in computer science and More

€481 EUR in 8 days
(7 Reviews)

23 freelancers are bidding on average €603 for this job


Hello I read your specification carefully. I'm an OCR expert. I have developed many OCR app. You can see some demos at my portfolio. If you are interested please contact to me. Thanks.

€555 EUR in 10 days
(20 Reviews)

Hi, Dear. Nice to meet you. I've read your post carefully. I'm Machine Learning expert. Could you discuss more details on the chatting room. Regards. Fang G.

€555 EUR in 10 days
(36 Reviews)

Hello. I have your request deeply and I have enough experience to complete your project. I am full stack mobile app developer as well as OCR engine developer. I have enough experience in developing invoice control a More

€555 EUR in 10 days
(29 Reviews)

-Interested Project. Pro Google Cloud Platform, Machine Learning, OCR, Python, React.js expert. Best result in time----- [login to view URL] I read your description very carefully. I am very interesting for your project be More

€500 EUR in 5 days
(53 Reviews)

Hello, could you please send me some sample from the training data. does it include different format for invoices in term of style, font type, size..etc? Regarding my experience, I have more than 10 years experience in More

€1100 EUR in 24 days
(20 Reviews)

It seems like an interesting project. I would like to discuss all the requirements with you, so I can mark the scope of this project. Please also note that final estimation will be provided once all the requirements wi More

€555 EUR in 10 days
(10 Reviews)

Dear client, Thanks a lot for taking your precious time to read my message. After browsing your job description, I am very interested in your project and I believe I’m qualified for the task. Regarding OCR & M More

€555 EUR in 10 days
(31 Reviews)

I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without changing my bid More

€600 EUR in 6 days
(27 Reviews)

Hello How are you? I have seen your description carefully and very interested in your project. I have rich experiences in the OCR development. Do you know the Tapcanner, smartscanner? You can find it on app store More

€300 EUR in 10 days
(18 Reviews)

Hi my name is Anthony, I am a 20+ year exp. Full statck developer located in North Bellmore. I saw your job posting carefully and I believe that I would be the perfect fit to complete your project. The following ar More

€555 EUR in 10 days
(19 Reviews)

Dear Norway Client This is React-Native app. First, need to implement scanner functionalities about 4 factors as you mentioned. [login to view URL] Using google platform, p More

€750 EUR in 10 days
(7 Reviews)

Hi there. I am very interested in your proposal. I can instantly help you with your starting project with a successful completion. As a professional python developer, I ensure for a perfect ongoing project. You wil More

€700 EUR in 10 days
(1 Review)

Hello! I am a python developer. I looked at your project and it seems interesting. I have all necessary skills required for this project. Ping me to discuss in detail.

€500 EUR in 2 days
(23 Reviews)

This is a huge project. I'm currently working on extraction of data from the invoice and see this as an extension of that project. I can get this done in a month's time, using the above preferred technologies (includin More

€700 EUR in 20 days
(3 Reviews)

We have 11+ years of experience in software development. We have developed 400+ projects and the research paper in the field of Machine Learning, Artificial Intelligence and Image processing (GIS), Network, SEO based W More

€1000 EUR in 20 days
(7 Reviews)

Hello sir. I'm excited about your project, because I've really rich experience in OCR & Machine Learning Programming. I've developed many projects similar to yours and excellent skills. If you award me, I'll provide More

€500 EUR in 10 days
(10 Reviews)

I have been working as data scientist for more than 4 years during which i implemented numerous machine learning algorithms to solve varied business problems. Moreover, to gain other domain expertise, i have been activ More

€750 EUR in 15 days
(2 Reviews)

Hi.I am a Visual Basic .NET programmer with 14 years experience(others say this too but I can show proof). This is not another automated bid like the ones you see around. I have read the description of your project an More

€740 EUR in 10 days
(0 Reviews)
€555 EUR in 10 days
(0 Reviews)

I believe i can do this for you. As your project description indicates i am able to achieve this with good output.

€250 EUR in 30 days
(0 Reviews)