Find Jobs
Hire Freelancers

Write Java web crawler for bookmaker website

$30-250 USD

Closed
Posted almost 7 years ago

$30-250 USD

Paid on delivery
For this mini project, we want you to parse [login to view URL], a sports-betting website. Under /football menu, /currentodds, you will find the events that we need to get data from : [login to view URL] . Click on the day (for example: "SAT 1") of one event, and the Event page will appear, where markets and selections are found. This we need to get from you. Note: We don't need the live events(the events that are in progress/ that are already started); only non-live events. We have attached to this project some java domain objects which you need to get from this website. The objects follow the following structure : tournament -> events -> markets -> selections. A tournament has more events, an event has more markets, a market has more selections. If you can't find the tournament, no worries, just take the rest. When your code finishes, we need to have a List/Set/Map or whatever of the mentioned domain objects. Steps to parse hkjc.com. 1. when clicking [login to view URL], in the console you will find this url : [login to view URL] In the response html, you will find : "var MSN=" text to parse ". Inside text to parse you find the event ids. This is step 1. 2. At step two, when you click on the date of the events, you will find in console, for each eventID you have an url : [login to view URL] Example: [login to view URL] Search for the same variable "var MSN=", and there you will find the markets + selections for each event. Example : betValue[[login to view URL]]=["['10-06-2017SAT2**HAD**Oita Trinita**FC Yokohama**1**0**x**x**x**JD2**115645','2.37**homecomb**1','3.05**drawcomb**X','2.37**awaycomb**2']"]; date HAD -> code for different markets (Each market has it's own no of selection) TEams / selection names Selection types, in this case 1/x/2 eventId 115645 selectionValue/odd for homecomb/1 selectionvaluefor drawcomb selectionvalue for awaycomb. Notes: The server [login to view URL] is in Asia, the urls will load hard if you parse it from Europe, so set connection timeout to 15 seconds. We need to get all data structure in less than 60 seconds, so i recommend you to load asynch all events urls from second step. We need the source code. This is an easy first project and if you are able to complete succesfully, there will be other similar projects for you in the near future. When bidding for this project, please make clear you have read and understand the project. Bids without specifics will be declined. Any experience in scraping bookmaker websites is very much a plus.
Project ID: 14297202

About the project

25 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
25 freelancers are bidding on average $151 USD for this job
User Avatar
Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/script for you. Thanks, Kimi
$138 USD in 3 days
5.0 (325 reviews)
7.7
7.7
User Avatar
Good day! I`m expert Java Dev with more than +7 years in It area. I have a success career in web/soft development using cutting edge Tech with latest frameworks in Java. Best Regards
$222 USD in 2 days
5.0 (42 reviews)
7.1
7.1
User Avatar
Hi! I can help you. I have one question though. Is Java a compulsory requirement? This can be done much faster with python. Please PM for details. Regards, Usama
$111 USD in 1 day
5.0 (36 reviews)
6.7
6.7
User Avatar
I use python language and scrapy framework. My scripts works on windows, mac or linux, but linux is preferably. I have more 300 finished projects (google scraping, facebook scraping, yellow pages, linkedinIn, amazon, webshops and other sites with lists of any items). I can scrape secured and protected sites, ii site block IP i can use proxy or TOR, also i can try avoid captcha. I can export data into json, xml, csv (excel), or any database (mysql, mongodb, mssql, etc). I can develop web-interface for management running script (start, stop, etc), using PHP, HTML, JS.
$155 USD in 3 days
4.8 (126 reviews)
6.5
6.5
User Avatar
Hi There, I would like to be considered for this project. I have 3 years experience in python, Django and web scrapping. I can complete this task in as per your requirement. Please give me a chance to prove myself. Regards, Fatima
$222 USD in 3 days
4.9 (103 reviews)
6.2
6.2
User Avatar
Greetings sir, i am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. Here is the reason. Why you should pick me? a) I am a very expert and have the same kind of experience of 5 years. b) I work very hard (16+ hours a day and 7 days a week) and also very fast so... it will be done very soon than most of the other providers c) And most important part is my policy: "I will give you (to my client) life time support (as long as you keep relation with me). And fix any bugs/problem without any cost. So, don't ever worry about me” Please sir, leave a reply ASAP, as I am waiting for your kind reply
$160 USD in 3 days
5.0 (41 reviews)
6.3
6.3
User Avatar
Hi, I am experienced software developer (more info in my freelancer profile). I have reviewed your project description and I am ready to complete this project for you. We can discuss all details in the private chat. Please do not hesitate to leave offline messages - I will answer as soon as possible. Looking to cooperate with you.
$200 USD in 4 days
5.0 (68 reviews)
6.2
6.2
User Avatar
Hi I have 3+ experience in web development. I have completed many task like this. I have strong knowledge of Mysql, Oracle, Database Design and as languages like Java, JSP, PHP, Javascript, Bootstrap CSS, Ajgular JS, HTML, CSS, JQuery etc . Thanks, DH
$155 USD in 3 days
4.9 (35 reviews)
5.2
5.2
User Avatar
I have good knowledge in below mentioned skills by you. I also have some certifications in Java. I can share some of demos with you if you want for better understanding. Currently I'm working on a banking project in an IT company using Java, jsp/jsf, hibernate, spring, software architecture and database programming. And most importantly, you will get your project done before the deadline.
$99 USD in 3 days
4.9 (41 reviews)
5.1
5.1
User Avatar
Hello, I'm a professional Java programmer, have been working in this area for 9 years now. I've scraped other sites successfully with jsoup library. However they weren't bookmaker sites. But your specification was very clear, actually impressive. I can design a program where you can set the number of threads to start, so based on the bandwidth you can tweak how many you need for it to finish within 60 seconds. However I can't guarantee, that the site hasn't got some kind of protection against mass scraping. Let me know if you interested in my proposal and let's discuss the details via chat. Thank you for reading! Regards, Zsolt
$200 USD in 3 days
5.0 (20 reviews)
4.3
4.3
User Avatar
Hello sir I can scrape the websites. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well.  Scraping/Crawlingworking experience of more then 8 year Analytics, Data Mining, Data Science, Machine Learning, Research I have working experience on- web scrapeing,Web Research, lead generation, data entry, data mining, lead collection. I have great experience of extracting information from websites i.e. I provide best solutions at fastest speed with the cheapest cost. Your satisfaction is my only priority. My skills is: Python,Data Processing,Data Entry,Excel,Web Scraping,Web Search,Data Mining,Data Science I am a highly skilled provider seeking an opportunity to leverage my expertise and demonstrate my high level of technical an administrative skills,I have completed 50+ projects in Python,Data Processing,Data Entry,Excel,Web Scraping,data mining,Data Science I can achieve the results that you are asking for. Please check out my portfolio and my past work on my profile through reviews,Looking forward from your end. Thanks.
$30 USD in 5 days
4.6 (7 reviews)
4.5
4.5
User Avatar
Hello, I am a full-time freelancer and do web scraping jobs only. I am creating automated data extraction systems for more than two years now. Any security can be bypassed. I have already scraped millions of records out of dozens of websites. Some of the websites were secured (banning IP address, showing no results, etc.). i can scrape any website using any technology (captchas, ajax requests etc.). I can provide scraped data in whatever format you want: csv, excel, xml, mysql etc. I can also provide you the program i used to scrape that website.I am developing my programs in python, java, .net, perl and you may run them on windows, mac and linux/unix machines. Thanks
$35 USD in 3 days
4.0 (9 reviews)
4.3
4.3
User Avatar
Hi, I am a serious developer who aims to provide high quality services. If you contact me, we can discuss more things detail and will be achieved with each other's purpose. Good luck for your business…
$155 USD in 2 days
4.7 (2 reviews)
3.0
3.0
User Avatar
Hi I just read your requirement. I have long experience in this field. I can provide you good solution. And I can work full time or part time for you. Thanks
$235 USD in 3 days
5.0 (2 reviews)
2.0
2.0
User Avatar
Hi I am Zubair, expert in java, web scrapping, Data mining, and web research. I have scraped over 1000 sites from last 6 years during which I have undertaken many challenging aspects. I have gone through your project and I am interested in your project. We can have a detailed discussion on the project over chat… Thanks and Regards Zubair Ashraf
$30 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello Sir Greetings We are competent and have adequate experience on Betting Solutions like ipl sports and have given solutions to various clients using betfair API All we need is an opportunity to talk further and demonstrate the same to you. Looking forward for your response with a ray of hope . Kindly give us an opportunity to work for you at our best. we have completed many work i will show you in PM. Thank you !! With Regards Diplfl
$250 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of NETHERLANDS
Utrecht, Netherlands
5.0
11
Member since Mar 19, 2007

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.