Ruby (on Rails) expert for Web Scraper / Web Scraping Job needed


I am looking for a multi-talented Ruby (on Rails) expert in web scraping. You are going to build an entire webapplication with Ruby (on Rails) - using the newest Rails 6.0.0 version and the latest compatible Ruby version. You will find all the links to Frameworks, Templates, Gems etc. below.

Target website.

The first website will be AirBnB's room / housing listings. Please take a very careful look at a few of those listings. AirBnB's is randomly generating id and name HTML-attributes to protect their site from scraping. The structure seems to stay the same though. You will always be presented with 300 search results - even in cities like New York City. To see all listings you have to adjust the price (increase, decrease). In addition to that, use the map to get all the results (zoom in and out, move the map).


• You will use the Kimura framework for scraping jobs (link below)

• You will create a "command script" that triggers an AWS EC2 server to be setup, configured and destroyed for every single scraping job (see tutorial / links below). This server will function as a proxy. You are going to use Terraform for that.

• Authorization through CanCanCan (Guest, User, Manager, Admin)

• Authentication through Devise (Basic User table with login is enough)

• Historization of all listings through Papertrail

Scraping job.

The scraping job needs to run when triggered (e.g. if I want to have a new city to be scraped). Also, the job needs to re-scrape an existing listing - the old version can be saved through Papertrail, or you just create a new listing and reference the old with the new one.


I will provide you with a Bootstrap admin template that needs to be used for the frontend. This Bootstrap admin template is built on top of the Bootstrap framework, SASS, jQuery, HTML5, and CSS. So you need to know how to work with those!


[login to view URL] (Ruby Framework)

[login to view URL] (Create AWS servers tutorial)

[login to view URL] (EC2 proxies)

[login to view URL]

[login to view URL]

[login to view URL]

Skills: Amazon Web Services, CSS, HTML5, PostgreSQL, Ruby on Rails

See more: ruby rails web service response types, ruby rails agile web development freelance dev book, ruby rails web reservation system, ruby rails job kochi, web service post xml ruby rails, job careers scraper scraping york web, ruby rails webmaster job description, rss web services ruby rails, setup ruby rails shared web host, web scraping job employment, web scraping job python, web scraping page scraping job posting, ruby rails web development, become ruby rails expert, ruby rails expert job, script scraping job classifieds web, ruby rails web scraping, web scraping using ruby rails, ruby ruby rails expert

About the Employer:
( 0 reviews ) Wem, United Kingdom

Project ID: #20015968

12 freelancers are bidding on average $525 for this job


Dear, I have 7+ years experienced in Web Development. I'm full stack Ruby On Rails developer, I have experience in developing the application like you want with, i can do this job very well. Specialties: Ruby More

$555 USD in 10 days
(71 Reviews)

Hello, I can do the job, please send me a message so we can discuss more. I am a skilled and experienced Developer having 7+ years of experience in ROR Web Development, Front-end Development, API Development, T More

$555 USD in 10 days
(26 Reviews)

Hello, I can do the job EASILY, your requirement is matching with my skills. I am a senior Ruby on Rails developer with 6+ years of extensive experience in building various responsive and beautiful websites. Pleas More

$300 USD in 7 days
(15 Reviews)

Dear Client. I see your job post and I'm sure this is my job. I have rich experiences in Ruby on Rails with React.js, Angular.js, Vue.js frontend. You can check out my skills reviewing these websites. [login to view URL] More

$500 USD in 7 days
(8 Reviews)

Hi, We've expertise in Ruby on Rails, Reactjs, Redux, Heroku, JavaScript - [login to view URL] and we'd like to work with you on your project, can we please discuss in detail? Currently, we're working on a marketp More

$840 USD in 20 days
(34 Reviews)

Nice to meet you. I've read the task description and can develop definitely. I'll provide you with the highly skill to complete this task in time. I'll also do my best for you. Please contact with me. Thank you ve More

$555 USD in 10 days
(12 Reviews)

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spide More

$500 USD in 7 days
(7 Reviews)

Dear Customer! I have built many scrapers. This is my favorite type of job. I am absolutely confident I can complete your project easily and on time. Ready to begin immediately and finish as soon as possible. Please co More

$500 USD in 14 days
(15 Reviews)

Hi there, Well, I’m a Senior Ruby on Rails Developer having an experience of 6+ years. I have technically rich hands-on developing applications in Ruby on Rails, Python, Wordpress, Jekyll and develops the APIs as wel More

$250 USD in 4 days
(8 Reviews)

Hello, Greetings for the day!!! I'm Front-end Developer with 5+ years of experience designing, developing, and managing a complex website. Specializes in various types of layouts, elements, grids, animations, res More

$500 USD in 15 days
(2 Reviews)

Dear Prospect Hiring Manager. Thank you for giving me a chance to bid on your project. i am a serious bidder here and i have already worked on a similar project before and can deliver as u have mentioned "I can do th More

$550 USD in 7 days
(0 Reviews)

Hey, My name is Ben, and I'm a software engineer from Hungary currently working for a US based startup. I'm currently working with Node.js, Go-lang back-end and React front-end stack. Previously I have been working wi More

$700 USD in 10 days
(0 Reviews)