Find Jobs
Hire Freelancers

Customized, automated data scraping - energy production. .csv output

$15-25 USD / hour

Closed
Posted over 8 years ago

$15-25 USD / hour

We require a web scrape be built with the results automatically processed and saved to .csv format and saved in a company one drive folder. Specific variables of the website are of interest while others aren't. The site refreshes every 5 minutes. We require the data be pulled hourly, at the end of each hour. If the data could be formatted such that it matches our present csv format, that would be a bonus. [login to view URL]
Project ID: 9605992

About the project

26 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
26 freelancers are bidding on average $18 USD/hour for this job
User Avatar
Hi friend, I can build and setup a script to do this task for you. I worked on many similar projects. Feel free to check my profile for reference of the similar work. I will be glad if you choose to work with me on this or any future project and I am sure happiness will be mutual.
$25 USD in 24 days
5.0 (48 reviews)
8.4
8.4
User Avatar
Hi, my name is Sevinc. I read your "Customized, automated data scraping - energy production. .csv output" project descriptions carefully before bidding. I checked the url you provided as well...I got what you need and ready to go ahead as soon as we can clarify further project details. I intend to create an excel vba script for you, to download, process and save data as per hyour needs... I am 5-star excel and vba coding expert here at freelancer.com. Pls check my profile and feedbacks first to have some idea about the quality of my previous businesses. I had many similar excel tasks, including automated data extraction, aggregation and reporting, all achieved with 5/5 rating. Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too... I bid my best for you to start business, and I am ready to prepare an excel workbook template for you to check & validate, once you give me a reply...regards.
$20 USD in 20 days
4.9 (167 reviews)
7.0
7.0
User Avatar
Hi there! I am an expert American programmer specializing in webscraping with experience developing custom applications and collecting data from hundreds of websites for clients here on Freelancer. For this project, I would build a lightweight app written in VB.NET that runs on any windows PC and scrapes the site you specified hourly (per your request) and then outputs the data in CSV format and uploads it to your company one drive folder. I could do this in several days. If you choose to award me I would prefer we coordinate a fixed sum project for $250. Please send me a message so we can speak further about the project details! Thanks, Mike
$20 USD in 20 days
5.0 (84 reviews)
7.0
7.0
User Avatar
the site is updating after every 2 mins here i can code it in PHP, you've to just run it and it only takes 5-6 mins to scrap data and give you csv file only one thing, which i want to ask "and saved in a company one drive folder. Specific variables of the website are of interest while others aren't." please details me about it looking your response thx
$20 USD in 10 days
4.9 (151 reviews)
6.7
6.7
User Avatar
Hello! I am a professional programmer with over 7 years of web scraping experience using Python. I have read your project description, and I can create the Energy Market Reporting program you have described. To do so, I will use the libraries Mechanize (for web automation tools), BeautifulSoup (for parsing html), and Selenium (for working with AJAX or Javascript, if necessary). I have written very similar programs in the past, and I would be happy to show examples. Please contact me so we may speak further and so I can send files. Thank you for your consideration.
$22 USD in 10 days
4.9 (14 reviews)
5.4
5.4
User Avatar
Hi, I have ten years of experience in Excel . Please ping me back . Simple excel macro can do this job . I can provide you 100% accurate and flexible solution. Please check my past reviews. Thank You Regards Rishi
$22 USD in 5 days
4.9 (50 reviews)
5.0
5.0
User Avatar
Hi, I can come up with a solution for this using Scrapy (a scraping framework written in Python) and cron (assuming you will run this from a linux server). If you could attach you current csv format I can take a look at it to see if it's possible to emulate it.
$22 USD in 8 days
5.0 (12 reviews)
4.3
4.3
User Avatar
Hello I've 15+ years experience in web scraping and data entry. so i can do your work easily please send me message so i can start your work ASAP. Thanks
$15 USD in 3 days
4.9 (9 reviews)
4.2
4.2
User Avatar
Hi there, I have read the description & have looked into the link in the description....I have good web scraping reviews on freelancer...I have experience of web scraping scripts in Python & C#.. Looking forward to your response..
$15 USD in 10 days
4.9 (25 reviews)
4.4
4.4
User Avatar
This power data would fit nicely into an ETL (Extract, Transform, Load) process. ETL is a mature technology with excellent tools available. For example, my latest project was to read a data feed of insolvent companies and compare it to online trademark data. Each day it produces a new list of trademarks which have become available. This is just one example of how ETL works great at data processing and provides a much more robust solution than custom code. Most freelancers will quote you based on custom code which is hard to maintain and rigid to adapt as you grow. Here are some standard ETL functions we would use. - Scheduling (hourly) - Download the AESO data - Transform the AESO data into CSV - Store to the OneDrive using REST The tool I provide would also allow you to implement analytics, send email alerts, upload to FTP, compare against a historian or database, link to spot prices, etc. These modifications can be "drawn" into the ETL transform as additional ETL steps. If you are interested, we could do this as a fixed-price contract rather than hourly. The scope you have provided is clear and I can provide a direct quote. I am located in Alberta, Canada and have worked with clients worldwide for twenty years. I am an English speaking freelancer and can bring creativity, dedication, and a wealth of experience in the computing industry to your project. Thank you for your consideration. Please contact me to discuss my bid further. Best regards, Jay
$20 USD in 10 days
5.0 (3 reviews)
3.7
3.7
User Avatar
Hello! I understood the task and I can implement the required functionalities. I have great experience in performing tasks like this and I have positive feedbacks about it in my profile. After you award me this project you MUST NOT worry about task's implementation - only wait for the final completed result. All difficulties of task's implementation – are my responsibility. My price based on: 1. 100% guarantee of the task's implementation in accordance to the specification. 2. 100% guarantee of the task's implementation within the specified time period. 3. The support - after the task will be completed (if there will be any needs). Thanks.
$20 USD in 40 days
5.0 (2 reviews)
3.1
3.1
User Avatar
I design scrape scripts using python and VBA. I have a smart solution in mind for your project! Kindly provide your current CSV layout.
$16 USD in 4 days
5.0 (2 reviews)
2.9
2.9
User Avatar
Hello I have checked the site and untested in your Project Recently i have done a similar type of Job https://www.freelancer.com/projects/Data-Entry/Automated-listing-crawler-9360192.html The Program can be run after a certain period of time (exp: 1 hour or as you wish) Also this could be possible to format it as CSV or Text or any database Format Please give me a response to talk in details Regards Ratul
$15 USD in 30 days
5.0 (2 reviews)
2.4
2.4
User Avatar
Hello, We are a well experienced team of developers and Interested in your project. Simply let's discuss the project. We can write a php code as well for you to collect data from website and store into the database. as well as we can set that script to collect data with specific tie intervals. So that i can give you the time-frame for this project. Waiting for your response. Have a nice day. Thanks, Muhammad Jawad
$21 USD in 40 days
5.0 (2 reviews)
2.4
2.4
User Avatar
Hello, I read your project details and I would like to discuss the opportunity of working on this project. I am looking for a long term collaboration and I can start as soon as all the details will be provided. Thanks. Alex
$20 USD in 3 days
5.0 (1 review)
0.4
0.4
User Avatar
I am an experience web developer having good hands on latest relevant technologies used for the front end and backend development,i am experienced in doing the similar projects,i could be results a better resource for your project,looking forward to here from you for the further discussion. i could result a good resource for this work,i'll try to complete work as soon as i can with perfection.
$22 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have written a web scraper in python for this site and put into a csv format. I can give you the source code to run in a python interpreter or I can bundle the program into a windows executable. It could populate the file onto your local computer also onto a one drive using the onedrive api. This is my first project on freelancer and I am fairly excited as you are my first bid. Its cool that the data is for Alberta as I live in Edmonton, so its personally interesting for me. I have the scraping to csv file program finished less the specific fields your interested in. If you have any specifics you could let me know before the bidding closes that would help me finish in the very near future. This project should take me no more than 5 hours to complete. example of current .cvs output: Cloverbar #1 (ENC1),48,0,0 Cloverbar #2 (ENC2),101,0,0 Cloverbar #3 (ENC3),101,0,0
$15 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi There, I am an expert Web scraper. I have read through the job details extremely carefully and I am absolutely sure that I can do this project with the highest standards and in timely manner. Kindly share all the details so that I can review and quote you the best. Looking for your revert, Preeti
$15 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
This Amigoz, I Can do , for this with my team I have above 6 Years good experience The following Field of Business Management, Project Provider, Data Entry, Data Scarp, And Also i can work As Per New project of who r willing to provide with me, Ready to work Employer terms and Conditions with good Time Frame, & We can communicate 24/7, Achievement ,.. For Humans No Limits to do our Achievements Thanks, Amigoz News
$15 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, My name is Waheed and i offers all types of Data Entry services, Excel to PDF or PDF to Excel Data Conversions, All types of Internet Research services. ..........................................................WHAT I OFFERS TO YOU............................................................. If you are looking for Data Entry or Internet Researcher with Good English or Basic Internet work and Computer Skills worker then i am the Right person for you who's always delivers the work on time. I am a highly talented Ms. Word, Ms. Excel and Ms. Power Point looking to be hired. I am a totally freelance worker that's why I am available 24 hours support. I am available in weekend also. I can work 40+ hours per week. I am here to provide quality services to my client with latest technology at extremely reasonable cost. My motive is to make my employer happy. I would like to ask you more questions about your project for the best understanding of exactly what you are looking for. In future please don't hesitate to contact me with any opportunities. ............................................................THANK YOU................................................................
$15 USD in 40 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of SOUTH AFRICA
WEST KELOWNA, South Africa
5.0
1
Payment method verified
Member since Dec 16, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.