Web scraping ruby jobs
I need a Python expert with an ability to cover various functionalities as per the need. The project might involve data analysis, web scraping, automation, or could be anything else as per the project requirements. The ideal candidate should have: - Expertise in Python programming and its different libraries. - Experience with data analysis, web scraping, automation. - Strong problem-solving skills. While applying, please share: - Your past work related to Python programming. - Your Python programming experience level. - Detailed proposal of how you can assist in this project.
I am seeking an experienced developer to create a website scraper which is capable of collecting various pieces of data. This savvy to...to extract from () site: - Text content - Images - Product information - Address - Contact details - Videos It is essential for the scraper to perform its task on a daily basis. Yet, there won't be a need for the gathered data to be automatically integrated into a database. Ideal Skills: - Web scraping - Developing scraping bots - Programming knowledge - Manual data mining expertise Please only apply for this job if you have significant experience in creating web scrapers. This project requires a quick turnaround, so the ability to work under time constraints is key. Let's converse about specifications, and devel...
We are looking for a freelancer with strong web scraping experience for an exciting and challenging project. We need to gather specific data from multiple online sources and transform it into useful, structured information for analysis. Responsibilities: Utilize web scraping techniques to extract data from selected websites. Automate the extraction process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Beautiful Soup, Scrapy), Seleni...
I'm looking for a web scraper. Your application should include your experience in this field specifically. I'm interested in scraping the following data from a particular website: - Product details - Contact information - Pricing information Please only apply if you have solid experience in web scraping. We will have lots of different webscraping tasks in the following weeks.
I'm looking for a diligent professional who can implement an Internet price research mechanism for the electronic products listed within a .csv file. The deliverable I expect from this project is a separate report containing the price of each ...the price history. Key Responsibilities: - Extracting and updating the price information of electronic products from the Internet, based on the .csv file provided. - Incorporating a detailed report that includes the prices, a link to the retailer's page, and the price history of each product. Skills and Experience: - Proficiency in data extraction, research, and analysis. - Experience with web scraping tools. - Strong organizational skills to present the data in a clear, concise manner. - Prior experience with e-commerce o...
I'm seeking an individual who can create a one-time web scraper that can collect text, images, and tables from Website 1. The project involves: - Developing a tool to scrape text, images, and tables from the specified website. - Ensuring the tool can operate efficiently for a one-time scraping process. Key Skills: - Proficiency in web scraping tools and techniques. - Experience in scraping text, images, and tables. - Ability to create a custom scraper for a one-time scraping task.
I need a web scraper to extract specific data from various websites. The project will involve: - Identifying the necessary data to be scraped - Building a scraper to extract this data Ideal skills for this job include: - Proficiency in web scraping tools - Familiarity with web data extraction techniques - Ability to work with and extract data from various websites Please provide your quote for this project.
I'm looking for a skilled web scraper who can extract detailed information regarding the sellers on the Miravia website. Requirements: - Extracting Seller Data: The main purpose of this project is to gather information about the sellers on the Miravia platform (). This includes the shop_id shop_name Ivl1_cate_name product_number avg_price shipping_duration company_location phone_number email_address vat_number company_name shop_rating shipping_on_time % followers comments etc. I require 10,000 entries of data I require the data to be well-structured and organized into a CSV or Excel file for further analysis. Skills and Experience: - Proficiency in Web Scraping: The ideal candidate should have extensive experience in web scraping and data extra...
I need help with scraping specific information from urls (we will provide). The key details I need are the company name and contact information. Website Phone Email Brand Country Of Origin Total Entries: 1704 No research required, you just need to copy paste information from the fields onto a google sheet.
We are looking for a person, whether a person or a company, to help us conceptualize, organize and develop a web platform that contributes to the growth and income generation of our company and, if possible, to the community. We are at an early stage where we are exploring different approaches and possibilities for our project. We value the creativity, experience and technical capacity that an external team can contribute to turn our visions into reality. We are open to anyone who can contribute fresh ideas and innovative solutions. In short: We don't have any ideas for a web platform that helps the company earn income.
...planned and prioritized appropriately. Experience you’ll need ● Proven depth and expertise as a Senior Software Engineer or higher ● Extensive experience in software development, scripting and agile methodologies ● Experience using system monitoring tools and automated testing frameworks ● Highly skilled knowledge of selected programming languages (e.g. Ruby, Python, React) ● In-depth knowledge of relational databases (e.g. PostgreSQL, MySQL) and NoSQL databases (e.g. MongoDB) ● Familiarity with AWS and cloud native offerings ● Analytical mind with problem-solving aptitude ● Ability to work independently ● Ability to work cross-functionally with leaders in Architecture, QA, SR...
I am looking for a professional who has experience in data scraping to extract email addresses of senior level employees in the Building Industry, specifically from the United Kingdom. This task involves collecting the email addresses of 100 senior level employees. Key Requirements: - I need the first name, job title, and email address of each employee. - All the email addresses should be from the United Kingdom. The ideal freelancer for this project should have: - Experience in data scrapping and data mining. - Proficiency in tools and techniques for extracting data from web sources. - Attention to detail to ensure the accuracy of the collected information. - Familiarity with the Building Industry and the job titles associated with senior level roles in this field.
...proxy, and bash scripts for a personal project. This personal project is focused on web scraping. The successful candidate will be tasked with scraping product information, news articles, and social media data. Exemplary knowledge of proxifying requests through nginx and formatting bash scripts that interact with Nodejs applications is a requisite. Mandatory Skills and Experience: - Advanced proficiency in Nodejs - Extensive experience with nginx reverse proxy - Expertise in formatting bash scripts - Proven experience in web scraping, with emphasis on scraping product info, news articles, and social media data The ideal candidate must be able to present a portfolio demonstrating their competence in web scraping using techniqu...
I have an urgent web scraping task that needs to be completed as soon as possible. This project involves: - Scraping specified data from a list of instagram accounts. The information includes phone number and email of account and also phone number and email of account tagged in the bio description The ideal freelancer for this job should have: - Proven experience in web scraping - Proficiency in handling different types of data (text, images, tables) - An excellent track record of delivering projects on time. Please apply if you have the expertise and availability to tackle an urgent project.
I need a Python developer with a strong skill set in web scraping, database management, and video manipulation to create a code which can easily download videos from personal websites, save them to local web storage, and subsequently update values in an sqlite database. Detailed requirements are as follows: - Download videos specifically from personal websites. - Save videos internally for archiving purposes. - Saved videos should be in AVI format to maintain consistency. - Program should have a functionality of updating an sqlite database with relevant video details upon successful download. Ideal candidate should have a deep understanding of AVI video format handling as well as extensive experience interacting with an sqlite database using python. Familiarity ...
I need a freelancer to collect data from online. It is simple job of data search and collection from crowdsourcing website. Would provide spreadsheet with details, all you need to fill the details. We are into venture financing. Job Description: Name LinkedIn profile. contacts (if possible) Attached spreadsheet for your reference. Regards, R
Looking for an experienced Ruby on Rails back-end developer specialized in database management. The focus is to construct a medicine distribution system with a smooth, efficient process. - Key Requirements: * Extensive back-end development experience * Strong database management skills * Proven track record in Ruby on Rails
I'm looki...Telegram group via API integration but currently, it isn't purchasing as expected. Specifically, I'd require someone who could: - Identify and fix the issues that prevent it from purchasing and selling the scraped coins. - Make sure the bot interacts properly with the Latoken cryptocurrency exchange. This task would suit someone with a strong background in bot programming, API operations, web scraping, and experience dealing with cryptocurrency exchanges, particularly Latoken. Knowledge of crypto trading bots' operational peculiarities would be a major plus. Your task would be to get it back to working condition, ensuring all functions operate as they should. This job will evolve into continuous maintenance and development of bot's feat...
I'm looki...Telegram group via API integration but currently, it isn't purchasing as expected. Specifically, I'd require someone who could: - Identify and fix the issues that prevent it from purchasing and selling the scraped coins. - Make sure the bot interacts properly with the Latoken cryptocurrency exchange. This task would suit someone with a strong background in bot programming, API operations, web scraping, and experience dealing with cryptocurrency exchanges, particularly Latoken. Knowledge of crypto trading bots' operational peculiarities would be a major plus. Your task would be to get it back to working condition, ensuring all functions operate as they should. This job will evolve into continuous maintenance and development of bot's feat...
...script named “Main script for scraping and filling in a contact ” that executes subordinate scripts. For example, “Main script for scraping and filling in a contact ” might contain… import subprocess # Common base directory base_dir = "~/abc/xyz/" # Run script 1 (["python3", base_dir + "1 of 3 script for scraping and filling in a contact "]) # Run script 2 (["python3", base_dir + "2 of 3 script for scraping and filling in a contact "]) # Run script 3 (["python3", base_dir + "3 of 3 script for scraping and filling in a contact "]) In this example, almost all of your code would have been in… "1 of 3 script for scraping and filli...
...by a single person. For instance, commercial food blenders can blend thousands of vegetables in less than 30 minutes in a food processing environment, whereas a non-commercial blender cannot. - Check and list products that do not meet UK or EU standards. - List products that do not have a clear description, images, and videos. Your ideal skill set will include: - Profound experience in data scraping and mining - Familiarity with Shopify's product structure - Strong data organisation skills - Experience working with sales data and commercial filters Once the above has been completed, 1,000 commercial products need to be sourced, edited with video, pictures, and content, and added to the Shopify site. The order in which these products need to be added needs to be agreed upo...
I need an Excel 365 PowerQuery or VBA script that can fetch daily market data and handle potential data source interruptions or changes. Google Shhets example =INDEX(IMPORTXML("" & C31, "//span[@class='mod-ui-data-list__value']"), 1, 1). <Where C31 = Cell...example =INDEX(IMPORTXML("" & C31, "//span[@class='mod-ui-data-list__value']"), 1, 1). <Where C31 = Cell containing the Stock eg GB00B8XYYQ86, LU1033663649 or GB00B0CNH163 I need an identical function in MS365 Excel - either with PowerQuery OR VBA (preferable) Ideal skills: - Proficiency in Excel 365 and PowerQuery and VBA - Experience in web scraping and handling dynamic data sources. I am after a fixed quote for this project.
I am looking for someone experienced in web scraping and data collation. The project will involve scraping blog articles in HTML format and compiling desired information into an Excel file. Key Project Requirements: * The extraction will be from specified URLs, using their individual patterns for efficient and accurate scraping. * For each blog article, I need the title, the full text, and the publish date extracted. * This scraped data must be properly arranged in an Excel file for easy analysis. * List of articles is here: Ideal Candidate Expertise: * Proven experience in web scraping is a must, preferably with full understanding of HTML structures. * Proficiency in Excel and data organization. * Attention to detail to ensure accuracy of the ...
I require your expertise for an end-to-end testing of my Ruby on Rails application. Inclusive of all the components, which are Models, Controllers, and Views. Knowledge and usage of MiniTest, Simplecov, and Capybara for the testing frameworks are also required for this project. Key features for testing: - User Authentication - Database Queries - Form Validation The ideal candidate would be someone experienced with Ruby on Rails applications, fluent in the use of multiple testing frameworks, and specializes in identifying and rectifying potential pitfalls.
I need a fully bilingual professional (I will interview in English) to do some tasks for my agency such as: PR Outreach Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Wordpress And others You must be a fast learner, attentive, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes. This job will start part-time as a test period, after that it will be full-time. Payment for part-time during trial period: Fee: 250 USD Performance bonus: 50 USD Results bonus: 50 USD If your work complies with my quality requirements and you give more than asked, you’ll get performance and results bonuses each month. After a two-month...
I'm looking for a talented freelancer who can assist with scraping automobile ads from website. Key Requirements: - Scraping specific automobile ads. - Extracting ad titles, descriptions and prices. The ideal candidate should have: - Experience in web scraping. - A strong understanding of data collection from websites. - Attention to detail to ensure accurate extraction of data. Please note that the exact websites and the car details are not provided yet, so the freelancer should be able to work with changing parameters.
I want to scrape daily leads from LinkedIn Jobs, Indeed Jobs, , etc. The task involves extracting data from these job sites and exporting it to Excel sheets. It would be preferable to have some kind of automation that reduces human dependency in obtaining leads every day. If someone has already set up a similar process before, I would prefer that. Preference will be given to those who have previously performed lead extraction tasks for recruitment websites.
Create an executable scraper in Python that can extract the SKU (product) list from the following Indonesian online grocery apps: - Astro - Sayurbox - Segari The scraper must be IP-block tolerant, meaning if the scraper gets blocked, execution can be continued from the point where the last row of data was successfully extracted. Scraper Functions Function: list_category_tree Input: competitor_name(astro | sayurbox | segari), existing_csv (optional - CSV file to append to for continuing execution, if the scraper stopped or got IP blocked) Output: CSV of category tree with the following columns (scrape_date, URL, category name, position index, parent_category (null if top level)) Function: extract_sku Input: competitor_name, location (autocomplete place from google maps API), category ...
...opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of the scraped data. Customize the scraper to meet our specific requirements and adapt to any changes or updates in the target websites. Deliver the scraped data in a timely manner, adhering to project deadlines. What We're Looking For: Proficiency in web scraping techniques ...
...opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of the scraped data. Customize the scraper to meet our specific requirements and adapt to any changes or updates in the target websites. Deliver the scraped data in a timely manner, adhering to project deadlines. What We're Looking For: Proficiency in web scraping techniques ...
I’m looking for an experienced programmer who can create an automation script for a website. Key Requirements: - Automation Tasks: Your main job would be to automate various tasks on a website. This could involve anything from data entry to form submissions, and possibly content scraping. The specific tasks will be shared with you in detail. - Python Expertise: Given the nature of this task, your proficiency in Python is a must. If you have experience with automating websites using Python, that would be a huge plus. - Experience: Your application should showcase your relevant experiences and past projects. I’m looking for someone who has a proven track record in this field. Please include relevant examples of your past work in your application. Looking forward to heari...
we need a Web Scraping expert for a long term. will give you 1 site a day. per site $15. It's all about scraping product data like product title, description, image link etc.
...Key Features: - Efficient data scraping: The tool should successfully extract rental prices, occupancy rates, and property descriptions from Airbnb and AirDna. - Localized scraping: The data scraping should be focused on a specific city, which will be revealed once the project commences. Use of Data: The scraped information will be primarily used for market analysis purposes. The data will be instrumental in helping me understand the dynamics of the rental market within the specific city. Skills & Experience Required: - Proven experience in data scraping, especially from websites like Airbnb and AirDna. - Brilliant understanding of how to work with different types of data, such as numerical and textual data. - Strong ability to tailor the tool towards ...
...search of a skilled freelancer proficient in web scraping with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categories must be
I'm looking for an experienced API developer to help with syncing and scraping data from Confluence. Ideal Skills and Experience: - Proficient in Confluence API - Expertise in data synchronization and data scraping - Knowledge of handling Confluence pages, spaces, attachments, and content images - Able to preserve formatting and filter by date Key Responsibilities: - Develop an API integration for data synchronization - Implement scraping functionality for Confluence pages, spaces, and attachments - Ensure the scraped content maintains original formatting - Implement filtering logic to sort data by date
...and preferrably in Cyprus Malta U.K. and LATAM Brazil Key Requirements: - Focus on the Online Gaming Industry: The primary focus of this data scraping project is the online gaming sector specifically. All data should be relevant to companies operating within this industry. - Company Contact Information: The main data that I'm seeking here are Marketing manager and Business development email contacts for companies within the online gaming sector. This could include CEO founder and other decision-makers within these companies. Skills and Expertise: - Proficient in Data Scraping: The ideal candidate should have a strong background in web scraping, with prior experience in compiling email lists from online sources. - Industry Knowledge: A good underst...
I am seeking an expert in email scraping for the purpose of building a marketing database. The ideal candidate can efficiently scrape emails and the company names. Key Aspects: - Attention to detail to ensure all relevant emails are scraped accurately and company name is also with. - Quick turn around, the project should be completed within a month. - Extensive experience in email scraping and database construction. I need this in a google sheet document. The approx amount of names/emails is 12.000 - 14.000 on the website. I need a fixed price offer and also time frame for this.
I need a database for the UK market, with a focus on company names and Email ID. Key Points: - The project primarily involves creating a comprehensive database for the UK market - The main data points to be included are company names and Email ID's - Information can...names and Email ID's - Information can be extracted from Yellow Pages, Business Pages, Associations, Business Chambers and similar. - Accuracy of data, specially Emails - Sample File of Required database is attached - To start with we require 10,000 records. - Will pay INR 0.60 per record. Ideal Freelancer: - Prior experience in creating detailed databases - Proficiency in data gathering, scraping and organization - Familiarity with the UK market would be a plus Please include your relevant experience ...
Join our team as a Python Selenium Web Scraper responsible for developing scraping scripts using Python and Selenium. You'll gather data from diverse websites, utilizing your expertise in web technologies, HTML, CSS, and JavaScript. Key responsibilities include analyzing website structures, extracting and cleaning data, and collaborating with team members to integrate data into existing systems. Ideal candidates possess proficiency in Python, experience with Selenium, and a strong understanding of web technologies. This role offers competitive compensation, flexible work hours, health benefits, and opportunities for career growth in a dynamic, collaborative environment
PLEASE CHECK THE DESCRIPTION BEFORE SUBMITTING A BID Let's skip a boring description generated by AI. Actually, we are looking for a hero who helps us get all things about gambling in Spain, especially iGaming. We are not interested in bettings si...control this market, different funds and initiatives, if any, and current government and society aspects. 4. This point is about people. We are expecting useful information and data that will be valid for target audience research. Who, how, when, where, what for plays. Maybe blogs, streams, forums, groups or open data, public research. 5. General recommendation how to organise custom process(web scraping) in order to understand how to keep hand on a pulse of this market and be aware of all news, interesting content, etc. Th...
For this project, I require an expert who can efficiently extract text content from two distinct webpages...webpages and input my data into an Excel file organized by rows. Given that all types of data hold equal importance to me, of essence is for the professional to: - Accurately scrape all text content from the specified webpages - Ensure no data is skewed or omitted during this process - Neatly organize the data by rows in the Excel file The ideal candidate for this job should be proficient in web scraping tools and techniques, possesses an acute attention to detail, and is experienced in using Excel to ensure data is properly formatted and easy to analyze. Please note that minimizing errors during this process is critical, as the data collected will directly influence...
I am in need of a well-...need of a well-versed Python expert to assist in managing a Linux server. This project is task oriented and requires specific skills including: • Working with server data analysis • Implementing web scraping techniques • Establishing automation processes The role also demands a comprehensive understanding of Linux operations and the ability to print headers. A background in server security, setting up database servers and performance optimization would be ideal, but the focus is primarily on Linux server management via Python. Proficiency in Python, Linux, server data analysis and web scraping are must-haves. Experience in automation and server management will highly be appreciated. Looking forward to your knowledgeab...
I'm looking for an experienced web scraper to access and download specific information and images from the Used Inventory section of the White Rock Honda website. Here are the specifics of what I need: - Car make and model - Year of the car - Price of the car For each car listing, I need ALL available images downloaded. Furthermore, I require the images in JPG format. Candidates applying should have successful experience in web scraping, data extraction, and handling myriad images. Efficiency and accuracy are critical for this project.
I'm currently seeking a skilled backend developer who has proven expertise in Python, Java, and Ruby. I need someone who can guide me through whether to use the current source code or start from scratch, a decision that we can make together as the project evolves. As our project's main responsibility is to handle authentication and server configuration, the perfect candidate should be experienced in: - Setting up, managing, and sustaining server configurations - Handling various authentication tasks - Expertise in Python, Java, and Ruby - Decision-making skills concerning source code development This project will be rewarding for someone who enjoys tackling unique challenges and has a flair for problem-solving. If you're up to the task, please don’t ...
Looking for a skilled individual to undertake data scraping project. Key tasks will involve: - Focused on scraping 'Website 1' - Specific data requirement is 'price' - Data collection should be conducted periodically Ideal freelancers should be proficient in PHP, and have a track record in successful and ethical data scraping projects. Advise on suitable scraping schedule is appreciated. Efficiency and meticulous attention to detail are highly sought.
I require a professional with a high level of expertise in web scraping and API integration to assist with a critical project. Here are the specifics of the project: - I need you to scrape data from , a website where we dropship our designer clothing products. - Specifically, I need the following details scraped: Product names, Product Colour, Product Sizes In Stock & Not in Stock, Product Prices (Only Black & Grey Pricing, not red sale price), and Search Key. - The scraped data should be automatically updated on a daily basis. - The scrapped data should be integrated into our Shopify store through an API bot. The ideal candidate should have a proven track record of working with similar projects and should be able to tailor the solution to our specific needs. Ple...
I need assistance in compiling a large, extensive database o...- Name and contact details - Education and qualifications - Current job title and company Interestingly, these professionals should spread across various industry sectors such as Technology and IT, Healthcare and Medicine, as well as Marketing and Advertising. Particular skills and experience that would set freelancers apart for this job include: - Proven experience in data mining and data scraping - Familiarity with the mentioned industry sectors - Ability to accurately cross-reference and verify data - Excellent attention to detail Freelancers with extensive experience in maintaining data integrity and confidentiality will be seriously considered. Successful completion of this project could lead to long-term coll...
