Data mining vs web scraping jobs

...You will only be required to generate a list of followed accounts' IDs for each user that is provided - The data you collect will be used to predict trends in user behavior and preferences Ideal Skills and Experience: - Proficiency in data scraping, particularly from social media platforms - Familiarity with Instagram's API and limitations Further notes - I am very familiar with scraping in general myself. There are many obstacles with Instagram - namely, the endpoint where the 'following' list is found requires a logged in sessionid. I have a very large list of users (11 million overall) that I need this data found for. Honestly, I'd prefer to have the methodology to scrape this data rather than have it all scraped as...

I'm looking for an experienced IoT developer who can create an Arduino-based system that triggers actions or alerts based on scraped text data from a website. Key Responsibilities: - Develop a system using Arduino, Raspberry Pi, and ESP32 microcontroller - Implement website scraping functionality to extract specific text content - Design a mechanism to trigger predefined actions or alerts based on the scraped data Ideal Experience: - Proficient in Arduino programming - Familiarity with ESP32 microcontroller and Raspberry Pi - Experience with website scraping techniques - Ability to integrate scraped data to trigger actions or alerts on an IoT system Please note that my preferred programming language wasn't specified. Feel free to suggest the...

I'm in need of help with fetching influencer data from Instagram, YouTube, and TikTok. The specific data needs are not completely defined at this moment, so the ability to adapt is essential. The end goal of this data collection is currently open-ended. Key skills and experience needed: - Deep understanding of Instagram, YouTube, and TikTok - Experience in data mining or web scraping - Proficient in data analysis - Flexible and adaptable work approach.

For my project, I need a freelancer with strong skills in data scraping and extraction, particularly with textual content and figures, from a specified public website - Tasks: - Effectively pull relevant textual content and figures - Ensuring the scraped data is comprehensive, accurate, and neatly organized Excel Skills: - The data collected must be meticulously stored in an Excel database - The organization method within the database is by entity An effective freelancer must be detail-oriented, proficient in using Excel and knowledgeable about data scraping techniques from public websites. A background in handling similar tasks would be advantageous. Accuracy and neatness in data organization are also paramount. Please indicate you ...

I need to extract pricing information and contact details from a Chinese website for market resear...- The project also involves obtaining contact details from the website. This would typically include email addresses, phone numbers, names of suppliers, and any other relevant contact information. - It is important that this data is collected accurately and in a structured format for use in supplier outreach. Ideal Skills: - Proficiency in web scraping and data extraction. - Familiarity with Chinese websites and text. - Experience in market research and supplier sourcing. - Ability to organize data for easy analysis. - Attention to detail and accuracy in data collection. If you have experience in these areas and are comfortable navigating Chi...

I'm seeking a developer to help me create a system that can archive web-based content, including text and images, for offline viewing. Key Requirements: - Archive text and images: The system should be able to save text and image content from websites. Use appropriate tools like HTTrack, Wget, or WebCopy to mirror the website. - Single archive process: The content will require archiving only once, as it won't be updated frequently. Ideal Skills: - Proficient in web scraping: Ability to extract and save content from websites. - Experience with archiving systems: Previous work on systems that save web content for offline use. - Knowledge of offline storage: Understanding of how to save and retrieve content without requiring an internet connection. This...

I'm urgently looking for a web scraping expert who can help me gather information from various medical service provider websites. Key Requirements: - Extract doctor names, contact information, medical service details, and additional data such as phone numbers, specialties, and participating plans. - The information should be pulled from three specific websites - Website 1, Website 2, and Website 3. Your deliverable: - The scraped data should be compiled into a CSV format for easy analysis and integration into our system. Ideal Skills: - Proficient in web scraping and data extraction - Advanced knowledge in handling and exporting data formats like CSV - Experience in scraping medical websites or similar domains would ...

I am looking for an expert freelancer to develop a software that will expedite my web scraping process. I have identified the need to automate if possible the solving of image-based reCAPTCHA challenges. Key Requirements: - Practiced experience in automation and CAPTCHA solving. - Familiarity with various web scraping technologies and debugging will be vital to this project's success. The ideal freelancer for this project would have a proven track record in web scraping, specifically with handling reCAPTCHA challenges and previous experience with 2captcha will be considered an advantage. Let's bypass these hurdles together and get the necessary data!

I need a professional to scrape specific information from an one page weblink and present it in an Excel file. The details will include: - IMAGE LINK - Product Name - Price1 -Price 2 - Link to Product Page - Stock Availability (I lager) The freelancer that can deliver fast will be prefered.

We are looking for someone who has knowledge in web scraping and building mobile apps. Please do not apply if you don't have experience in both. As we are in the final stretch of our MVP (native iOS and Android mobile app), this individual will help us finish a critical feature in the app (i.e., web scraping) + other small features and help us launch in app stores. Please take a look at the attached high level SOW before you submit the bid AND include your time commitment (hours/week) and hourly rate. We will select candidates based on the bids. The detailed SOW will then be shared with the selected candidate/s before finalizing timeline & budget. Acceptance criteria will be provided once we move forward with the selected candidates. Tech s...

I am seeking a skilled data scrapper to retrieve specific information from 'Website 1'. a full comprehension of various types of data is needed for a successful scrape. The types of data required include: - Textual content - Metadata Specifically, within the textual content, I require: - Titles - Descriptions - Prices - Linked products - Related products An ideal candidate would demonstrate extensive experience in data scraping, with a keen focus on retrieving accurate and relevant information. A good understanding of e-commerce sites and familiarity with Metadata and APIs will be advantageous. Please, I urge you to utilize ethical scraping methods in accordance with the rules and regulations of the source website. Looking forwa...

...Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. T...

I'm seeking an experienced and knowledgeable data scraping professional to collect specific information from three major platforms - RERA websites (specifically Maharashtra, Telangana, Haryana, and Delhi), Google, and Justdial. Here's what I am looking for: Details to Scrape: - Name - Mobile Numbers - Locality - City - Address - Pincode Platforms: - RERA Websites (Maharashtra, Telangana, Haryana, Delhi) - Google (DSA and Loan Agents data) - Justdial (DSA and Loan Agents data) The ideal freelancer for this job will be highly experienced in data scraping and will be able to deliver the results in an organized manner. Proficiency in scraping from Google, RERA websites, and Justdial is particularly important. Delivery Format: -...

...provide a scraping sample (2-3 lines) aligned with the instructions below. Scrape data from this website: Filters to be used: - "CAR": 203 and 16348 - "Anno di Concessione": 2020, 2021, 2022, 2023, 2024 - "Importo": select "Compreso fra 100000 e 200000", "Compreso fra 200000 e 500000" and "Maggiore di 500000" We need to scrape the results from all the possible combinations of the above filters. The outcome table should contain all the columns of the initial table AND all the data contained inside each result (you can access in it by clicking on the magnifiying lens). To be clear: - identificativo di riferimento - numero di riferimento - titolo misura - tipo misura - COR - titolo progetto - data...

I am in need of a logo for a startup mining consultancy, and I would like it to be minimalist in style. The main colours I am looking to be incorporated are Green and Grey. I have had a play around online and managed to make something that is close to what I am looking for which I have attached, I would like the writing to be a bit clearer than this example. The company logo would need to be embroidered on shirts so keep this in mind. Key requirements: - Minimalist style (similar to attached) - Include the company name 'Ready Mining' - A unique symbol that could be used stand alone logo for the company on things like job ads or letterheads without the company name and still recognised. - Incorporation of Green (however colour not super important at this stage and h...

I'm looking for a skilled data scraping professional to assist me with a project. I had a working script in Python using an API, but the company implemented a Cloudflare protection that is always blocking me. You would need to find a solution how this could be circumvented (e.g. proxies) and large amounts of data be scraped. If you are interested, I am happy to provide more details privately.

I am looking for a person who can do data mining for contact details including the whatsapp number of ielts institutes own which are located in Haryana, Punjab, and Gujarat Job Responsibilities 1 you have to update daily google sheet 2 it is upto you how you do data mining, by calling or by some software 3 the contact details you will deliver were used by our telecaller team 4 we want to contact the owner regarding to our ielts product I will create and release milestones on every Saturday, please bid your weekly milestone budget not monthly

I'm seeking a Python developer with experience in Playwright to complete my existing code. Key tasks include: - Reviewing the existing codebase. - Identifying and fixing bugs. - Completing partial functionalities if any. Ideal candidate should have: - Prior experience with Python (Playwright). - A strong understanding of web scraping and UI automation. Please provide examples of your past work in Python (Playwright) along with your bid.

I need a tool that can search multiple sheets in an Excel workbook and copy specific rows to a new sheet based on manual selection. The core requirements of the tool are: - Searching across multiple sheets to find specific data. - Allowing me to manually select a specific number of rows from the search results for copying. Given these criteria, the ideal tool would be: - Capable of working with Excel files. - Providing a user-friendly interface for easy manual selection. If you have experience with these requirements, please reach out.

Must be able to meet via Microsoft Teams I'm looking for a Python developer who can provide me with hands-on assistance in my project development within VS Code. Key Tasks: - Code Debugging: I require assistance in debugging my Python code. The ideal freelancer will be able to analyze and troubleshoot my code to identify and fix any issues. - Package Installation: I'm using Django, Flask, and NumPy in my project, and I need help installing these packages correctly within my development environment. - API Integration: As part of my project, I need to integrate several APIs into my Python code. The successful freelancer will be able to guide me on how to implement these integrations effectively. Python Version: - I'm working with Python 3.x, so experience with this v...

...in Zambia for a Bitcoin mining operation. The chosen freelancer will help me with the following tasks: - Research and identify suitable land for Bitcoin mining in Zambia - Find out the rental cost of land suitable for Bitcoin Mining - Find out the the cost to install 250kva transformer in the proposed Land - Find out the power cost per kilo-watt hour when using 250kva transformer - Consider the best location in terms of cost-effectiveness for the Bitcoin mining operation Skills required for this project include: - Strong research skills, particularly in the Zambian market - Excellent negotiation abilities - Knowledge of the cryptocurrency industry, particularly Bitcoin mining - An understanding of how to calculate and assess power consumption for B...

...in automating daily pricing updates from a specific website. The script should pull the pricing information and update it into our system. Key Requirements: - Develop a script that can extract data from a website and automate the pricing update process - The script should be able to run daily, without manual intervention - Ensure the script is robust and can handle occasional changes in the website's layout without breaking Ideal Skills and Experience: - Proficient in web scraping and data extraction - Experienced in script automation, particularly on a daily basis - Familiarity with handling data within a business context - Ability to create a reliable and sustainable solution, accommodating for potential changes in the website's structur...

I'm looking a freelancer based in Texas, specially in Rockdale Texas Here's what I need: - **Rental Land Rate Optimization:** Since cost is a critical factor, I need a freelancer who can find me the optimal land rate for my Bitcoin mining business. This would involve conducting thorough market research in Texas to determine the best rental rates available. 500 to 1000sqm need open land size with available electricity for bitcoin mining. - **Natural Gas Cost:** . Search for lowest cost (wholesale cost) of natural gas delivered to the proposed site(land) by truck per 1000 cubic feet or per 1 Dekatherm. Skills and experience that would be ideal for this project include: - **Logistics Expertise:** A deep understanding of the logistics industry is essential to help...

I require a professional data scraper to scrape multiple websites. Key tasks include: - No limitation on type of data scraped as this was not specified. - Scraping must be done across multiple websites, specifics will be provided upon project commencement. - All data should be delivered in Excel spreadsheet format. Ideal skills and experience: - Prior experience in web scraping across multiple diverse websites. - Proficient in using different scraping tools. - Strong understanding of Excel and data parsing. - Attention to detail and commitment to high quality, error-free work.

We are in search of an experienced Web Scraper to uncover price points across multiple websites and categories for us. Key Requirements: * Compile pricing information from the following platforms: Amazon, , , , , , , , , , nykaaman.com. * The scraping project should cater to several products and categories rather than specific ones. * Implement scraped data directly into the backend of our website using PHP. Ideal Skills: * Proficiency in web scraping scripts and tools * Deep knowledge and experience in PHP programming * Familiarity with the aforementioned websites' structures and processes * Ability to handle data scraping projects from a wide range of product categories

data collection as per sample web scraping fro

...au/explore/find-an-architect There are 566 architect contacts for Sydney, NSW, Australia within 100km. I requirements: - Extracting: I require the following contact information to be extracted: Business Name, Email, Phone number, Full address separated by suburb, postcode and state. - Formatting: All extracted data should be structured and organized into an Excel spreadsheet. Ideal Skills: - Web Scraping: Proficiency in web scraping tools and techniques is essential. - Data Entry: Experience with data entry and extraction. - Attention to Detail: Accuracy in capturing and organizing contact details is crucial. - Excel Proficiency: Ability to create and format an Excel spreadsheet effectively. - Communication: Regular communication an...

Hello, I have a simple WordPress plugin with 300 lines of code, which scrapes a website. Problem: The website has activated cloudflare and since then the plugin no longer extracts the data. If you can tell me your budget and we will start working immediately. I'll send you the Zip so you can modify it and return it to me, I'll test it and if everything works we'll finish the project. URL of the website that I scrapped:

I need a wide range of details about accommodations ...about accommodations on , downloaded for analytical purposes. This data should include room availability, pricing, customer reviews, accommodation rate variances, photos, addresses, and phone numbers. - Essential Skills and Experience: 1. A strong understanding of web scraping tactics and data extraction. 2. Proficiency with 's platform and data structures. 3. Data organizing skills to deliver finalized data in CSV format. The outcome I envision is a well-organized CSV file that can further my research and analysis goals. A successful delivery will require attention to detail to ensure all requested information is included. Please bring forward your innovative solutions ...

I am in need of a professional data collector/detective who is well-established in Australian and Asian markets. I require verified contact information of 300 specific companies across these regions who own Hotels. The list of companies will be provided upon project initiation. Some contacts will be easily found in Linkedin, others will need deeper research. So please don't apply if you only use Linkedin for your research. Skills & Experience: • Familiarity with the business landscape in Australia and Asia • Proven experience in data mining and data verification • Effective communication and swift execution Your role involves not only finding the precise contact details but also ensuring their validity. Please pitch your proposed meth...

I need a proficient developer to create a Firefox add-on that can scrape specific data from multiple websites.

I'm in need of a versatile data engineer who can tackle various aspects of data analysis, AI development, and data engineering. - The ideal candidate should be proficient in Python and knowledgeable about Machine Learning algorithms, as these will be crucial to the AI development aspect of the project. - Sound experience in working with structured databases (e.g., MySQL, PostgreSQL) is essential. Introduction: Join our team as a Data Engineer, where you'll have the opportunity to contribute to cutting-edge projects and drive significant advancements in data analysis and machine learning. We are looking for a highly skilled professional who thrives in a dynamic environment and is passionate about transforming large volumes of data into a...

I have a need for a comprehensive listing of Oracle EBS custo...collect for each organization, I'd like to see the following: - Company Name - Contact Person Name - Contact Person Email. The ideal candidate for this task would be someone who is proficient in data mining and possesses broad knowledge of Oracle EBS customers in the manufacturing, retail, automotive industry. Prior experience in CRM database creation would be an added advantage. It's essential that all information gathered adheres to privacy and data protection laws, ensuring a legally compliant list. So, a freelancer with a keen understanding of these laws would be highly preferred. Accuracy of data is of top importance, therefore meticulous cross-checking is needed for each entry. ...

Looking for a skilled individual to create a script to automate the process of data scraping from The project involves: - Extracting comprehensive data from the specified website. - Covering all possible details that can be scraped from the website. - Ensuring accurate and efficient collection of data. The ideal candidate should: - Have significant experience in data scraping and automation. - Have strong knowledge of back-end technologies. - Be able to quickly understand and map the structure of the targeted website. Your proposal should illustrate your experience and approach to this kind of task. Please also include an estimated timeline for completion.

I have a back end code for a project of phishing website detection…it is a CNN vs LSTM comparative study …but I want a person who can develop a UI for that project as well as who can explain that code to us

I need a professional who can scrape product prices from Starbucks and Dunkin Donuts' websites. The main focus will be Coffees, Beverages, and Food items. Key Requirements: - Scraping: Extract product name and price from two apps/websites. - Data Organization: Provide the scraped data in a clean and organized format. Ideal Skills: - Proficient in Web Scraping: Experience in scraping data from various websites. - Data Management: Ability to organize and present scraped data efficiently. This project will require attention to detail in maintaining the data integrity throughout the scraping process. The scraped information should be accurate and up-to-date.

I need emails from these companies of CEO ot anyone else working in financials, sales, or partnerships. Data scraping from rocketreach of the emails of the people that you can find with relevance from these companies in the image. Excel sheet with company name in the rows and in the 3 columns full name, email and position in the company

I'm looking for a skilled developer to create a one-time scraper for the TruePeopleSearch website. The scraper should focus on extracting addresses and phone numbers, and the output should be in CSV format. Key Requirements: - Develop a scraper for TruePeopleSearch - Extract...skilled developer to create a one-time scraper for the TruePeopleSearch website. The scraper should focus on extracting addresses and phone numbers, and the output should be in CSV format. Key Requirements: - Develop a scraper for TruePeopleSearch - Extract addresses and phone numbers - Output the data in CSV format Ideal skills and experience for this project: - Proficient in web scraping - Experience with scraping tools and techniques - Proficient in CSV formatting - Understand...

I'm looking to create a detailed list in Excel from the website AND filtered by clicking on 'Hardware' under 'Products' which is on the left side in the 'Filter' section. The list should have t...'Filter' section. The list should have two columns - the first for the Company Name and the second for the Description available on the website. Key Requirements: - Copy the Company Name into Column 1 and the Description into Column 2 of the Excel sheet. - Description should be directly copied from the provided URL. Ideal Skills and Experience: - Proficient in Excel and web scraping. - Attention to detail to ensure accurate data transfer. - Previous experience with similar projects would be advantageous.

I'm on a mission to gather as many logo images as possible for my brand research. And that's where you come in. My project specifically revolves around: - Extracting high-quality logo images from a specified web app. - Ensuring the integrity of the image quality during the extraction process. This job would be a perfect match for a freelancer with extensive experience in: - Web scraping and data mining. - Handling different image file types and ensuring quality preservation. If you've completed similar data extraction projects and are versed in the art of web scraping, you might just be the perfect fit! So come on board, and let's revolutionize brand research together!

We are in ne...experienced Python Developer who specializes in Large Language Models (LLM) and Retrieval Augmented Generation (RAG) tasks. Key Tasks: -Your main responsibility will be to create a custom AI Chatbot by combining LLM (Large Language Model) with RAG (Retrieval-Augmented Generation) using custom data. General Requirements: - Demonstrable proficiency in Python and understanding of LLM and RAG is a generally necessary. - Familiarity with Chatbot modeling, data analysis, model building, web scraping, data extraction, and task automation will be regarded as additional advantages. This project provides an excellent opportunity for individuals deeply interested in language models and augmented generation. Interested and qualified bidders are ad...

I require a proficient developer to create an SQ...require a proficient developer to create an SQLite database. The database must be populated with data extracted from three specific websites. The data should include text, images and numbers. Once the data extraction is complete, the database shouldn't require continual updating. However, the DB should be able to expand at a later stage. You are creating a starting point. I am looking for a one-time service. Key requirements are: - Creation of an SQLite database - Data extraction from websites (text, images, numbers) - No need for regular updates to the database The project needs to be completed as soon as possible. Ideal skills for this job: - Experience in SQLite - Proficiency in web scrap...

I’m seeking a data expert to scrape a specific database and transfer all available fields into an Excel (.xls) file. The database consists of approximately 150,000 entries. Each record includes data such as name, business name, contact information, date of foundation, etc. Ideal Skills: - Strong experience in Web Scraping - Proficiency in transferring data into .xls format - Attention to detail to ensure all available fields are captured Purpose and Deliverable: - The objective of this project is to use this information for data analysis. - The final output will be an Excel (.xls) formatted file containing each scraped database entry. Operation Specifics: - You would be required to locate and scrape the database by Zip codes. - A full...

I have a college assignment where I need to perform a data analysis task using Python. I have a specific dataset that I will provide. Key requirements: - Data Analysis: The task involves in-depth data analysis - not just basic statistical analysis but also some intermediate data processing and visualization. - Python Proficiency: You must be skilled in Python for this project. Experience in using Python for data analysis is a definite plus. - Dataset: I will provide the dataset which you will be working with, so you should be comfortable working with provided data. this is the question : In this question, you will use the dataset made available to the public by: S. Moro, R. Laureano and P. Cortez. Using Data Mining for Bank D...

I'm looking to hire an experienced data scientist or researcher to gather data on trending topics from Twitter. Here's what you'd do: - Leveraging Twitter's API or any robust scraping tool, you'll gather and record data around trending topics globally or as requested. - After collection, these data will need to be organized in a clear, concise and easy-to-read format. Skills & Experience: - Experience with data collection on social media platforms, particularly Twitter - Strong understanding of Twitter's API or proficient in web scraping techniques - Ability to interpret and analyze collected data effectively Please only bid if you're comfortable and experienced with large-scale so...

We're working on promoting and expanding our VS CRM solutions across several African countries. Our primary focus is on Nigeria, South Africa, Kenya, and many more. Visit before bidding. Key Goals: - Developing partnerships: We're looking to forge alliances with local IT companies and propel our marketing forward. We believe aligning with businesses having specialized knowledge could provide mutual growth opportunities. Ideal Candidate Skills and Experience: - Experiences in IT company partnerships - Brilliant networking skills across African markets, particularly in Nigeria, Kenya, and South Africa - Strong background in promotional strategies and CRM marketing - Previous experience with VS CRM would be an added advantage. The ideal freelancer will help u...

...content. Here are the specifics of the project: - Data Extraction: The scraper should be able to collect data from a specific website. This data will be in the form of text and images. - Update Frequency: I require the data to be updated once. This means that the scraper should be designed to pull the data once and not re-visit for updates. - Data Format: The extracted data should be saved in a CSV file. This is the preferred format for the end result of the scraping process. Ideal Skills and Experience: - Proficiency in Python: A strong background in Python programming is essential. - Web Scraping Experience: Previous experience with web scraping tools and techniques is highly desired. - Data...

As an experienced developer myself, I am seeking an expert Python developer with a deep understanding of the Flask framework to collaborate on my project. Here's a glimpse of what I have in...command over Python programming language with expertise in Flask. - Experience in developing & managing complex Python applications. - Advanced Python coding skills are needed, as experience matters most in this kind of project. Although I haven't decided on specific tasks or functionalities yet, your advice and suggestions would be highly appreciated. There could be future opportunities for web scraping, data analysis, and automation ahead. Interested parties, kindly share your portfolios of relevant exposures in Python, specifically Flask based projects. Looking...

I'm in need of a skilled freelancer to scrape data from car Website . The specifics of the data extraction are as follows: - I require product details and price information from the site. - The main task involves capturing a comprehensive car database, including all car brands and models present on the site. The focus here is on the complete car directory, not just specific brands or models. If you have experience in web scraping, particularly in the automotive sector, this project is for you. Accuracy and completeness are key, as the success of the project hinges on the comprehensive nature of the dataset. I attached RAR file (Scraping code). by running this script, fetching yourself full database of cars. pocketbase queries to supoprt filter...

...regarding our system architecture, schema, and API’s to enhance our overall user experience. Key Responsibilities: - Collaborate closely with the founders, project managers, and designers to drive product roadmaps and address business challenges effectively. - Develop and uphold our SDK utilized in third-party React Native, iOS, and Android applications. - Conduct reverse engineering of public web APIs and manage authenticated accounts programmatically. - Make strategic decisions about technical direction, architecture, and scalability as we expand our user base. - Take ownership of the entire software development lifecycle, from design and implementation to testing, deployment, and maintenance. - Contribute to shaping our engineering culture and processes as we expand ou...