Web scraping database jobs

**Purpose:** T...Features:** - Ability to securely log in to each supplier's B2B system. - Ability to instantly capture and process data. - Conversion and integration of the captured data into a format suitable for the user's system. 1. **Backend Development:** Required for system integration and data processing. 2. **Data Scraping/Web Scraping:** It is important to extract data from suppliers' B2B programs. 3. **API Development/Integration:** To securely integrate with suppliers' systems and retrieve data. 4. **Database Management:** It is a critical skill to organize, store and always keep the captured data updated. 5. **Security and Encryption:** It is important to ensure the security of users' data, especially to protect keys and pas...

I need a professional to gather 750 contacts from three different Houzz pages. Requirements: - The information required for each contact is Name, Email, Phone number, and business name. - The contacts should be organized by location. - There is a need for the contacts to be from the following specific ...number, and business name. - The contacts should be organized by location. - There is a need for the contacts to be from the following specific Houzz pages: Kitchen Designers and Renovators, Bathroom Designers and Renovators, Design and Construction. Preferably, the contacts should be from a specific location which I will provide. The ideal freelancer for this task should have experience in web scraping and data collection. Accuracy and attention to details are also key ...

I need fresh email addresses from users in Germany! These should not come from web scraping or web crawlers, but from real users who have participated in contests, signed up for newsletters, or requested information on lead platforms, for example. The data must be current and deliverable. Only data from users in Germany is sought, in both the B2B and B2C sectors. B2C email addresses (freemailer addresses) are preferred. Acceptance will be based on a trial run in batches of 50,000 to 100,000 pieces (expandable), with a total volume needed of 10,000,000 pieces!

I'm seeking a data-savvy freelancer with a deep understanding of Instagram, to create a well-organized spreadsheet of micro influencers. There are three crucial components needed for each influencer: I AM NOT LOOKING TO CREATE FAKE SOCIAL ACCOUNTS - I WANT EMAIL ADDRESSES TO CONTACT THEM TO HELP CREATE CONTENT> 1. Instagram Handle 2. Number of followers 3. Their Email Search Criteria - total of 2000 records acrsoss - Dieticians and Nutritionists - Pregnancy and infertility - Mums / Working Mums 500 - 5000 followers only. Australian-Based Accounts

I'm in need of an experienced Talend Studio developer to assist with a database migration project. Key Project Details: - **Data Sources**: The project entails integrating data from various databases. - **Primary Goal**: The primary focus of the project is to migrate the data accurately and efficiently. - **Data Processing**: The data migration will primarily be through batch processing, therefore real-time processing is not required. Desired Skills: - **Talend Studio Proficiency**: A strong understanding of Talend Studio and its capabilities is essential for successful project completion. - **Database Integration Skills**: Experience working with database integration is a must. - **Data Migration Experience**: Previous experience with data migration projects w...

...freelancer to assist us with a high-speed web scraping project. Our existing web scraping scripts have been developed and deployed, but we need to optimize the scraping process to achieve faster data extraction rates. Responsibilities: Optimize existing web scraping scripts for speed and efficiency. Deploy and manage web scraping scripts on platforms such as Scrapy Cloud, Apify, AWS Lambda, or Azure. Implement techniques to ensure high-speed data extraction (e.g., parallel processing, distributed crawling, efficient request handling). Monitor and troubleshoot scraping processes to ensure uninterrupted operation. Collaborate with our team to understand project requirements and adjust scraping strategies as nee...

I need a mobile app image scraping tool to help me collect images for product cataloging purposes. The ideal candidate should have experience in app scraping and image processing. Key Requirements: - Scrape images from a mobile app - Categorize images by brand - Develop a tool for product cataloging Ideal Skills: - Proficient in web scraping - Strong background in image processing - Experience in app development Please note, the primary use of these images will be for product cataloging. Being able to categorize them by brand is essential.

I'm in need of an experienced data scraper that can help me in extracting data from Yel... Thailand, Japan, and Indonesia. Key Details: - I require a full listing of all businesses from various sectors within the mentioned countries. This includes but not limited to Restaurants, Hotels, Clinics, and Retail Stores. - The extracted data should be well-organized, including data such as business names, contact information, and addresses. Skills/Experience: - Proven track record in web scraping with a focus on Yellowpages. - Familiarity with the Yellowpages platforms of Malaysia, Thailand, Japan, and Indonesia. - Capability to handle large data sets and deliver the information in an easily usable format. - A high level of accuracy in data extraction to ensure no important d...

...skilled Python developer to assist me with a project involving data analysis, web scraping, and potentially machine learning. Your role will be crucial in helping me to derive insights from a large dataset and extract specific information from the web. Key Responsibilities: - Conducting in-depth data analysis using Python - Implementing web scraping scripts to collect relevant data - Potentially developing machine learning models (based on your expertise) While the client did not specify the exact libraries, the ideal candidate should be well-versed in Python programming, particularly with libraries such as Pandas and NumPy. Familiarity with Django, although not mentioned, could be a plus if the project expands to web application development....

I am in need of a professional web scraper with Python expertise, who can scrape data from a website(with filter Options) and convert it into Excel format. Key Requirements: - Expertise in web scraping with Python, including dealing with website search filters. - Proficiency in data extraction and manipulation. - Experience in converting extracted data into Excel format. Please note that the specific website and the type of data to be extracted has not been provided as it was skipped by me. The project can be detailed further with the selected freelancer. If you have the skills and experience in this area, please do apply.

...it's fourth generation of ownership. My Dad started using a database program called Formula Coster on his Apple IIc to figure out how to correctly price our baked goods based on ingredient costs, labor costs, overhead, etc. The program also allows us to store the formulas and makeup instructions for all our products based on the dough batch and individual pieces from the dough. It's a simple program that we still use today, but are afraid it may not continue to work very long. Other programs exist, but are all cloud based and require subscriptions with features we do not need. I am seeking an adept database developer to either continue work on an in-progress database or commence anew based on existing requirements. This database is intended for e...

HELLO. PLZ READ THE TASK DESCRIPTION CAREFULLY. IF YOU DON'T UNDERSTAND WHAT IS ABOUT PLZ DON'T BID. I'm in need of a f...,boo,kpop2 ,kmap,kpop3 (**2)We need to extract from ALL today's news a set dedicated to our subjects of interest (lets say Band1, Band2 & Artist1) in a form of short review with a link to the full source OR in a form of a full news text Choose which is easier to implement. (***2)It could be excellent to experiment with Native Korean web sources (full site or rss scraping) but i doubt any good local LLM can do it in Korean language giving out results in English (cloud LLMs maybe?). (*3) 8/16 CPU, 16Gb Nvidia VRAM, 48GB RAM (or if you will do API based cloud solution it can be a hosted VM) MAX BID (without bonus) IS 100 USD

I'm looking for a talented individual who can help me scrape 500 - 1000 quality leads. I need the below criteria to be met The must be located in Melbourne Australia The must have a Google My Business Profile They must only have a...individual who can help me scrape 500 - 1000 quality leads. I need the below criteria to be met The must be located in Melbourne Australia The must have a Google My Business Profile They must only have a few reviews if at all They must have an Australian mobile phone number 0407 464 674 Ideally a first name is provided Ideal candidates should: - Have prior experience in lead generation and scraping and have access to the right tools - Be able to deliver high-quality, accurate leads - Be proficient in data mining and have the necessary too...

Our development team just wrapped up front end development for a large-scale website. At this critical juncture, we're seeking advice to ensure that our back-end databases - PostgreSQL and Cassandra - will be optimally performing and highly available. Key areas of consultation include: - Performance optimizat...optimization strategies - Replication and high availability options - Ideal design of databases to accommodate the scale of our website Ideal professionals would bear extensive experience with both PostgreSQL and Cassandra databases, as well as a keen understanding of integrating front-ends to back-end databases. Your prior work with large-scale website infrastructures will greatly benefit our project. Database optimization and design aptitude is a crucial requirement...

I'm looking for an expert to scrape data from a website. I will provide the list of data (approx. 16K entries) that will be entered into the search bar and I need 2 fields extracted from each search into an excel sheet. This will be a one-off scrape of the website.

As a company, we have a keen interest in developing partnerships with influencers on Instagram to boost our brand visibility. Our main goal with this project is to create a comprehensive database of potential influencers on this platform. Key Responsibilities: - The primary responsibility of the freelancer will be to search, collect, and organize relevant data about potential Instagram influencers. This will include their follower count, engagement rate, niche, and other relevant information that will help us evaluate their suitability for a partnership. - The database should be easily accessible and user-friendly, with the ability to filter and sort based on different criteria. Ideal Skill Set: - Extensive experience in social media research and data collection, with a fo...

Project Overview: Develop a Windows application that can automatically scan a specified website, scrape usernames, and use these usernames to perform real-time performance inquiries on another website. The system will automatically support trading decisions based on the inquiry results and predefined filtering criteria. Specific Requirements: 1. Data Scraping and Processing: • Automatically scan and scrape usernames from a designated website. • Use the scraped usernames for real-time performance inquiries on another site. • The system must be able to handle usernames and related numeric data. 2. Trading Decision Logic: • Decide whether to display buy or sell signals based on performance inquiry results and predefined filtering criteria (to be further spec...

I need a Python script that can scrape ALL imag...uploaded on Stackexchange posts related to LaTeX, especially those tagged with tikz/pgfplot. The primary goal for collecting these images is to create a personal database of the best illustrations asked and made by users. Key Requirements: - Ability to scrape Stackexchange posts specifically related to LaTeX - Must be able to identify and download all images in the posts - Organize the images with their corresponding posts Ideal Skills and Experience: - Proficiency in Python - Experience with web scraping and data extraction - Familiarity with Stackexchange's layout and data structure - Ability to handle and download images from web sources Please submit detailed project proposals outlining your approach ...

I'm in need of a developer who can create a web scraper for the marketplace. Your main task will be to scrape both card details and bids, based on specific filters such as rarity or card type. Key Requirements: - Extracting card details (name, stars, price, last sale price) and bids (price, quantity, time) - Applying filters based on card attributes like rarity Ideally, I would like the data to be updated on a daily basis. This means you will have to set up the scraper to periodically check for new information and update the existing dataset accordingly. Skills and Experience: - Proficient in web scraping - Experience with scraping marketplaces or similar platforms - Familiarity with filtering and updating scraped data - Ability to work with large dat...

Project Description: I need a developer to create a system that queries multiple external sources (18) through APIs, web scraping, and web page reengineering processes to extract information and structure it in the expected format. The system should generate a record of each query made, indicating whether results were obtained, no results were obtained, or if the source was not available. A document detailing all the sources of information from which data should be extracted will be provided. Main Features: 1. Automatic Querying of External Sources: Perform queries to multiple external sources according to the provided specifications. 2. Data Structuring: Process the obtained information and structure it in the required format. 3. Query Log Generation: Create a detai...

I am seeking an experienced developer proficient in creating complex, feature-rich applications and websites....order tracking system for customer convenience. - The inclusion of an AI upselling feature tailored to client interests. - Click & Collect option for alternative product acquisition. - Open source data and web scraping capabilities for refined data category management. Design: The aesthetic should be minimalistic and clean, placing emphasis on functionality and ease of navigation without sacrificing style. Store based on Grocery - food & drink products. It is essential you have previous experience with e-commerce, AI implementation and open-source data technologies within app and web development. I look forward to viewing examples of past project...

...integration, visualization tools, and cloud platform automation. Responsibilities: 1. Geofenced Mapping: Utilize bulk Google Sheets data to create geofenced mapping solutions. Implement geofencing techniques to accurately map addresses and locations and precise boundary definitions for target areas. Includes visual enhancements for clustering data and map filtering. 2. Data Integration: Integrate web scraped data into geospatial existing datasets. Ensure seamless integration and compatibility with mapping and visualization tools. Enhancing our overall data analytics capabilities. a. Integrate the processed data into a centralized dashboard and reporting system, optimizing for performance and user experience. b. Incorporate predictive analytics and AI/ML models to uncover deeper ...

I'm looking for a web scraping expert to help me gather personal profiles, email, and phone numbers from LinkedIn. The data I need should be based on broad search queries. Key Requirements: - Extract specific data: personal profiles, email and phone numbers - Data source: LinkedIn - Search type: Broad search query - Search criteria: Job title or role, Geographic location Ideal Skills: - Proficient in web scraping - Experience extracting data from LinkedIn - Ability to create custom search queries - Prior experience in gathering personal contact information

As a website owner, I am in need of a freelancer to scrape the text content from the unstructured, plain text and HTML of my website's hom...freelancer to scrape the text content from the unstructured, plain text and HTML of my website's homepage. Tasks to complete for this project will include: - Identify valuable text data from the webpage - Create scripts or suitable methods to extract this text data - Clean and deliver the scraped data in a readable, usable format The ideal candidate for this position will be proficient in data scraping technologies, HTML, Python (or similar), and have the ability to work with unstructured data efficiently. Prior experience in a similar project and familiarity with data cleaning will be a huge plus. Please highlight any relevant expe...

I need a comprehensive angel investor list for North America in an Excel spreadsheet. The list should cover all the necessary details for each investor, including but not limited to: - Name and contact information - Investment preferences - Industry expertise - Geographic preferences - Industry preferences - Investment stage - Average Investment Amount - Membership model - Membership fees There are additional questions we would like answered. PLEASE READ THE ATTACHED DOCUMENT FOR ALL INFORMATION SOUGHT. The ideal freelancer should have experience in compiling such lists and should be able to deliver a well-structured and detailed Excel spreadsheet. The list should be easily navigable and professional, making it easier for me to reach out to potential investors. Given that I'm ta...

I am seeking for a skilled web scraper who can effectively extract product information from online catalogs on a website. The aim here is quite straightforward; we need to gather and download catalogs to enrich our store's database. To further specify, the data in question include: - Product Images - Product Descriptions - Pricing Information - Category Details You will be tasked to focus on all categories available on the website. As such, proficiency in navigating various website blockades is a must. Your ability to deliver comprehensive, detailed, and accurate information in a well-structured format is crucial to this job. Prior experience in similar e-commerce web scraping projects would be a great advantage. Look forward to your bids. Thanks in adv...

I want to enlist the ass...enlist the assistance of an experienced web scraping developer, specifically in scraping data from Redfin. I'm primarily interested in the following data points: - Property address - Price - The number of bedrooms - The number of bathrooms This data will be used for personal reasons therefore respectful dealings with the website and its terms of service are obligatory. Here's the kicker, I don't just need you once. I'm wanting the data to be updated on a monthly basis, so I require a solution that's reliable in the long term. Ideal skills for this job are expertise in web scraping, familiarity with real estate websites particularly Redfin, and proficiency in language like Python, BeautifulSoup, Scra...

I need content scraped off a Dokuwiki for...The task is not recurring; it will require a single extraction that encompasses: - all the text content, - images, and - links. Ideally, the perfect candidate for this assignment will possess expertise or qualifying experience in web scraping. Knowledge on how to extract data from diverse formats will be beneficial. Proficiency in web scraping tools and techniques is a prerequisite. Once the content has been scraped successfully, I would appreciate if you can help arrange the data in a clear, accessible structure. Kindly ensure that while conducting the web scraping, the site’s terms of use are respected and that no harm comes to the website. The job is about finding, arranging, and extracting inf...

...looking for an experienced MySQL database developer. The central point of the project is database management. • The main responsibility of the developer will be to create a database, and a form page in HTML • and link the form to the database Experience in the field of database and Mysql is necessary. , the form must be elegant and well displayed on laptop and tablet screens. the objective is when entering a reference in the form all the data in the row of the database table will be displayed in the form. if the reference number does not appear in the database the web page generates a message. The successful candidates will illustrate these skills throughout their portfolio in relation to previous projects. If you ar...

...obtained: - cost of training - duration of training - training facilities within the school - success rates - etc The main goal of this project is to obtain some relevant info about all of the modular pilot training facilities in Europe and the UK. Key Tasks: - Data scraping: you will be responsible for scraping data about flight schools - Data researching Ideal Skills and Experience: - Proven experience in data scraping and research. - Familiarity with qualitative data and its nuances. - Proficiency in using data scraping/researching tools and software. - A background in working with similar datasets or within the aviation industry would be a bonus. Please provide me with details of your relevant experience along with your bid....

...desire; Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. ...

I'm currently facing an issue on my website where frequent database connection errors are appearing. I'm seeking a knowledgeable and experienced professional who can address this problem diligently and efficiently. Key tasks will include: - Identifying the source of the database connection error. - Implementing a robust solution to eradicate these errors permanently. The ideal freelancer for the job is someone with: - Proficient understanding of database maintenance and troubleshooting. - Proven experience in debugging and fixing similar issues. - Ability to work independently and communicate progress effectively.

As a part of my market analysis project, I'm looking to scrape company profiles from the robotreport.com. This data will be crucial for understanding the market landscape and competitors within the robotics industry. Ideal Skills and Experience: - Proficiency in web scraping tools and techniques. - Experience in scraping data from news or business websites. - Understanding of the robotics industry would be a plus. - Ability to organize and present large amounts of data in a clear and concise manner.

I have a database that I need to be cleaned up. The main task is to remove duplicate entries. Key Points: - Main Task: The primary goal of the data cleaning project is to remove duplicate entries in the database. - Handling Duplicates: The duplicates should be automatically deleted, not merged or manually reviewed. Ideal Skills & Experience: - Database Management: A strong background in database management is crucial for this task to ensure the data is processed correctly without compromising the database integrity. - Data Cleaning: Experience with data cleaning processes, especially in handling duplicate records, is important. - Automation: The ability to automate the deletion of the duplicates efficiently and accurately is essential. Please bid...

I'm seeking an expert in data scraping who can gather menu items and prices from all restaurants listed on Hungerstation. Key Details: - Your task is to extract data specific to menu items and their respective prices. - The project spans all restaurants on the platform, not just specific ones or top-rated restaurants. - I need the final data to be organized and shared in an Excel file. Appropriate Skills and Experience: - Proficiency in data scraping - Strong attention to detail - Familiarity with Excel for data organization and delivery.

I need a software that checks me in real time an entire database of amazon ASINs in .csv format (3,000,000 asins) , and when the price of one of the asins falls below a price I choose it should notify me on telegram , all with the use of proxy .

...due the data in the database) developer to create a set of scripts that will synchronize data between my AuctionWizard2000 database and my Opencart (cubecart, oscommerce) database. I have a python script done by previous contractor who dropped the project for the personal reason, so there is no issues with source and target db structures, mapping of the fields. etc. Need an to refresh and do an extra polish. My specific requirements are as follows: 1) Learn the structure of AW 2000 database (old Paradox format, but work fine via Windows ODBC) - download here setup exe file, install it, run trial, restore inventory database from the link I will provide and use this data for the export-import. Paradox DB files are in database folder. 2) Lear...

I need a script or program that can scrape data from a specific website and store user interactions in either a text file or a database. Specifically, I'm looking for the values of the buttons the user has clicked on the provided website - The goal of this data extraction is to customize user experience based on their interactions with the website. Key requirements for this project include: - Extracting the values from buttons on the website - Storing these values in an easily accessible format (text file or database) Ideal skills for this project would include: - Web scraping - Database management - Understanding of user experience customization Experience with similar projects and the ability to complete the work in a timely

2 Different assignments: (1) search for leads and email adresses for the german foundations. (2) Do data scraping from our Energy-consultans assignemnt

I am facing issues with my Node.js application, it isn't performing optimally. Specifically, the web scraping and automation features are flawed, causing inconvenient lag in functionality. The app crashes, performs slowly and sometimes displays incorrect data. I need you to scrape data from , as this function no longer works as intended. - Core Requirements: • Proficient in Node.js and debugging • Familiar with Web scraping methodology • Knowledge of web structure With your in-depth technical skills, I believe you can easily rectify these issues. Looking forward to your proposals.

I'm searching for a professional with experience in data scraping to extract availability details from a list of Airbnb properties. Interestingly, you will: - Collect availability information from the Airbnb calendar for each URL provided. - The data to be extracted pertains to the 'status of availability'(whether a property is booked or available). No further details are required. - Upon completion of scraping, the availability data should be compiled into an Excel file. Skills and Experience: - Proficient in data scraping specifically from websites like Airbnb - Familiarity with Excel formats - Exceptional attention to detail - Strong adherence to timeline and deadlines.

I require a good freelancer for a simple data scraping exercise. I require the freelancer to scrape information from a website. The data I require to be placed in columns within a spreadsheet is as follows:- Job Title Employer Address Salary Contract Type Closing Date Working Pattern Link to Job Job Summary Job Description Employers Website For questions about the job, contact: Team Name or Job Title Name Email address Phone Number Date Posted Pay Scheme Band Contract Duration Reference Number Job Locations I require approximately 5500 rows of data scraped. More work to follow if the quality of your work is good. Thanks,

I am in need of a freelancer who can assist me in the scraping of LinkedIn for the purpose of lead generation. The ideal candidate should be able to organize the data by industry and deliver the final dataset in CSV format. Key Requirements: - Efficiently scrape LinkedIn for specific industry - Organize the data by industry - Compile the final dataset in CSV format Ideal Skills and Experience: - Proficiency in web scraping, particularly LinkedIn - Ability to extract and organize data efficiently - Proficient in CSV file formatting - Understanding of lead generation needs and strategies Please provide examples of similar projects you have completed in the past, and let me know your approach to this task. I am looking for a freelancer who is detail-oriented and can de...

scraping agents records from sales/queensland/brisbane-qld/agents aprx 5,460 agents

I'm on the lookout for an experienced developer who can assist me in finding Hidden APIs for two bookies. My goal is to scrape real-time data from both bookies. Key requirements include: - Data to be scraped: Odds and betting lines, Game schedules - Target: Real-time data scraping Ideal candidate should have experience in: - Web scraping - Uncovering Hidden APIs - Real-time data scraping Looking forward to hearing from professionals who've worked on similar projects and can ensure accurate and efficient data should be in puppeteer or beautiful soup but fast and also ability to load the games in game bid if you have done similar project before you can share sample for preview

I'm looking for a proficient WordPress developer to create a comprehensive relational database for my event marketplace website. This database should not only manage the product inventory but also store a range of user information and details about outdoor activities. Primary Responsibilities: - Developing a robust database to efficiently manage outdoor event organizer product inventory by sector, action, activity, and geo-location. User Information Storage: - The database should be designed to store personal identification and geo-location details of the users, including but not limited to their name, address, and contact details. - It should also be capable of storing users' preferences, which includes their preferred outdoor activities, preferre...

I'm seeking a seasoned FileMaker Pro developer to help address a few challenges with my database. The issues I'm currently experiencing include: - The 'Copy' feature is not functioning as expected. It's failing to accurately copy and paste records along with their associated data. - The 'Time Clock' element is encountering problems with incorrect calculations or logging. - The 'Sort' feature has not been set up properly to ensure consistent and correct sorting of data. Your primary task will be to rectify these issues and ensure the database is working smoothly. Ideal candidates should have: - Proven experience in developing and troubleshooting FileMaker Pro databases. - A keen eye for detail and problem-solving ski...

I'm in need of a seasoned Python developer to create a program to scrape information from Telegram channels. The main purpose of this project is to: - Develop a Python program that can successfully extract all usernames from diverse Telegr...main purpose of this project is to: - Develop a Python program that can successfully extract all usernames from diverse Telegram channels. Given the nature of this project, it would be ideal if you possess extensive experience in Python programming. Understanding the operations and functionalities of the Telegram API is a prerequisite as well. This project requires a comprehensive grasp of web scraping principles and a consistent track record in data extraction tasks. Please bid if you are confident that you can deliver this Pytho...

I am looking for a Python experienced person capable of creating a web scrapper that can extract text content from Aliexpress and then categorize these extracted data into a Google Sheet in a specific format. Crawler in python format. Thanks. Please provide a sample

I need a freelancer to scrape text data from a PDF and output it into separate cells by paragraph in an Excel document. Key Requirements: - Extract and convert text data from a PDF into a structured Excel file. - Each paragraph should be in a separate cell in the Excel sheet. Ideal Skills and Experience: - Proficiency in PDF scraping and Excel data entry. - Attention to detail to ensure accurate data transfer. - Understanding of text formatting to ensure the data is organized accordingly in the Excel sheet.