Data scraping linux jobs

I'm in need of an experienced Linux programmer to update my current SMTP server code and add new routines. Key requirements: - Revise and improve the sending efficiency of the server - Add new functionalities to the existing code The ideal freelancer for this project should be well-versed in Linux programming and have a solid understanding of SMTP server architecture. Your proposal should include a detailed plan on how you aim to achieve the project requirements.

I'm looking for a qualified freelancer to develop a script that can navigate the Almaviva Egypt website just like a human w...that can still function proficiently with a limited number of appointment slots. Moreover, it must be programmed to input login credentials. A crucial requirement is that it can bypass or solve captcha verifications, ensuring a smooth booking process. The essential skillset for this project comprises expertise in Python, as the script should be developed in this language. Familiarity with web scraping and script-making is essential. Knowledge of dealing with booking systems or captcha verifications would be a remarkable advantage. The ideal freelancer is able to create an efficient, reliable script that can consistently secure appointments on Almaviva E...

...need an experienced web scraper who can extract data efficiently from multiple websites. Applicants' guidelines are as follows: 1. Websites for Scraping: Due to security concerns, the websites to be scraped will only be shared with the selected freelancer. 2. Application Contents: I didn't explicitly mention what I want freelancers to include in their applications. However, demonstrating your skills, experience, and past work related to web scraping will surely be a significant advantage. 3. Project Deadline: I require this project to be completed as soon as possible. Please include your estimated completion date in your proposal. Ideal Skills & Experience: - Proven experience in web scraping - Knowledge of Python, Selenium or other scrap...

I'm in need of a professional who can develop a desktop application that can generate addresses for my Solana token. Some key details about the project include: - The token will be built on the Solana blockchain, so experience with this platform is essential. - The desktop application needs to support multiple operating systems – Windows, macOS, and Linux. - The address generation feature should be seamless and reliable. I'm looking for a skilled developer who has experience in creating cryptocurrency-related applications, particularly on the Solana blockchain. The ideal candidate should have a good understanding of blockchain technology and be proficient in developing desktop applications for multiple operating systems. Please provide your portfolio demonstrat...

I need a market research-oriented individual with an expertise in data mining and web scraping. The project entails extracting data from the website harborfreight.com. Specifically detailing: - Product names - Product price - Product type (IE power tools) - Their associated number of customer ratings These details should provided in a CSV file then be categorized by product type. A strong understanding of categorization and proficiency in scraping complex websites will be beneficial. With this data, I intend to carry out detailed market research. Do not worry about descriptions, focus solely on the product names, price, rating numbers, and categorization. I'm looking forward to seeing your proposals if your skills align with these needs.

I need a proficient Python expert to scrape recipes from a designated website to an Excel sheet. The project needs to be c...website to an Excel sheet. The project needs to be completed as soon as possible. You can use this open-source working scraper Key requirements: - Scraping recipe information (name, ingredients, cooking instructions, nutrition facts) from a specific website. - Outputting the scraped data in a well-organized Excel sheet. Ideal skills for this project include: - Proficiency in Python for web scraping. - Familiarity with scraping data from websites. - Excellent organizational and data management skills for outputting the data in Excel. If you can deliver this quickly and efficiently, please feel free to bid.

We require an Excel list comprising 500,000 LinkedIn accounts, each including the login email ID (not contact email), name, and company name. The contacts must meet the following criteria: Title: Owner Location: United States Search Keywords: Restaurant, Automotive Repair, Towing, Tire, Jewelry, Pawn, Automotive, Pools, Boutique, Tile, Heavy Equipment, Chiropractic, Boats, Furniture, Lumber, Granite, Stereo, Trailers Project Deadline: Saturday 7:30 PM ( Indian time zone) To confirm your readiness to commence the project, provide me a minimum of 2000 completed rows that meet the specified requirements.

I am seeking a professional capable of setting up a Red Hat Enterprise 7 server on two VMware clients. The ideal candidate should possess deep knowledge in Linux and VMware and have specific technical skills in version 7 of Red Hat Enterprise. Key Responsibilities: - Installation and configuration of Red Hat Enterprise 7 on VMware clients. - Setup of DCHP, DNS services on the server. Completing this project will require a high level of proficiency with Linux-based systems, specifically Red Hat Enterprise, as well as an understanding of server setup on VMware. Please note that only qualified professionals with the relevant experience should bid on this project.

I'm looking for a programmer to help me build a visa appointment bot for person...primary goal is to automate the task of securing a visa appointment. The Bot: - The bot should be able to navigate a visa appointment booking system, select the appropriate options, and secure an appointment on my behalf. Skills and Experience: - Proficiency in bot programming and automation is crucial. - Experience with task automation and appointment booking is a plus. - Understanding of web scraping and navigation is a requirement. - Attention to detail is important to ensure the bot selects the correct options during the appointment booking process. Please get in touch if you have prior experience with building similar bots or automations, particularly in the context of visa or appoin...

I urgently require a web scraper proficient in extracting data from xing.de. I will provide a file of specific company names, for which I want to obtain the number of employees. Your task will involve: - Gathering accurate and up-to-date data on the number of employees for each company on the list - Formatting the information suitably for my usability. You need to have proven experience in web scraping, particularly on professional platforms such as Xing. Familiarity with German language platforms is beneficial. The deliverable is a neatly formatted file containing company names and their respective employee numbers.

Embedded Linux Engineer to assist in the creation of a kernel device tree for a custom board. You must expertise in embedded systems development, particularly in configuring and customizing Linux kernels and creating device trees. Please explain your relevant experience for this task in few sentences in your application.

...can help me extract specific data on the results of the Tokyo 2021 Paralympic Games from the official website - The data I require includes: - Athlete profiles - All the results of each competitor - Medal winners The extracted data should be presented in a CSV file format. It should be in a similar format as this dataset on the results of the Olympic games: No specific analysis is needed on the extracted data. Ideal skills and experience for this job include: - Proficiency in web scraping - Experience in data extraction - Expertise in data formatting and CSV files Your professional approach and ability to deliver accurate, complete data will be crucial. Please bid

I need a Python expert with an ability to cover various functionalities as per the need. The project might involve data analysis, web scraping, automation, or could be anything else as per the project requirements. The ideal candidate should have: - Expertise in Python programming and its different libraries. - Experience with data analysis, web scraping, automation. - Strong problem-solving skills. While applying, please share: - Your past work related to Python programming. - Your Python programming experience level. - Detailed proposal of how you can assist in this project.

Integrated Al-Quran Education System Development Brief: Create a digital platform for Al-Quran education that features student progress tracking and transparent reporting. The system will utilize PHP Laravel, Flutter or .NET Core, with MySQL/MariaDB on a Linux server. Key Features: User registration for different roles: Admins, Teachers, Guardians, and Students. Payment options both online and offline. Attendance and performance monitoring tools. Video tutorials for Quranic concepts. Requirements: Experience in educational technology. Quick turnaround and budget adherence. Deliverables: Complete web application. User guide and maintenance support. Proposal Needs: Approach, timeline, and cost.

I need an expert to help me select the most suitable all in 1 programming language for building various applications targeting multiple platforms (mainly web) 1. I would like to build applications for Web, iOS, Android, Windows 10, Linux, and MacOS & embedded systems (like micro controllers) from single code base 2. I want to learn a language in which we write a code once and can compile for any platform. 3. One possible answer to my questions is JavaScript. We can build server side apps in JS using Node.js & Next.js. Javascript can be embedded in HTML on client side too. We can build desktop apps in JS using Electron and we can make mobile apps in JS using react & angular. But in javascript will code be exactly same for all platforms ? 4. Another option is Flutter (Da...

I am seeking an experienced developer to create a website scraper which is capable of collecting various pieces of data. This savvy tool must be designed to extract from () site: - Text content - Images - Product information - Address - Contact details - Videos It is essential for the scraper to perform its task on a daily basis. Yet, there won't be a need for the gathered data to be automatically integrated into a database. Ideal Skills: - Web scraping - Developing scraping bots - Programming knowledge - Manual data mining expertise Please only apply for this job if you have significant experience in creating web scrapers. This project requires a quick turnaround, so the ability to work under time constraints is key. Let's converse about s...

I need a skilled C++ developer to improve the lighting and shading effects in my project. The project involves implementing Ray Tracing & Phong Shading in C++ to create more realistic lighting and shading effects. The scenes to be created will be of basic complexity, involving simple shapes and lights. Key r...Phong Shading in C++ to create more realistic lighting and shading effects. The scenes to be created will be of basic complexity, involving simple shapes and lights. Key requirements: - Implementing Ray Tracing & Phong Shading in C++ - Creating 3D scenes with basic shapes and lights - Optimizing the implementation for Linux deployment Ideal skills and experience: - Proficient in C++ and 3D graphics - Experience with Ray Tracing & Phong Shading - Previous work o...

We are looking for a freelancer with strong web scraping experience for an exciting and challenging project. We need to gather specific data from multiple online sources and transform it into useful, structured information for analysis. Responsibilities: Utilize web scraping techniques to extract data from selected websites. Automate the extraction process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Beautiful Soup, S...

I'm looking for a web scraper. Your application should include your experience in this field specifically. I'm interested in scraping the following data from a particular website: - Product details - Contact information - Pricing information Please only apply if you have solid experience in web scraping. We will have lots of different webscraping tasks in the following weeks.

I'm looking for a diligent professional who can implement an Internet price research mechanism for the electronic products listed within a .csv file. The deliverable I expect from this project is a separate report containing the price of each ...the price history. Key Responsibilities: - Extracting and updating the price information of electronic products from the Internet, based on the .csv file provided. - Incorporating a detailed report that includes the prices, a link to the retailer's page, and the price history of each product. Skills and Experience: - Proficiency in data extraction, research, and analysis. - Experience with web scraping tools. - Strong organizational skills to present the data in a clear, concise manner. - Prior experience with e-com...

I'm seeking an individual who can create a one-time web scraper that can collect text, images, and tables from Website 1. The project involves: - Developing a tool to scrape text, images, and tables from the specified website. - Ensuring the tool can operate efficiently for a one-time scraping process. Key Skills: - Proficiency in web scraping tools and techniques. - Experience in scraping text, images, and tables. - Ability to create a custom scraper for a one-time scraping task.

I need a proficient Linux developer with a solid understanding of networking and security, and expertise in scripting languages like Bash or Python. The primary task will be troubleshooting and optimizing existing Linux systems. Also, superior skills in server administration and deployment are a requisite for this role. As the project unfolds, communication is critical, but I haven't decided on a reporting frequency at this point. Please provide suggestions on what you've found effective in your experience.

I need a web scraper to extract specific data from various websites. The project will involve: - Identifying the necessary data to be scraped - Building a scraper to extract this data Ideal skills for this job include: - Proficiency in web scraping tools - Familiarity with web data extraction techniques - Ability to work with and extract data from various websites Please provide your quote for this project.

...Seller Data: The main purpose of this project is to gather information about the sellers on the Miravia platform (). This includes the shop_id shop_name Ivl1_cate_name product_number avg_price shipping_duration company_location phone_number email_address vat_number company_name shop_rating shipping_on_time % followers comments etc. I require 10,000 entries of data I require the data to be well-structured and organized into a CSV or Excel file for further analysis. Skills and Experience: - Proficiency in Web Scraping: The ideal candidate should have extensive experience in web scraping and data extraction. - Attention to Detail: Since the project involves gathering a wide range of data points, having a keen eye for detail is crucial t...

... OpenCV, PyAV, or MoviePy, but the solution should be compatible with both Windows and Linux (and mac) - The output should have details of the signal, the different type noises, the common ratios and finally the values ... - the frame number ... - the time position/time code ... - the data detected ...... - e.g. the sharpness and this should be outputed in a JSON file per video file. Ideal Skillset: - Proficiency in Python - Experience with video processing libraries (like OpenCV, PyAV, or MoviePy) - Experiences with OOP (classes and lists) - Familiarity with JSON output format. Milestones: MS1: provide python OOP module to measure the blurness & sharpness quantification of images and videos data will be written in same filename but with .json as extensi...

I need help with scraping specific information from urls (we will provide). The key details I need are the company name and contact information. Website Phone Email Brand Country Of Origin Total Entries: 1704 No research required, you just need to copy paste information from the fields onto a google sheet.

I am in need of a skilled Linux and Bash Script expert to help me with my current project. Although I haven't specified exact tasks or goals, I am seeking assistance in the following areas: - Linux installation and configuration - Bash scripting and automation - Troubleshooting and debugging I expect the successful freelancer to have a deep understanding of Linux systems and be proficient in Bash scripting. Your past work and experience in similar projects will be valuable. Please detail how you can assist and your approach in your application. Thank you.

...need of a Linux-based invoicing solution with multi-user support. The software should be self-hosted and able to handle different access levels for users. Key Requirements: - Operating System: The invoicing solution should be compatible with Linux. - Multi-User Support: The software must support multiple users with distinct access levels. - User Roles: The system should have at least two access levels - Admin and User. Ideal Skills and Experience: - Prior experience in developing invoicing software, particularly for Linux environments, would be advantageous. - Proficiency in user authentication and authorization protocols. - Strong understanding of database management and security. there is a html file already build , the only thing that it need to be done is co...

I am looking for a professional who has experience in data scraping to extract email addresses of senior level employees in the Building Industry, specifically from the United Kingdom. This task involves collecting the email addresses of 100 senior level employees. Key Requirements: - I need the first name, job title, and email address of each employee. - All the email addresses should be from the United Kingdom. The ideal freelancer for this project should have: - Experience in data scrapping and data mining. - Proficiency in tools and techniques for extracting data from web sources. - Attention to detail to ensure the accuracy of the collected information. - Familiarity with the Building Industry and the job titles associated with senior level roles i...

...and bash scripts for a personal project. This personal project is focused on web scraping. The successful candidate will be tasked with scraping product information, news articles, and social media data. Exemplary knowledge of proxifying requests through nginx and formatting bash scripts that interact with Nodejs applications is a requisite. Mandatory Skills and Experience: - Advanced proficiency in Nodejs - Extensive experience with nginx reverse proxy - Expertise in formatting bash scripts - Proven experience in web scraping, with emphasis on scraping product info, news articles, and social media data The ideal candidate must be able to present a portfolio demonstrating their competence in web scraping using techniques mentioned a...

I have an urgent web scraping task that needs to be completed as soon as possible. This project involves: - Scraping specified data from a list of instagram accounts. The information includes phone number and email of account and also phone number and email of account tagged in the bio description The ideal freelancer for this job should have: - Proven experience in web scraping - Proficiency in handling different types of data (text, images, tables) - An excellent track record of delivering projects on time. Please apply if you have the expertise and availability to tackle an urgent project.

I need a Python developer with a strong skill set in web scraping, database management, and video manipulation to create a code which can easily download videos from personal websites, save them to local web storage, and subsequently update values in an sqlite database. Detailed requirements are as follows: - Download videos specifically from personal websites. - Save videos internally for archiving purposes. - Saved videos should be in AVI format to maintain consistency. - Program should have a functionality of updating an sqlite database with relevant video details upon successful download. Ideal candidate should have a deep understanding of AVI video format handling as well as extensive experience interacting with an sqlite database using python. Familiarity with various d...

I need a freelancer to collect data from online. It is simple job of data search and collection from crowdsourcing website. Would provide spreadsheet with details, all you need to fill the details. We are into venture financing. Job Description: Name LinkedIn profile. contacts (if possible) Attached spreadsheet for your reference. Regards, R

I'm looking for a computer engineer with strong expertise in Google technologies. Key Requirements: - Proficiency in Operating Systems and Technical Skills: You should be well-versed in various Operating Systems and t...challenges of the project. - Google Technology Proficiency: You must have a deep understanding and hands-on experience with Google technologies, products, and services. Ideal Skills and Experience: - Previous experience in software development, network security, or hardware design would be a plus. - Strong understanding and experience in using multiple operating systems, particularly Windows, Linux, and macOS. - Excellent problem-solving skills and the ability to work independently and in a team. - A proactive approach to learning and adapting to new technolo...

I'm looki...Telegram group via API integration but currently, it isn't purchasing as expected. Specifically, I'd require someone who could: - Identify and fix the issues that prevent it from purchasing and selling the scraped coins. - Make sure the bot interacts properly with the Latoken cryptocurrency exchange. This task would suit someone with a strong background in bot programming, API operations, web scraping, and experience dealing with cryptocurrency exchanges, particularly Latoken. Knowledge of crypto trading bots' operational peculiarities would be a major plus. Your task would be to get it back to working condition, ensuring all functions operate as they should. This job will evolve into continuous maintenance and development of bot's features. T...

I'm looki...Telegram group via API integration but currently, it isn't purchasing as expected. Specifically, I'd require someone who could: - Identify and fix the issues that prevent it from purchasing and selling the scraped coins. - Make sure the bot interacts properly with the Latoken cryptocurrency exchange. This task would suit someone with a strong background in bot programming, API operations, web scraping, and experience dealing with cryptocurrency exchanges, particularly Latoken. Knowledge of crypto trading bots' operational peculiarities would be a major plus. Your task would be to get it back to working condition, ensuring all functions operate as they should. This job will evolve into continuous maintenance and development of bot's features. T...

I urgently need an expert in Linux and Nginx who can help me: - Configure my Nginx server - Optimize server The ideal candidate should have: - Extensive experience with Nginx and Linux - Excellent troubleshooting and problem-solving Time is of the essence, so please get in touch if you can jump straight into action. Ubuntu Nginx

...nor tens of thousands, nor even thousands of websites each day. I plan to use your scripts on a relatively small scale of not more than one hundred websites each day. ******* TESTING ******* You must test your script on Linux Mint 21.3 Cinnamon Edition to ensure that it runs properly on Python 3.10.12, on the current stable version of Google Chrome, on Linux Mint 21.3 Cinnamon Edition. I do not care if your script runs on any other operating systems or any other browsers. If you typically use Microsoft Windows, please consider setting up a virtual machine to install Linux Mint 21.3 Cinnamon Edition so you can test your code properly. In particular, if I were to send you a bug report, I would not like to receive a reply from you like, “The script works 100...

I'm in need of a skilled data miner who can help to extract certain details from a vast range of Shopify products. Your mission, if you choose to accept it, is as follows: - list products that contain non-English writing or words in text and videos - Organise and sort these findings for simple review - Identify and list any products filled with non-English language in the description, pictures or images - Compile lists of products that aren’t currently making top-seller lists - List any products can not be delivered in eight days or less. Please note that tractors and food vans may take up to two months to deliver. - List any products that are not suitable for industrial purposes/non-commercial products. Ensure that the products you are considering are meant for commerci...

I need an Excel 365 PowerQuery or VBA script that can fetch daily market data and handle potential data source interruptions or changes. Google Shhets example =INDEX(IMPORTXML("" & C31, "//span[@class='mod-ui-data-list__value']"), 1, 1). <Where C31 = Cell containing the Stock eg GB00B8XYYQ86, LU1033663649 or GB00B0CNH163 I need an identical function in MS365 Excel - either with PowerQuery OR VBA (preferable) Ideal skills: - Proficiency in Excel 365 and PowerQuery and VBA - Experience in web scraping and handling dynamic data sources. I am after a fixed quote for this project.

As a client, I am in search of a skillful full-stack software developer. The task at hand involves improving an already existing project with freshly integrated functionalities. An overview of the project's main requirements include: * Integrating the application with Stripe for online payment * Creating Telegram and WhatsApp bots (API) * Incorporating existing text into the translation mod...effortless yet functional implementation. Also, the urgency of the tasks varies, with the addition of existing text to the translation module of React taking top priority. Your experience with APIs, Stripe integration, and React translation modules will be key to the success of this project. The project will take place in a controlled environment for monitoring and evaluation purposes. Working ...

...someone experienced in web scraping and data collation. The project will involve scraping blog articles in HTML format and compiling desired information into an Excel file. Key Project Requirements: * The extraction will be from specified URLs, using their individual patterns for efficient and accurate scraping. * For each blog article, I need the title, the full text, and the publish date extracted. * This scraped data must be properly arranged in an Excel file for easy analysis. * List of articles is here: Ideal Candidate Expertise: * Proven experience in web scraping is a must, preferably with full understanding of HTML structures. * Proficiency in Excel and data organization. * Attention to detail to ensure accuracy of the scraped...

I need a fully bilingual professional (I will interview in English) to do some tasks for my agency such as: PR Outreach Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Wordpress And others You must be a fast learner, attentive, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes. This job will start part-time as a test period, after that it will be full-time. Payment for part-time during trial period: Fee: 250 USD Performance bonus: 50 USD Results bonus: 50 USD If your work complies with my quality requirements and you give more than asked, you’ll get performance and results bonuses each month. After a tw...

I'm looking for a talented freelancer who can assist with scraping automobile ads from website. Key Requirements: - Scraping specific automobile ads. - Extracting ad titles, descriptions and prices. The ideal candidate should have: - Experience in web scraping. - A strong understanding of data collection from websites. - Attention to detail to ensure accurate extraction of data. Please note that the exact websites and the car details are not provided yet, so the freelancer should be able to work with changing parameters.

I want to scrape daily leads from LinkedIn Jobs, Indeed Jobs, , etc. The task involves extracting data from these job sites and exporting it to Excel sheets. It would be preferable to have some kind of automation that reduces human dependency in obtaining leads every day. If someone has already set up a similar process before, I would prefer that. Preference will be given to those who have previously performed lead extraction tasks for recruitment websites.

Create an executable scraper in Python that can extract the SKU (product) list from the following Indonesian online grocery apps: - Astro - Sayurbox - Segari The scraper must be IP-block tolerant, meaning if the scraper gets blocked, execution can be continued from the point where the last row of data was successfully extracted. Scraper Functions Function: list_category_tree Input: competitor_name(astro | sayurbox | segari), existing_csv (optional - CSV file to append to for continuing execution, if the scraper stopped or got IP blocked) Output: CSV of category tree with the following columns (scrape_date, URL, category name, position index, parent_category (null if top level)) Function: extract_sku Input: competitor_name, location (autocomplete place from google maps API), ca...

...operating in the healthcare sector, committed to leveraging data to enhance our services and support for medical professionals. Our focus is on identifying and connecting with newer medical professionals and travel nurses to offer them tailored opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of the scraped data. Customize the scraper t...

...the pip3 and Python 3 Virtual Environment by running. - sudo apt install -y python3-pip python3-virtualenv 2. I then created and activated the Virtual Environment by running. - python3 -m venv projectsenv - source projectsenv/bin/activate 3. Then I installed opencv while inside the virtual environment - pip3 install opencv-contrib-python 4. After that I installed the depthai dependencies for Linux (still in the environment) - sudo wget -qO- | bash 5. Then I installed depthai (still in the environment) - python3 -m pip install depthai 6. Then I cloned the "depthai-python" git hub repository 7. Then I ran the install requirements (still in the environment) - python3 Finally, I tried to run the example code ColorCamera/rgb_preview

...the pip3 and Python 3 Virtual Environment by running. - sudo apt install -y python3-pip python3-virtualenv 2. I then created and activated the Virtual Environment by running. - python3 -m venv projectsenv - source projectsenv/bin/activate 3. Then I installed opencv while inside the virtual environment - pip3 install opencv-contrib-python 4. After that I installed the depthai dependencies for Linux (still in the environment) - sudo wget -qO- | bash 5. Then I installed depthai (still in the environment) - python3 -m pip install depthai 6. Then I cloned the "depthai-python" git hub repository 7. Then I ran the install requirements (still in the environment) - python3 Finally, I tried to run the example code ColorCamera/rgb_preview

I am in need of a skilled Linux and Bash Script expert to help me with my current project. Although I haven't specified exact tasks or goals, I am seeking assistance in the following areas: - Linux installation and configuration - Bash scripting and automation - Troubleshooting and debugging I expect the successful freelancer to have a deep understanding of Linux systems and be proficient in Bash scripting. Your past work and experience in similar projects will be valuable. Please detail how you can assist and your approach in your application. Thank you.