Python scrapy web scraping jobs

I'm looking for experienced Python and Ansible experts to help me with network automation specifically focusing on Cisco switches. • Your primary task will be to automate my existing network comprising of Cisco Switch devices. • Your specialties should unquestionably include Python, Ansible, and a thorough understanding of switch automations. • Proficiency with Cisco devices is a must. This project requires someone with great attention to detail and in-depth understanding of network automation to enhance efficiency of my network devices.

I'm looking for a Django developer with experience in e-commerce applications to help me complete and enhance an existing...system within the app. While I haven't decided on a specific provider yet, I'm open to suggestions that would suit an e-commerce platform. - Customer Reviews: I'd like to add a customer review system, where users can leave feedback and rate products. The app is already partially developed, and I have a good understanding of Python and Django, but I need an expert to finalize the app and add the new functionalities. Ideal Skills and Experience: - Proficiency in Django and Python - E-commerce application development experience - Payment system integration - User authentication and order tracking implementation - Prior experience with...

*************IMPORTANT*********** Please start with your bid by writing your personal Github profile first, we won't check bid without Github profile. ************************************ I'm in need of a talented developer, preferably with a strong background in producing business applications. Here's what I'm looking for: - Expertise: You should be skillful in any of Javascript, Python, Java / Kotlin or Swift / Objective C, Flutter / React Native / Xamarin. - Platforms: Production of a cross-platform app that runs smoothly on both iOS and Android is essential. - Experience: Evidence of previous projects in business app development would ideally be shown. By applying these requirements, you will help to create an app that can contribute to the success of ...

I'm in need of a freelancer with strong Python skills. I require a time series forecast for my Twitter dataset. The forecast should be for 1, 3, and 7 days ahead. The key deliverable is 3 dynamic dashboards that display this forecast in real-time. Key Points to Note: - **Programming Language**: Python - **Time Series Forecasting**: The freelancer is expected to have a solid understanding of time series forecasting methods. The deliverables should include 2 Neural Network and 2 autoregressive models (ARIMA, SARIMA etc…). The validation should demonstrate each model performance. - **Dynamic Dashboard**: I'm looking for a dashboard that's dynamic and interactive. It should display the forecast for the Twitter data using a visually appealing interface. - **...

I'm in need of a proficient data entry specialist to assist with a substantial volume of data entry work. This is a very basic task, a lead scraping website doesn't allow me to export data. So we will copy and paste from one website to a google sheet. There are 2,241 entries needed This project will take ~20 hours I am attaching a screenshot of the picture of the website and of the spreadsheet

I have lost my old server I want to build a new one - setup WHM cPanel & migrate 2 website on it the website are on Python & laravel my Bud Get is 6 0 A u D

I require a specialized robot capable of locating and compiling available citations from business websites. As a fundamental part of this project, I am looking for: - Proficiency in hand...and compiling available citations from business websites. As a fundamental part of this project, I am looking for: - Proficiency in handling and extracting data from different business sources, specifically focusing on citations. - Advanced skills in programming and web scraping to efficiently channel through high amounts of data. - Understand the "citation" within the context of a business website as a direct link to the company's website. The ideal candidate would be someone with vast experience in data mining, web scraping, and programming. Previous expos...

I'm seeking an experienced Python programmer to design a program that analyzes the data from 7-8 spreadsheets and generates a discrepancy report. The project will require: - Strong proficiency in Python - Expertise in data visualization - Ability to compare categories within a large dataset - Comprehension of CSV format Specifically, the core functions of this Python program should include: - Analyzing spreadsheet data - Comparing various categories - Visualizing these comparisons to spot discrepancies - Exporting the results in CSV file format Ideal candidates should have extensive programming experience, particularly in the field of data analysis, and be able to demonstrate a solid understanding of data visualization techniques. They should also be fam...

I'm seeking a Python developer who can automate certain calculations in my existing Excel files. The calculations that are currently done manually in Excel need to be automated. This means the Python script you develop will need to accurately and efficiently perform these calculations every time it runs. As for the frequency, the system should run calculations on demand. This way, I can trigger it whenever I need the numbers updated. The calculations are based on the data currently stored in my Excel files. So the script will need to read this data, perform the necessary calculations and update the files with the new results. The ideal candidate should have: - Proficiency in Python - Experience in working with Excel files - Understanding of automation proce...

We are facing a challenging issue with our existing Python scripts that deal with data processing, automating tasks, and communication with other services. - Problems: These scripts have been producing incorrect results and running slow, affecting the overall performance of our project. - Scope: The project consists of 1-5 Python Scripts that need to be diagnosed for the errors, fixed, and optimized for better performance. - Key Skills: An ideal freelancer would be well-versed in Python programming, task automation, and capable of identifying and rectifying issues relating to communication with other services. Experience with rabbitMQ is mandatory as it's part of our current code base. We are eagerly waiting for a Python wizard who could breathe life...

I'm in need of a web scraping wizard who can help me extract text data and profiles from Twitter website. Key Requirements: - The ability to scrape text data and profile information efficiently and accurately. - Experience in web scraping, with a strong portfolio showcasing past work in similar projects. - The time for scraping a post and profile must be less 3 seconds without using Twitter API. The final deliverable should be in a format that's easy for me to analyze, but I'm flexible on whether it's a CSV file, Excel spreadsheet or a database format. Please describe your past work examples with your application. Write "Blue" on the head of your bid if you are not a bot.

...help me set up OpenCV on a Tesla T4 GPU. I would like the latest version of OpenCV to be installed on the GPU, using Python as the primary programming language. The solution you provide must be generic enough to ensure that OpenCV can be installed on any other GPU in the future. Key Requirements: - Installation and setup of the latest version of OpenCV on a Tesla T4 GPU, leveraging CUDA and cuDNN. - Ensure functionality is maintained for Image Processing and Video Analysis. - Implement the solution in Python. - Provide thorough documentation for future reference. Ideal Freelancer: - Should have significant experience in working with OpenCV and GPU setups. - Proficiency in Python and a good understanding of CUDA and cuDNN. - Previous experience in configuring and...

I have a 500MB XML file that I need loaded into SQL across approximately 20 tables. I'm in need of a Python script to handle the transformation. The script will need to handle normalization of the data. Key requirements: - Develop a Python script to read the XML file and transform the data into a normalized structure across 20 tables. - You will need to create the SQL tables as part of the normalization process. - Experience with large data transformations and SQL is vital.

Develop 3D scanner using Python as discussed

I have a frontend file that needs new features and an admin panel to manage content. The project involves: - Implementing new features into the existing fron...who can not only make the necessary changes to the frontend but also create a user-friendly admin panel for managing contents. Experience in both frontend development and backend (specifically for the admin panel) will be crucial. Ideal Skills: - Proficiency in front-end technologies such as HTML, CSS, and JavaScript - Experience with backend technologies for admin panel like PHP, Python, or Ruby - Knowledge of web frameworks like Laravel, Django, or Ruby on Rails - Understanding of database management for effective content storage and retrieval - Prior experience with developing admin panels for content managemen...

I'm about to get daily PDF forms and need them automatically dumped into a Google Sheets document. The project involves: - Extracting data from incoming PDFs and inputting them into corresponding fields on Google Sheets. - Ensuring that each f...project involves: - Extracting data from incoming PDFs and inputting them into corresponding fields on Google Sheets. - Ensuring that each form submission creates a new row in the Google Sheets document. It's essential that: - The data is accurately extracted with no errors. - The system can handle a normal volume of PDF submissions (no more than 150) Ideal qualifications: - Proficient in web scraping and data entry. - Experienced in working with Google Sheets and PDF manipulation. - Ability to create an automated system ...

I'm in need of a professional who can develop a scraping tool that will track market announcements and releases on a financial website using specific keywords. - The tool should scrape this data on a daily basis. Accuracy and reliability are key. - the scraped data should be filtered for the current date, daily. - I need this table of data to be automatically filtered for keywords. -the filtered results to be emailed automatically to an email list. - the tool to run automatically on a website or server. I'm looking for someone who has a proven track record in web scraping with a focus on financial data. Experience in creating automated scraping tools, particularly those that operate on a daily basis, is a huge plus.

I'm looking for a skilled software engineer. THis task is too large for excel power query, however i wan...it to operate in a similar fashion. The main purpose of this project is to develop a self-updating database of every racehorse in the state of NSW, Australia, via the website. Key tasks and responsibilities: - Determining the best platform for the software (Web-based/Desktop-based/Mobile application). - Creating a software solution that will automatically update and manage a database of racehorses. Skills and Experience: - Proficiency in at least one high-level programming language i.e., Java, Python, C++ - Experience with automation software - Familiarity with database management - Ability to recommend best software platform based on project requirements. Than...

I am looking for a freelancer who can help me generate Python specific to Ignition 8.1 Perspective Key Requirements: Install of Ignition 8.1 - The Python code should implement file creation in JSON format. - The code snippets should be customized to work seamlessly within Ignition 8.1. Ideal Skills and Experience: - Proficiency in Python programming. - Prior experience with Ignition 8.1 or similar platforms. - Knowledge of JSON file creation. - Understanding of interface functionalities. This project would be ideal for a freelancer with a background in software development, particularly in Python, and experience with industrial automation systems. A comprehensive understanding of Ignition 8.1 is required.

I'm looking to scrape a website using the python package requests. 1) create a session because the site requires a username and pwd login 2) pass an initial URL that will get pagination of results 3) from the results we'll get the URL of the individual person/page we need to get info from 4) we'll make a request call within the session to the persons URL 5) Then we'll parse the HTML from the persons page 6) Then, we'll put the information into a dictionary object and append it to the a list 7) Finally we'll then print out the list of JSON objects to a text file

I'm in need of a Python Developer who is proficient in data analysis, visualization, and data science to work on an array of data types including financial, customer, social media, and pharma data. Key Tasks: - Data Analysis and Visualization: You will be given various sets of data which you will need to efficiently analyze and create meaningful visualizations. - Web Scraping and Automation: Knowledge in this area is desirable but not necessary. - Django Web Development: Again, not a necessity but would be considered a bonus. Objectives: - Efficiency Improvement: Assist in identifying areas of operational efficiency and suggest or implement changes accordingly. - Cost-Saving Opportunities: Use the analyzed data to identify potential areas for reducing co...

I'm seeking a talented Python developer who can create a Telegram bot that offers wallet functionality. Specifically, this will include checking the balance of specific tokens and enabling the transfer of tokens to another wallet. Key Requirements: - Proficient in Python and its libraries for Telegram bot development - Experience with integrating wallet functionality into bots - Capable of creating a user-friendly interface for the bot - Strong understanding of blockchain technology and token transfers The bot should be easy to use and understand, with clear instructions on how to check balances and complete token transfers. I'm open to suggestions on the design and structure of the bot, but simplicity and user-friendliness are essential. Ready to hire you now. ...

I need a Python code to perform data analysis on text data sourced from tables. This project emphasizes the importance of being highly familiar with Python and its data analysis and text processing libraries. Key tasks: - Extract text data from tables - Perform comprehensive text data analysis Ideal skills: - Proficient in Python - Extensive experience with data analysis and text processing libraries - Familiarity with table data extraction - Strong understanding of text data analysis techniques and methodologies. I look forward to hearing from experts in Python data analysis. This is a chance to demonstrate your ability to solve complex data processes.

I'm seeking a pr...followers' ratio. The higher the ratio, the more viral the tweet is considered to be. - It should be able to scrape and analyze tweets from the past week. - The bot should be capable of differentiating between tweets based on their views to followers ratio and identify the 'most viral' one. Ideal Skills & Experience: - Proficient in creating Twitter bots. - Strong understanding of Twitter API and scraping tools. - Familiarity with tweet analytics and calculations. - Ability to extract and process data efficiently. The end goal of this project is to have a functional tool that can accurately pinpoint the most viral tweet of the week. It is essential that the developer is skilled at creating algorithms that can measure and compare the '...

I'm in search of a versatile full stack developer to assist in the completion of a project. A...project. Although I have not set specific tasks, I'm looking for someone who can handle both front-end and back-end development tasks, as well as database management. The ideal candidate should have a strong background in all the skills required for full stack development. The project will involve creating a website or building a web application, and possibly require some mobile app elements. Key skills and experience required include: - Proficient in JavaScript, Python, and/or Ruby - Ability to handle both front-end and back-end development - Experience with database management - Strong problem-solving skills. If you're a full stack developer looking for an in...

I need a web scraping expert to scrape Title, Price, star ratings, delivery window from a specific e-commerce site on a regular basis. - The scraping should cover a range of products, ideally with the ability to specify categories for tracking. - The data needs to be scraped frequently, so automation and scheduling will be crucial. - It's important that the extracted data is accurate and up-to-date as this will be used to inform pricing strategies and customer service. The ideal freelancer for this project should have: - Proficient experience in web scraping, particularly from E-commerce sites. - Proficiency in programming languages like Python or R for automation. - Good understanding of data management and quality control. - Ability to del...

I'm seeking a skilled Python developer proficient in Selenium or other scraping tools, AI and others API integration. The main tasks in this project include: - Integrating APIs: You'll be responsible for seamlessly integrating the following APIs: - Send/reveive data from trained AI - Collect data using scraping - Payment Gateway - Other websites: API to integrate with other websites - Developing B2B Features: We're looking to expand our platform to cater for B2B transactions. Your role will be to create and incorporate features that facilitate B2B interactions. Key skills and experience required: - Proficient in Python - Experienced with Selenium or other scraping tools - Proven track record with API integration - exchange...

I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The ...scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.

I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The ...scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.

I am currently looking for a skilled Python developer who can assist with an API integration project. The tasks to be completed will primarily involve: - API Integration: The key responsibility will be to integrate the Google Maps API into our system. - Location Tracking: The primary functionality we require from the Google Maps API is location tracking. This will be a key component of the project. Ideal candidates should have: - Proficiency in Python: A strong understanding of Python programming is essential for this role, as the primary development language will be Python. - API Integration Experience: Experience with integrating APIs, particularly the Google Maps API, would be a significant advantage. - Familiarity with Location Tracking: A background in de...

I am seeking a Machine Learning engineer with proficiency in Python. You should be able to apply your skills to solve a classification problem with a text dataset. Key Responsibilities: - Develop and implement a suitable ML model for the text classification problem - Conduct detailed data analysis and preprocessing Ideal Skills & Experience: - Extensive Python programming experience - Wide understanding and experience in Machine Learning, specifically in classification problems - Experience in working with text datasets - Familiarity with popular Python libraries used in ML such as scikit-learn, pandas, and numpy If you have a strong grasp of Machine Learning techniques, particularly in text classification using Python, then this is for you!

Our SaaS site () is getting a bit old. We need an experienced designer/front-end developer to completely freshen it up,We operate in the Web Scraping industry and would like our new site to stands out w.r.t. competition. We want a site that's easy on the eyes and presents our product offering better than how it is currently presented. Requirements =========== . New home page should have a section for testimonials/clients and a section for awards/review badges. . Each product (currently scrape and extract) have their dedicated page. Their illustrations need to be redone and the scrape page should have some icons/illustrations on top of each "Applications" box. . We need a new nav menu item for "Resources". The site footer section will also host new ...

I'm looking for a skilled professional who can help me retrieve information from various sources. The ideal freelancer should be well-versed in web scraping, especially from websites, social media platforms such as LinkedIn, publications, and news sites. This will help in gathering relevant data for building a recommendation system. Key requirements include: - Proficiency in data scraping from multiple sources - Ability to effectively scrape data from websites, social media platforms like LinkedIn, and news sites - Experience with handling and storing data in a database - Understanding of how to structure and manage data for machine learning purposes Your task will be to gather the data and store it in a database for further analysis. Having a solid bac...

I'm seeking a Python developer who's proficient in web scraping to help me extract data from social media platforms. Key Responsibilities: - Develop and implement a Python script for web scraping data from social media channels. Deliverable: - The scraped data should be compiled and delivered in an Excel spreadsheet for further analysis. Ideal Candidate: - Proficient in Python with a strong background in web scraping techniques. - Prior experience in scraping data from social media platforms will be a big plus. - Ability to deliver the end results in an organized, neat and easily accessible format, such as an Excel spreadsheet. Please reach out if you think you're the right fit with the necessary...

I'm urgently in need of a highly skilled programmer who has proficiency in Python, Java, and C++. Key skills and experiences will be: - Proficient in Python, Java, C++ - Strong problem-solving skills - Ability to work under pressure and adhere to tight deadlines - Previous experience in general programming, specific project genre unspecified Due to the urgent nature of this project, I'd appreciate it if interested freelancers could contact me immediately.

I'm in need of a skilled mathematician with a specialization in sta...specialization in statistics to assist me in data analysis. Essential Points: - Specialization: Your main focus should be on advanced statistics, specifically at a graduate level. - Experience: Proven experience handling complex statistical data analysis is a must. - Communication: You should be able to translate your findings into actionable insights. - Tools: Proficiency in statistical software like R, Python, or SPSS is essential. This role is crucial in helping me make sense of large datasets, so it's important that you are comfortable with the analytical side of data interpretation. Your findings will help me make informed decisions based on the data. Please reach out if you think you're the...

I'd like to extract the phone numbers of real estate agents from a particular website Key Requirements: - Extract agent contact information Ideal Skills and Experience: - Proficiency in web scraping - Experience with data extraction and automation - Strong understanding of data privacy laws and regulations Please note that the data is intended for internal use only and will not be shared with any third-parties.

I need a talented web designer with expertise in APIs, data scraping, and AI to help me build a professional portfolio website. - Design: The designer needs to create an engaging and visually appealing layout for the website, considering it's targeted at professionals. - Integration: I require the integration of API functionalities into the website. - Data Scraping: The designer should implement data scraping. - AI /ML Features: The website will also need AI-based features. The primary goal of the website is to serve as a showcase for my work. It’s important that the design is not only aesthetic but also functional, user-friendly, and professional. I am looking for someone who can bring a high level of creativity, technical skill, and attention t...

...real-time. The OCR system will be used for analyzing the data extracted from the digital meters, so a high level of accuracy is required. Key Requirements: - Develop an OCR feature that can accurately read and extract characters from digital meters - Implement the system to process images captured by cameras in real-time Ideal Skills and Experience: - Strong background in OCR technology, python, Tesseract, customized ocr readers, particularly with processing images from cameras - Experience in developing systems for specific industrial use cases is a plus electric meters, kwh meters etc. - Ability to handle a large amount of data accurately and in a timely manner. Please bid if you have the skills and experience to deliver a high-quality, real-time OCR system for ...

We are looking for a web designer who has minimum 3 years of experience in Full Stack Development. Tech for backend can be python/node.js and for frontend react.js. We have the UI for what we want to build, we need backend and frontend to be developed for the same. Our website is a marketplace, where publishers can register and add their offerings and advertiser can purchase it and place orders, admin panel UI is also available. You should know how to follow structured approach and keeping scalability in mind.

Accounting, stock control Integrate AI for generate content for marketing. All develop in python. Able to run at aws Propose your timeline and price.

I am in need of a skilled developer who can create a functional scraping tool for me. The purpose of this tool is to download JPEG product images from a specified URL that increments numerically. Key Requirements: - Scrape images from a continuously changing URL (i.e., www.****/asdasd/1234 then 1235, and so on). - Ability to tweak URL structure according to my needs. - Images must be saved in JPEG format. The ideal candidate for this task: - Has experience in web scraping and dealing with dynamic URLs. - Understands how to name files after the URL page number. Please note that the key goal is to download product images, not data extraction or process automation. Hence, your proposal should focus on delivering this specific requirement. Your understanding of this ...

...interpreting, and presenting data to inform decision-making. - Manage data integration: The candidate should be capable of combining data from various sources to create a cohesive dataset. - Develop data visualization: The engineers will need to create meaningful and understandable visual representations of the analyzed data. The necessary skills for this role are: - Proficient in Python: The candidate should be well-versed in Python programming language to work with our system. - Knowledge of Hadoop: Experience with Hadoop is a must for this position to handle the data integration and data storage tasks. - Knowledge of Kafka Prior experience in big data engineering and a good understanding of data engineering principles will be vital. Please note that this project suits...

...An accurate bone fracture detection model should be developed using Python and TensorFlow. The primary goal of the model is to ensure precision in diagnosing fractures from X-ray images. You can use any datasets available online for free. Model should be able to predict the fracture, body part, highlight the fracture part, - **User Interface**: The UI should be designed to offer an intermediate level of interactivity. This includes incorporating some interactive elements like progress bars to enhance user experience. Use HTML, CSS, Javascript for this. Ideal Skills and Experience: - Proficiency in Python and TensorFlow, with demonstrable experience in building and training deep learning models. - Strong grasp of web development languages, especially HTML, CSS,...

...backend of my project. The primary issue revolves around frequent errors that are hindering its stability and functionality. - The backend is primarily developed using a mix of Python, Java and Node.js. - The main task would be debugging, ensuring all scripts and functions are working as intended. - Additionally, I'm looking for the identification and resolution of any underlying issues that could be causing the frequent errors. - A crucial requirement is the ability to enhance the stability and reliability of the backend, ultimately improving the overall performance of the system. Ideal Skills: - Proficiency in Python, Java, and Node.js - Extensive experience in backend debugging and stabilization - Strong troubleshooting and problem-solving skills - Knowledge...

I am seeking a proficient Python programmer who can create a web scraper for Lazada. Key Responsibilities Include: - Develop a Python program that will enter query in search box and scrape Lazada for the following data: product name, images, price, description, seller, and URL. - The scraper should be able to handle pagination plus also bypass captcha using 2captcha api Ideal Skills and Experience: - Proficiency in Python and web scraping frameworks. - Familiarity with the Lazada's web structure and data extraction. - Experience creating scrapers for e-commerce platforms. Website lazada .

I am looking for a proficient Python developer who has experience with Hugging Face and Gradio to create a small text classification application. This project involves the following key aspects: - **Functionality:** The primary objective of the application is to perform text classification. This means that it should be able to analyze given text and assign it to a specific category or label. - **Deployment:** The application should be deployed as a web application. Key Skills and Experience: - NLP, Machine Learning - Proficiency in Python. - Experience with Hugging Face - Gradio. - Prior experience in developing text classification applications. - Familiarity with web application deployment processes. Please note, the application does not need to support mult...

...desire; Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. ...

Hello Everyone, I need an expert developer for my on going project. We wanna make a visualizer where user can change vehicle body color. So I need expert person who has previous experience on this area. If you are new and you think you are good fit this this position then feel free apply on this job. I'll talk details in private chat. Thanks in advance

I'm looking to build a custom scraper for DeFi exchanges. The main features I'm interested in are: - Historical data analysis: This is crucial for me to make well-informed decisions about the market trends. - Real-time data updates: Although not explicitly...explicitly stated in the questions, the bot will need to be able to update data in real-time. This will help me stay ahead of the market. I currently prefer the output in CSV format, as it is easy and widely used. Given the nature of the DeFi space, experience in cryptocurrency scraping bots is a must. It would be ideal to have experience with DeFi exchanges particularly. This project will require strong skills in programming languages such as Python, R, or JavaScript, as well as experience in ...