Batch Scraper System Development

Batch Scraper System Development Project Overview: We are seeking an experienced programmer to develop a system for scraping a Gig App (Ask for Details). The goal of this project is to create a tool that can efficiently retrieve and display available Batches from the Gig App/platform. The bot needs to do this within a few tenths of a second. In some warehouses, this process can be too long, so additional scripting needs to be done to minimize computations and delays to beat out other scripts without using too many resources. Getting Routes (Batches) in these stores can be impossible unless there are more batches than Scripts or those batches come out at the last minute, preventing drivers that are not close by from accepting them. Key Responsibilities: Scraping Batch Data: Develop a system that can scrape and extract information available from the Gig. This includes details such as batch times, locations, and any other relevant data. Real-Time Updates: Ensure that the system provides real-time updates on the availability of Batch, allowing users to quickly identify and claim open shifts. User Authentication: Implement a secure user authentication system to enable authorized access to the scraped data. User-Friendly Interface: Create an intuitive and user-friendly interface that allows users to easily navigate and interact with the scraped information. Scalability: Design the system to be scalable, accommodating potential changes to the Gig platform and handling a growing user base. What needs to be done: Full website design (Front-Back End) Dashboard for Admin Server configuration Payment Integration Bot Development (Script) Geolocation Spoofing Web App Ideal Skills and Experience: - Experience in web scraping and data extraction. - Proficiency in programming languages such as Python or Java. - Knowledge of HTML and CSS for website design. - Familiarity with scraping tools and libraries such as Beautiful Soup or Scrapy, Selenium. - Experience in developing systems with real-time functionality. - Knowledge of secure authentication practices. - Reverse Engineer Private APIs - Server Setup and Optimization Budget: The budget for this project will be discussed based on the proposed approach, the complexity of the system, and the estimated development time. How to Apply: Please submit your proposal, including relevant experience, a proposed development plan, and an estimated timeline. Additionally, share any similar projects you have completed in the past. We look forward to reviewing your proposals and collaborating with a skilled programmer to bring this project to fruition.