
In Progress
Posted
Paid on delivery
I have a set of URLs that point to various procurement and tender-posting sites, and I need every relevant tender detail extracted. You’ll be working exclusively from the links I supply, so there’s no site discovery involved—just clean, reliable scraping. One of the sites will require OTP and other sites will require captcha. Requested data The target pages list tender notices; for each notice I need the essential fields (title, reference number, issuing body, publication and closing dates, link to full notice, etc.) captured consistently across all sites. If additional obvious fields appear, include them as well. Output format Everything must arrive in a single, well-structured Excel spreadsheet, one row per tender with clear column headings. Please normalise dates and strip duplicates so the file is immediately usable for analysis. Technical approach Feel free to employ Python, Scrapy, BeautifulSoup, Selenium or any combination that handles pagination, dynamic content or CAPTCHA challenges. The key is repeatability: I’d like to rerun the script later, so provide clean, documented code. Deliverables • Final Excel workbook containing all scraped tender records • Runnable script or notebook with brief setup instructions • I will want the script to be running on daily basis and will also need it to be updated on any changes on the website in the future. • The source code will belong to us and is not to be shared with anyone else Accuracy, respectful site access, and timely delivery are paramount. When you reply, outline your proposed workflow, expected turnaround, and examples of similar scraping projects you’ve completed.
Project ID: 40618494
54 proposals
Remote project
Active 2 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
54 freelancers are bidding on average ₹7,885 INR for this job

With my extensive experience as a Web-Scraping Specialist, I have successfully worked on similar projects like yours, extracting data from various websites including those with advanced anti-bot protection like Cloudflare and Incapsula. I am proficient in using Python, Selenium, BeautifulSoup, Scrapy and Requests to scrape even the most complex or protected websites. I assure you of delivering clean, well-structured, and reliable data in your desired format of Excel. My approach to your project will be through building a scalable solution that can be repeated with ease as well as updating it in the case of any future website changes. For instance, dealing with CAPTCHA or OTP challenges will not hinder me as they are routine for me to handle. In addition to that, I will ensure accurate extraction of the essential fields mentioned in your description and also any additional apparent fields that surface in the process. Notably, my proposal comes packaged with detailed documentation of the clean code used in developing the script or notebook for running the scraping process. You can expect a prompt turnaround and a delivery with zero errors as accuracy is paramount in all my projects. As for confidentiality, I absolutely respect your concerns as the source code will solely belong to you and not be shared with anyone else. Choose me for this task and get ready to receive professional-grade services tailored specifically to your needs!
₹7,000 INR in 7 days
7.5
7.5

Hello I am experienced data scraping specialist and I have completed a lot of Web Scraping projects here I am ready to start working immediately, there is needed to just clarify few questions, at first - what is URL of site to scrap data from? Thanks.
₹2,800 INR in 1 day
7.2
7.2

Hello, I can build a reliable Python-based scraper to extract tender details from all the URLs you provide into a single, well-structured Excel file. The solution will handle pagination, dynamic content. I have experience developing web scraping and automation solutions using Python, Selenium, BeautifulSoup, Scrapy, and data processing with Pandas, including handling dynamic websites, scheduled scraping, and structured Excel exports. I understand that the source code will be your exclusive property and will not be shared with anyone else. I look forward to discussing your URLs and getting started. Regards Karim
₹7,000 INR in 4 days
6.0
6.0

Hi there, Myself suganya, hope you are doing good. I am interested in Tender Data Web Scraping straightforward project. kindly share the details to do sample now. waiting for your message. Thanks
₹3,333 INR in 3 days
5.7
5.7

I will deliver tender details from supplied URLs in an Excel spreadsheet, handling OTP and CAPTCHA. I commit to completing this within the given budget. Can I start with a free sample? Waiting for your response in chat! Best Regards.
₹7,000 INR in 3 days
5.5
5.5

Hello there, I have done similar work earlier for my many client's with 100% satisfaction, Let's initiate chat, I can start your project right now with 100% accuracy and within time deadlines. I am happy to provide you a sample work. Please let me know. Thank you.
₹7,000 INR in 3 days
5.2
5.2

I can develop a reliable Python-based scraper to extract tender details from all the URLs you provide, including handling dynamic pages, pagination, OTP-assisted login (with your support for authentication), and CAPTCHA-compatible workflows where applicable. The output will be a clean, deduplicated Excel file with normalized dates and consistent fields. I'll deliver well-documented, reusable source code that can be scheduled for daily execution and maintained for future website changes. I have experience building large-scale web scraping and data extraction solutions using Selenium, Playwright, BeautifulSoup, Scrapy, and Pandas.
₹4,000 INR in 1 day
5.2
5.2

Hi there yeah I'm expertise in scrapping and I can do this in python programming language Kindly send me a message we'll discuss further Really looking forward to hearing from you Thank you
₹7,000 INR in 1 day
5.3
5.3

Hi Client ! i have read the project description and i fully confident to complete this scrip in 2 days with the testing and documentation , Thanks
₹25,000 INR in 2 days
5.0
5.0

★★★ TOP 1% IN FREE LANCER WORLD ★★★ ★★★ 20+ Year Experience in IBD being CMD★★★ ★★★ 200+ Country Satisfied Clientele ★★★ ★Linkedin★ ★Data Entry★ ★Business Plans★★★ ★★★ Operational Strategic planner Customer Support 24*7★★★ ★★★Excel/Word Operation★★★ ★★★Chat Support★★★ ★★★Calling Support★★★ ★★★Business Plans / Marketing Strategy ★★★ * Digital Marketing★★★ ★★★Social Media Marketing ★★★ ★★★Internet Marketing ★★★ ★★★Any type of Data Projects★★★ ★★★★★★ Regards, ★★★CMD★★★ ★★★PVSYS GROUP (INDIA)★★★ ★★★IF YOU THINK THEN I CAN★★★
₹12,500 INR in 33 days
5.1
5.1

Hello, Your project aligns well with my experience in Python web scraping, browser automation, data extraction, OCR integration, and workflow automation. I’ve built scalable scraping solutions using Playwright, Selenium, Scrapy, BeautifulSoup, and Pandas, including projects involving authenticated portals, scheduled data collection, and structured Excel reporting. I can develop a robust scraper that extracts tender details from all the URLs you provide, normalises the data into a single Excel file, removes duplicates, and includes additional relevant fields where available. The solution will be modular, well-documented, and designed for scheduled daily execution with detailed logging and easy maintenance. If you’d like a more scalable solution, I can also develop a Python-based web application that runs on your local PC or VPS, allowing you to manage source URLs, schedule daily scraping, monitor job status, review logs, and download Excel reports from any desktop or mobile browser. Before we begin, could you please share the list of tender website URLs and clarify how OTP authentication is expected to be completed (manual approval or an official API/integration)? This will help me recommend the most reliable architecture. I’m ready to start immediately and can deliver clean source code, deployment support, comprehensive documentation, and a solution that’s easy to extend as webapp evolve.
₹45,000 INR in 12 days
5.2
5.2

As an AI, Data & Automation expert with extensive experience in data extraction and mining, I possess a unique set of skills that perfectly align with your project needs. With proficiency in Python, Selenium, and Excel - combined with my past experience working on similar web scraping projects - I can provide you with a highly efficient and reliable solution. I understand the importance of clean, well-structured data, so rest assured that every field you need will be captured consistently and normalized to allow immediate usability for analysis. Moreover, my approach is focused on repeatability - an important aspect for you as you intend to re-run the script later. You can count on me to deliver clean and documented code that ensures long-term scalability and ease of maintenance. My workflow includes effective handling of OTPs, captchas, pagination, and dynamic content using a combination of Python, Scrapy, BeautifulSoup, and Selenium - all aimed at guaranteeing accurate data extraction even from the most challenging websites.
₹12,000 INR in 2 days
4.7
4.7

Hi, I have experience building Python based web scraping and automation solutions using Selenium, BeautifulSoup, Scrapy, and APIs. I can build a reliable scraper that extracts tender data, handles dynamic websites, and delivers clean, deduplicated Excel reports with documented source code. The solution will be easy to rerun, maintain, and extend for daily automation. I am available to start immediately and look forward to discussing your requirements.
₹6,000 INR in 2 days
4.3
4.3

Hello Sir/Madam, we are a team of senior AI ML Full Stack Web and Mobile App Developers. Please, send me a message to discuss the work and finish in no time. Thanks Ashish Kumar.
₹7,000 INR in 7 days
4.5
4.5

Hi, I can build a reliable Python-based scraper to extract tender details from all the URLs you provide and deliver the data in a single, well-structured Excel file with normalized fields and duplicate removal. The solution will handle pagination, dynamic content, and sites requiring OTP/CAPTCHA where feasible with your assistance for authentication. I'll provide clean, well-documented source code that you own entirely, along with setup instructions so it can be scheduled to run daily and updated as websites change.
₹4,500 INR in 3 days
3.7
3.7

Your project requires extracting tender information from a fixed list of procurement websites into a single, clean Excel file while keeping the process reliable for daily reruns. I will build a Python based scraper using Selenium, BeautifulSoup, and Playwright where needed to handle dynamic pages, pagination, OTP assisted login, and CAPTCHA dependent workflows. The data will be standardized with consistent date formats, duplicate removal, and all key fields captured in one structured workbook. The code will be clean, documented, and easy to rerun, with simple setup instructions so future maintenance and site updates remain straightforward. I understand the source code will be exclusively yours. Please share the list of URLs, and we can discuss the expected turnaround and the best approach for daily automation.
₹2,000 INR in 2 days
3.9
3.9

Welcome to professional Python development services! Hi there, I'm Alema, a Python expert programmer who strives for clear code in atmospheric, numerical weather prediction, physics, and all other seminal fields. I'm ready to provide you with high-quality services. I have completed 350+ projects with a 100% Positive Rating. If you are looking for Quality work, look no further. Tech stack: Python, FastAPI, Django PostgreSQL, SQLAlchemy React, JavaScript, TypeScript Docker, Docker Compose CI/CD (GitHub Actions, GitLab CI) AWS (EC2, S3, Lambda, ECS), DigitalOcean, Heroku NGINX, Caddy If you're looking for a reliable Python backend developer to help with your project, feel free to reach out. Your faithfully. Eng. Alema Akter
₹7,000 INR in 1 day
3.6
3.6

< Hi — Abror-Yakubov here from Uzbekistan > "TENDER DATA WEB SCRAPING" — you need a reliable script that pulls tender details from your list of URLs. I will build a Python Scrapy/Selenium pipeline that handles pagination, solves captchas with Selenium, and manages OTP via user‑provided credentials. The scraped fields will be normalized and saved to a single Excel workbook with clean column headings. I have previously automated a similar data extraction for a procurement portal using Python and Selenium, delivering a ready‑to‑use spreadsheet. The script will include clear comments and a short setup guide, so you can run it daily or adjust it if the source sites change. What authentication method (OTP email, SMS, or app) does the site requiring OTP use? Looking forward to working with you.
₹1,500 INR in 7 days
3.1
3.1

Hi, I can build a repeatable tender data scraping workflow from the URLs you provide and deliver clean tender records in a structured Excel file. The best solution is to first review all target sites, required fields, login/OTP flow, captcha points, pagination, and daily refresh needs. I’ll then create a Python-based scraper using Scrapy/BeautifulSoup/Selenium where required, normalize the data, remove duplicates, and export everything into one Excel workbook. I’m comfortable with Python, Selenium, Scrapy, BeautifulSoup, Excel exports, tender data extraction, pagination handling, dynamic websites, scheduled daily runs, logging, and maintainable scraping code. Deliverables include: * Tender scraping script * Excel workbook output * Title, reference number, issuing body * Publication and closing dates * Full notice links * Extra available fields * Duplicate removal * Date normalization * Daily scheduler setup * Setup instructions * Source code handover For OTP/captcha-based sites, I’ll use authorized access and human-in-the-loop handling rather than unsafe bypass methods. I’ll focus on accuracy, respectful site access, clean code, and future maintainability. Best regards Ankit
₹5,000 INR in 1 day
3.1
3.1

The OTP site is the real bottleneck here, not the captcha ones -- those I can handle with standard solvers, but OTP flows usually need a manual trigger step or a token you can share each run. I'd build this in Python (Selenium/Playwright for the dynamic and auth-gated sites, BeautifulSoup for the static ones), normalize all dates to one format, dedupe on reference number, and output one clean Excel file with consistent headers across sources. Script gets documented and scheduled to run daily, with selectors modularized so a site layout change means editing one config, not rewriting the whole thing. Code stays fully yours, no reuse elsewhere. I've built similar multi-site tender/listing scrapers before and can send a sample output. Want me to test on 2-3 of your URLs first so you can see the field mapping before we commit to the full set?
₹5,999 INR in 2 days
3.3
3.3

Kolkata, India
Payment method verified
Member since Jan 3, 2025
₹1500-12500 INR
₹12000-18000 INR
£750-1500 GBP
₹12500-37500 INR
$15-25 USD / hour
$8-15 USD / hour
₹12500-37500 INR
$1500-3000 USD
£10-20 GBP
₹750-1250 INR / hour
€30-250 EUR
$30-250 USD
₹1500-12500 INR
$10-30 USD
₹750-1250 INR / hour
₹750-1250 INR / hour
$15-25 USD / hour
₹750-1250 INR / hour
$250-750 USD
$25-50 USD / hour
$40-60 USD
₹750-1250 INR / hour