Find Jobs
Hire Freelancers

Twitter Scraper for recent tweets

₹12500-37500 INR

Completed
Posted 11 months ago

₹12500-37500 INR

Paid on delivery
I am looking to get a twitter scraper developed that should be able to scrape recent tweets from a given list of twitter profiles. - I may have a few dozen twitter profiles to scrape for tweets in the last 24 hours - I'll provide them in a text file - one on each line - Twitter now needs a login to be performed before the profiles are scraped. I should be able to configure the login before the process could be started. - The process should log in to twitter in the browser and then visit the profiles one by one and then scrape their tweets in the last 24 hours only - The tweets should be output in a CSV format as per attached. I'm okay with any tech you may want to use to achieve the objective. The deliverable will be a process that will run on my machine (Macbook) (and could use Chrome/Chromium in a headless manner)
Project ID: 36829516

About the project

13 proposals
Remote project
Active 11 mos ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
₹0 INR in 7 days
5.0 (38 reviews)
5.7
5.7
13 freelancers are bidding on average ₹27,655 INR for this job
User Avatar
Hi there! I'm George, a web crawler expert with over 8 years of experience in building data extraction tools. Recently I and my team built a custom web scraping tool that already solves some of the tasks described in the job description. I'd love to take a look at the task and suggest a solution. 1. What is the frequency of scraping? 2. Are the twitter profiles consistently updated? 3. Is this scraper meant to scrape the profiles daily or more often? 4. What is the maximum latency you accept for scraping the profiles? 5. Do you have any timeline for the project completion? I look forward to discuss it with you! Best regards, George
₹41,013 INR in 3 days
5.0 (78 reviews)
7.7
7.7
User Avatar
I'm excited to hear that you are looking for a twitter scraper developed that should be able to scrape recent tweets from a given list of twitter profiles. With 5 years of professional experience in backend jobs, I am confident that I can provide the best solution for this project. My expertise includes web scraping, data entry, Excel macros and visual basic. This makes me well-versed in the necessary techniques needed to successfully complete this project. Additionally, I provide full customer satisfaction guarantee as well as support for all my clients. I look forward to hearing from you soon about this exciting project! Please feel free to contact me if you have any questions or would like more information about me or my services. Thank you for your time!
₹35,000 INR in 5 days
4.8 (75 reviews)
5.7
5.7
User Avatar
I am Ganesh and I am excited to help you with your project! With Python, C# .net, VB.Net , Web Api Core, ASP.NET Razor Core, ASP.NET MVC Core , Dot Net Core and Web Services experience, I am confident that I can develop the perfect twitter scraper for your needs. I understand that you are looking for a way to get a recent tweets from a given list of twitter profiles in the last 24 hours without needing the user's login. My process should allow me to log in to twitter in the browser before visiting each profile and then scrape their tweets in the last 24 hours only. The tweets should then be output in a CSV format as per attached.
₹25,000 INR in 7 days
5.0 (24 reviews)
5.3
5.3
User Avatar
I understand you are looking for a twitter scraper that can scrape recent tweets from a given list of twitter profiles. I believe I am the perfect fit for this project because of my last 2 years of extensive experience in web and scraping where i solved complex cases like captcha bypassing, rate limiting and WAF bypassing, Application signature headers, TLS bypassing. I am confident that I can provide the needed solutions for your project. With my expertise in these areas, I am able to produce robust code using Python which enables efficient and user-friendly experiences. I look forward to hearing from you soon! Please feel free to contact me if you have any questions or would like more information about me or my skillset.
₹25,000 INR in 7 days
5.0 (5 reviews)
4.1
4.1
User Avatar
Hi, my name is Wale, i am a web developer and bot developer with python as my primary language. I would be able to scrape the tweets from the specified profiles and also implement an headless login for the twitter session and have all the tweets extracted into a csv file based on the format you provide. I hope we can initiate a conversation and discuss further.
₹30,000 INR in 7 days
5.0 (1 review)
1.0
1.0
User Avatar
I understand that you are looking for a twitter scraper developed that should be able to scrape recent tweets from a given list of twitter profiles. I have 2 years of experience in Python, Web Scraping & Server Administration which makes me the perfect fit for this project. I have experience in developing live projects of Python, Django, SQL & Scrapy which makes me capable of handling any technical challenges that may arise during the project such as logins to be performed before the process could be started, visiting the profiles one by one and then scraping their tweets in the last 24 hours only. Additionally, I'm able to output the tweets in CSV format as per attached. I believe I am your best choice for this project due to my extensive experience in Python & web scraping along with the ability to configure logins before starting the process on your machine (Macbook). Please feel free to reach out with any additional questions or concerns regarding this project!
₹25,000 INR in 7 days
5.0 (1 review)
0.6
0.6
User Avatar
Hi! I am Pratik from WEBJET. I have read all your requirements. We are group of professional having expertise's in HTML, CSS, WORDPRESS, WEB DESIGN and WEB DEVELOPMENT. If you are tired of struggling to find teams that can effectively execute your projects while maintaining clear and efficient communication throughout the process? If so, then reach out to us. So, what's it like to working with us? First things first, we'll breakdown your project into manageable milestones. Then, we'll assign a dedicated point of contact to your project, so you can reach out to us at any time. And everyday at 10 AM, we'll update you on the project 's progress. Of course, if you have any additional requests, we'll do our best to accomodate them. The best part is that your payments will be completely secure if you create a milestone. This means your money will be held by the Freelancer.com team until you are satisfied with the results. I will deliver quickly, and if I can't, you will get your money back. With Regards, Pratik.
₹30,000 INR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Twitter Scraper for Recent Tweets Objective: The objective of this project is to develop a Twitter scraper that can retrieve recent tweets from a given list of Twitter profiles. The scraper will log in to Twitter, visit the specified profiles, and scrape their tweets from the last 24 hours. The scraped tweets will be saved in a CSV format. Proposed Solution: To achieve the objective, we will develop a Python-based Twitter scraper using the Selenium library for web automation. The scraper will utilize a headless Chrome/Chromium browser for browsing and interacting with Twitter. Deliverables: Python-based Twitter scraper script. Sample input text file containing Twitter profiles. Scraped tweet data saved in CSV format. Documentation and user guide explaining the usage and configuration of the scraper.
₹35,000 INR in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I can create Twitter Scraper for recent tweets I am an experienced Web developer and work on crypto currency development and equipped with all the necessary skills to provide you best website that completely satisfies your business needs. Please share your requirements with me over chat so we can proceed further. Best Regards, Neha
₹25,000 INR in 7 days
0.0 (1 review)
0.0
0.0
User Avatar
Hello, Greetings for the Day!!! I have gone through your requirement and understood every aspect of them. I can flawlessly get this job done, fulfilling your requirements as clean as possible. I have 5 years of experience in web scraping and automation, I am confident in my ability to deliver a reliable and efficient solution for your requirements. I understand the need to scrape tweets from multiple Twitter profiles, provided in a text file, within the last 24 hours. With the recent login requirements on Twitter, I will ensure the scraper can perform the login process, allowing seamless access to the profiles. The scraper will visit each profile and extract the desired tweets within the specified timeframe. I look forward to the opportunity to contribute my skills to your project. When you want this project to be completed? I would like to start off this project ASAP. let's talk and get it done. Thanks and regards Vishal G,
₹37,500 INR in 20 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear Sir, I hope this message finds you well. I am writing to submit my bid for the development of a Twitter scraper to extract recent tweets from a given list of Twitter profiles. I am confident that my technical expertise and experience in web scraping will enable me to deliver a robust and efficient solution that meets your requirements. I am excited about the opportunity to work with you on this project and confident that my skills and experience make me the ideal candidate for the job. I am committed to providing exceptional results that exceed your expectations. I am available to discuss the project further and answer any questions you may have. I look forward to the possibility of working together. Sincerely, Naeem
₹20,000 INR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear Client, Thank you for considering my proposal to develop a Twitter scraper that meets your requirements. I am excited about the opportunity to work on this project and provide you with a reliable solution. Based on your requirements outlined on Freelancer.com, I am confident that utilizing Node.js's Puppeteer library for scraping is the appropriate choice to achieve your objectives. Implementation Approach: 1. Profile List Input: You will provide a text file containing a list of Twitter profiles, with each profile listed on a separate line. The scraper will read this file to identify the profiles to scrape. 2. Login Configuration: The scraper will be configured to perform the necessary login process before initiating profile scraping. You will be able to provide the login credentials or any other required authentication details. 3. Headless Browser Automation: The scraper will utilize the Puppeteer library to run a headless Chromium browser on your Macbook. It will visit each profile from the list, navigate to their timeline, and scrape the tweets posted within the last 24 hours. 4. CSV Output: The scraped tweet data will be exported in CSV format, matching the structure outlined in the provided document. The CSV file will include relevant fields such as tweet content, author, timestamp, and any additional information as required. Thank you for considering my proposal. Looking forward to your positive response. Best regards, Nadeem
₹16,000 INR in 4 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of INDIA
Vasai, India
5.0
10
Payment method verified
Member since May 3, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.