It uses JavaScript and a web browser (for example, Firefox) to scrape tweets.

Overview

Twitter JS Scraper

License: MIT

Introduction

There are many tools available for collecting tweets. Some of these tools make use of the official Twitter API, which has a number of limitations. Other tools collect tweets using selenium and Python. This repository allows you to collect tweets using just your web browser.

Usage

  • Open your browser. For me, it is Firefox.
  • Search on Twitter for the phrase you want. As an example, I search for #Elon Musk.
  • Click the latest tab to see the latest tweets. Advanced Search can be used as well.
  • Right-click the screen and click Inspect (Q).
  • Then click the Console tab.

Tweet collector

Use the code in the tweet_collector.js file to collect tweet text, number of likes, retweets, replies, tweet ID (Status), time and username. Copy the code and paste it into the Console tab, and then press Enter. By doing this, the script will run and automatically scroll the page and collect tweets. When the scrolling is complete, or you have collected the desired amount of tweets, paste the code inside extract_tweets.js in the console tab and press Enter. This will save a file called tweets.txt. In the tweet_collector.js file, the number 100000 indicates the number of times you want to scroll. The number 500 also indicates that scrolling is performed every 500 milliseconds. Adjust these values to suit your needs.

Username collector

To collect usernames of people who: -Liked a tweet -Retweeted a tweet -Followers of a person -Following of a person Use the code in the username_collector.js file. For example, I open the Elon Musk following page. Then paste the above code in the Console tab and then press Enter.

Extract usernames

Use the code in the extract_usernames.js file to save the collected usernames.

If you open the page of people who liked / retweeted a tweet and use the code inside username_collector.js file, you will notice that the scrolling does not work properly. This problem is solved using the following method:

License

The project is available as open source under the terms of the MIT License.

You might also like...

A Twitter bot that reads the tweets of a given username and analyzes the user's personality using AI.

Twitter Chatgpt Analysor Create a bot that reads the tweets of a given username and analyzes the user's personality using artificial intelligence.. In

May 9, 2023

Cumcord loader on Browser (Chrome, Firefox, etc)

CumLoad CumLoad is a Chrome Extension that allows you to load Cumcord and plugins inside your Discord pages. We recommend using the MV2 version becaus

Nov 7, 2022

Official companion browser extensions for Kagi Search (Chrome, Firefox)

Kagi Search Extension This contains the source for the Kagi Search extension for Firefox and Chrome. Get it for your browser here: Chrome Firefox Cont

Nov 25, 2022

A Twitter bot that tweets all ERC-721 NFT sales for a given contract 🤖

NFT Sales Twitter Bot 🤖 This was made to succeed my Opensea Sales Twitter Bot repo; while relying on the OpenSea Events API is simpler, it doesn't in

Jan 2, 2023

Generate #techtwitter tweets with OpenAI via Telegram.

Generate #techtwitter tweets with OpenAI via Telegram.

Responsible AI Hot Takes Generate and tweet awesome #techtwitter content with OpenAI via Telegram. After following FireShipIO's tutorial and hearing o

Mar 19, 2022

A logseq plugin to extract tweets. Optionally tag the tweet's author as well.

A logseq plugin to extract tweets. Optionally tag the tweet's author as well.

Logseq Twitter Extractor Plugin If this plugin helps you, I'd really appreciate your support. You can buy me a coffee here. A quick utility to parse a

Nov 17, 2022

Hides all the @saveToNotion @memdotai @threadreaderapp tweets from your Twitter timeline

This is a Plasmo extension project bootstrapped with plasmo init. Getting Started First, run the development server: pnpm dev # or npm run dev Open yo

Oct 11, 2022

🚀 A web extension starter built with React, Typescript, and Tailwind CSS. Build once, and run on multiple browsers: Google Chrome, Mozilla Firefox, Microsoft Edge, Brave, and Opera..

🚀 A web extension starter built with React, Typescript, and Tailwind CSS. Build once, and run on multiple browsers: Google Chrome, Mozilla Firefox, Microsoft Edge, Brave, and Opera..

Web Extension Starter A web extension starter, built with React, Typescript, and Tailwind CSS. Build once, and run on multiple browsers: Google Chrome

Dec 28, 2022
Owner
vahid baghi
vahid baghi
Free to use and not for sale. This repo uses scrape or data.json

Aine-MD This script is free, if caught sold, this script will be deleted immediately. Don't forget to follow my github Script ini gratis, Jika ketahua

Aine 119 Dec 30, 2022
Grupprojekt för kurserna 'Javascript med Ramverk' och 'Agil Utveckling'

JavaScript-med-Ramverk-Laboration-3 Grupprojektet för kurserna Javascript med Ramverk och Agil Utveckling. Utvecklingsguide För information om hur utv

Svante Jonsson IT-Högskolan 3 May 18, 2022
Hemsida för personer i Sverige som kan och vill erbjuda boende till människor på flykt

Getting Started with Create React App This project was bootstrapped with Create React App. Available Scripts In the project directory, you can run: np

null 4 May 3, 2022
Kurs-repo för kursen Webbserver och Databaser

Webbserver och databaser This repository is meant for CME students to access exercises and codealongs that happen throughout the course. I hope you wi

null 14 Jan 3, 2023
📈 AI powered web scraper that let's you scrape anything you want from the web including google search results

AI powered web scraper that let's you scrape anything you want from the web including google web search results from your terminal. And at the same ti

Udhay rajeev 27 Dec 27, 2022
An API that allows you to scrape blog posts and articles and get a list of notes or a summary back.

EZAI-Web-Scraper An API that allows you to scrape blog posts and articles and get a list of notes or a summary back. Recommendations Use browserless.i

null 9 Dec 8, 2022
The browser (chrome/firefox) extension that hides annoying login pop-ups in the Twitter web app

The browser (chrome/firefox) extension that hides annoying login pop-ups in the Twitter web app

MaySoMusician 36 Dec 6, 2022
Scrape From primbon.com

scrape-primbon Instalation : npm i scrape-primbon Usage: const { Primbon } = require('scrape-primbon') const primbon = new Primbon() Example const {

Dika Ardnt. 2 Apr 9, 2022
Scrape data from Instagram without applying for the authenticated API 🎯

scraper-instagram Scrape data from Instagram without applying for the authenticated API. Getting started Prerequisites NodeJS NPM or Yarn Install From

fabi.stehle 11 Jan 5, 2023
node.js script to scrape all top meme templates from https://imgflip.com/memetemplates

imgflip-scraper node.js script to scrape all top meme templates from https://imgflip.com/memetemplates Acknowledgements imgflip Run Locally Clone the

Abhishek Bhathela 3 Nov 12, 2022