This tool can be used to extract information from any website
$ apt-get update
$ apt-get upgrade
$ pkg install git
$ pkg install python
$ pkg install python2
$ git clone https://github.com/Ranajit199/WEB-INFO-
$ cd WEB-INFO
$ chmod +x *
$ python2 web-info.sh
TDTV2-Direct Version 1.00.1 • A Simple Web Scraper made to Extract Download Links from Todaytvseries2.com :) How to Works?? install all dependancies v
GetTss python Package extract gene TSS site form gencode/ensembl/gencode database GTF file and export bed format file. Install $ pip install GetTss Us
Shopee Scraper A web scraper in python that extract sales, price, avaliable stock, location and more of a given seller in Brazil. The project was crea
A web crawler script that crawls the target website and lists its links || A web crawler script that lists links by scanning the target website.
gogoanime-api-flask A simple flask application to scrape gogoanime website. Used for demo and learning purposes only. How to use the API The base api
cybernews A package that provides you Latest Cyber/Hacker News from website using Web-Scraping. Latest Cyber/Hacker News Using Webscraping Developed b
Scrapping the data from each page of biocides listed on the BAUA website into a csv file
Gypsylist gypsylist.py is a web scraper for nomadlist.com, made to avoid website restrictions. nomadlist.com is a website with a lot of information fo
Annex Bubt Scraping Script I think this is the first public repository that provides free annex-BUBT, BUBT-Soft, and BUBT website scraping API script
print () print ("name")
Source code(tar.gz)PaperRobot PaperRobot 是一个论文抓取工具，可以快速批量下载大量论文，方便后期进行持续的论文管理与学习。 PaperRobot通过多个接口抓取论文，目前抓取成功率维持在90%以上。通过配置Config文件，可以抓取任意计算机领域相关会议的论文。 Installation Down
YouTube data scraper To easily scrape any data from the youtube homepage, a youtube channel/user, search results, playlists, and a single video itself
Bean Seller A New Worlds market scraper. Deployment This must be installed on Windows as it uses the Windows api to do its stuff Install Prerequisites
wallstreetbets-tracker Using Python and Pushshift.io to Track stocks on the WallStreetBets subreddit.
cloudscraper A simple Python module to bypass Cloudflare's anti-bot page (also known as "I'm Under Attack Mode", or IUAM), implemented with Requests.
Forum Image Scraper Downloads images from forum threads Only works with forums which doesn't require a login to view and have an incremental paginatio
This is a simple website crawler which asks for a website link from the user to crawl and find specific data from the given website address.
An introduction to free, automated web scraping with GitHub’s powerful new Actions framework Published at palewi.re/docs/first-github-scraper/ Contrib
使用方法 python3 main.py + 配置好的文件 python3 main.py Verify.json python3 main.py NoVerify.json 以上分别对应有验证码的demo和无验证码的demo Tips: 你可以以域名作为配置文件名字加载：python3 main
WebScraping Web scraping Pyton program that scrapes Job website for python devel
Project A: WebScraper A script that prints out a list of all EXTERNAL references
Dissec A simple python web scraper. It gets a website and its contents and parses them with the help of bs4. Installation To install the requirements,
OSTA-La-Vista OSTA web scraper, for checking the status of school buses in Ottawa. Getting Started Using a Raspberry Pi, download Python 3, and option
Pythonic Crawling / Scraping Framework Built on Eventlet Features High Speed WebCrawler built on Eventlet. Supports relational databases engines like
Web-scraping - A bot using Python with BeautifulSoup that scraps IRS website (prior form publication) by form number and returns the results as json. It provides the option to download pdfs over a ra
Photon Incredibly fast crawler designed for OSINT. Photon Wiki • How To Use • Compatibility • Photon Library • Contribution • Roadmap Key Features Dat
Jobinja.ir Dataset Introduction This project is a simple web scraper that scraps pages of jobinja.ir concurrently and writes and update (if file gets
proxy scraper 🔎 Installation: git clone https://github.com/ebankoff/proxy_scraper Required pip libraries (pip install library name): lxml beautifulso
subscrape A Python scraper for substrate chains that uses Subscan. Usage copy co
Twitter Turbo / Auto Claimer / Swapper Version: 1.0 Last Update: 01/26/2022 Use this at your own descretion. I've only used this on test accounts and
1 Nov 28, 2021
6 Nov 21, 2022
5 Nov 29, 2022
2 Apr 29, 2022
1 Oct 29, 2021
4 Jun 2, 2022
1 Nov 30, 2021
5 Nov 24, 2022
4 Dec 3, 2022
47 Nov 23, 2022
7 Dec 03, 2022
4 Sep 21, 2022
91 Dec 08, 2022
2.6k Dec 31, 2022
9 Nov 16, 2022
1 Jan 10, 2022
15 Nov 24, 2022
47 Nov 09, 2022
2 Jul 22, 2022
2 Apr 26, 2022
11 May 06, 2022
1 Jan 28, 2022
173 Dec 05, 2022
1 Jan 04, 2022
9.3k Jan 02, 2023
3 Apr 15, 2022
19 Dec 07, 2022
14 Dec 15, 2022
6 May 02, 2022