whtsky/maga
Another DHT crawler written in Python using asyncio (⭐ 139)
chenjiandongx/magnet-dht
✌️ Python3 BitTorrent DHT crawler (⭐ 974)
Cavaticovelia - Wikipedia
bug, known commonly as the aaa water treader, lava tube crawler, or lava tube water treader, is a water treader native to Hawaii. The insect's specific
Kerb crawler - Wikipedia
crawlers to proposition them are a common method for tackling kerb crawling. Kerb crawling is illegal in Canada, the United Kingdom, the United States, South
Tracked loader - Wikipedia
A tracked loader or crawler loader is an engineering vehicle consisting of a tracked chassis with a front bucket for digging and loading material. The
javagaorui5944/ProxyIpPool
:bullettrain_side:The Crawler Proxy IP Pool Component (⭐ 71)
ilsilfverskiold/ai-tech-news-bot
AI tech news crawler that summarizes what's trending based on your preferences (⭐ 63)
What Is a Bot? | How Bots Work & Types of Bots - Anura
Dec 5, 2025 · Bots follow pre-programmed instructions to interact with websites, APIs, or applications. Some are designed to index content (like search engine crawlers), while others imitate human …
trouze/prenotami-bot
Crawler that checks for open jure sanguinis citizenship appointments on Italy's Ministry of Foreign Affairs site Prenot@mi (⭐ 21)
lumyjuwon/KoreaNewsCrawler
A korean news crawler built to ingest large amounts of news data. (⭐ 224)
NaiboWang/EasySpider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。 (⭐ 44030)
gigablast/open-source-search-engine
Nov 20 2017 -- A distributed open source search engine and spider/crawler written in C/C++ for Linux on Intel/AMD. From gigablast dot com, which has binaries for download. See the README.md file at the very bottom of this page for instructions. (⭐ 1601)
linhnguyen215538/Volatility-Study
• Conducted a volatility study to develop pairs trading strategy by writing web crawlers that automated extracting 30 equity and ETF spot and options prices data from CBOE and Yahoo Finance • Utilized NumPy, Pandas, and SciPy packages to calculate implied volatility, realized vol…
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and…
crawlab-team/crawlab
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架 (⭐ 12176)
PyPi download counts seem unrealistic
Tags: python, web-crawler, pypi | Score: 79
fhamborg/news-please
news-please - an integrated web crawler and information extractor for news that just works (⭐ 2395)
Shattered Pixel Dungeon is an open-source traditional roguelike dungeon crawler
Points: 747 | Comments: 228 | Author: notamy
creekorful/bathyscaphe
Fast, highly configurable, cloud native dark web crawler. (⭐ 95)
dyweb/scrala
Unmaintained :whale: :coffee: :spider: Scala crawler(spider) framework, inspired by scrapy, created by @gaocegege (⭐ 113)