python爬虫项目合集，从基础到js逆向，包含基础篇、自动化篇、进阶篇以及验证码篇。案例涵盖各大网站(xhs douyin weibo ins boss job，jd...)，你将会学到有关爬虫以及反爬虫、自动化和验证码的各方面知识

BaiduSpider，一个爬取百度搜索结果的爬虫，目前支持百度网页搜索，百度图片搜索，百度知道搜索，百度视频搜索，百度资讯搜索，百度文库搜索，百度经验搜索和百度百科搜索。

python3网络爬虫笔记与实战源码。记录python爬虫学习全程笔记、参考资料和常见错误，约40个爬取实例与思路解析，涵盖urllib、requests、bs4、jsonpath、re、 pytesseract、PIL等常用库的使用。

A simple distributed crawler for zhihu && data analysis

Python Crawler

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

It's designed to be a simple, tiny, pratical python crawler using json and sqlite instead of mysql or mongdb. The destination website is Zhihu.com.

🐍A collection of simple Python crawlers.

豆瓣电影爬虫: 电影信息 + 影评 + 短评

这是也一个爬虫教学的项目

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

This repo is mainly for dynamic web (Ajax Tech) crawling using Python, taking China's NSTL websites as an example.

just for python learning.

keep watching new bug bounty (vulnerability) postings.

支持多种爬取方式，下载用户相册，爬取用户帖子，爬取实时搜索帖子等，欢迎下载使用和补充功能

大三课设。本项目是一个基于Django框架的股票分红数据爬虫和展示系统。它可以从东方财富网站爬取股票分红数据，并将数据存储到Django数据库中，同时提供数据查询、导出和图表展示功能。

Python airline/flights data crawler

🐍🗺️ This Python script empowers you to scrape data from Google Maps, enabling extraction of valuable information like addresses, reviews, and ratings. 📋🏢⭐

a simple web of data visualization

A web crawler which crawls the stackoverflow website.