MediaCrawler: a multi-platform Chinese social media crawler
MediaCrawler is an open-source crawler that collects posts and comments from XiaoHongShu, Douyin, Kuaishou, Bilibili, Weibo, Tieba and Zhihu; trending this week.
MediaCrawler is a Python project that collects data from multiple Chinese social media platforms. It supports scraping posts and comments from major platforms for data analysis and research.
Key points
- Covers XiaoHongShu, Douyin, Kuaishou, Bilibili, Weibo, Tieba, Zhihu.
- Scrapes both posts and comments.
- Written in Python and open source.
- Trending on GitHub this week.
Source
GitHub
#web scraping#Python#data
This summary was written by the ORA·tech AI assistant. Read the original for full context.
Related
Tools, IDE & Open Source
Claude Code 2.1.207 defaults Bedrock/Vertex to Opus 4.8
Tools, IDE & Open Source
Immich 3.0 lands: breaking API changes, drops pgvecto.rs, adds Workflows and mobile editing
Tools, IDE & Open Source