Skip to content

Issues: dataabc/weiboSpider

简化cookie的获取教程
#610 opened Nov 15, 2024 by Zemelee
Open 1
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

70 Open 484 Closed
70 Open 484 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

运行一会下载了89条数据后，weibo.cn就访问不了。是被反爬策略禁止了吗？ failed 程序运行出错
#626 opened Dec 25, 2024 by dahai001
1
File "D:\Ancaonda\Lib\site-packages\scrapy\core\spidermw.py", line 104, in process_sync for r in iterable: File "D:\Python Project\weibo-search-master\weibo\spiders\search.py", line 241, in parse_by_hour_province for weibo in self.parse_weibo(response): File "D:\Python Project\weibo-search-master\weibo\spiders\search.py", line 537, in parse_weibo weibo["ip"] = self.get_ip(bid) ~~~~~^^^^^^ File "D:\Ancaonda\Lib\site-packages\scrapy\item.py", line 85, in __setitem__ raise KeyError(f"{self.__class__.__name__} does not support field: {key}") KeyError: 'WeiboItem does not support field: ip' bug
#625 opened Dec 19, 2024 by ycwang806
WeiboItem does not support field: ip failed 程序运行出错
#624 opened Dec 19, 2024 by ycwang806
你好，我在setting.py中设置WEIBO_TYPE = 0，就运行不了，爬取不了数据是为什么。并且设置WEIBO_TYPE=2或者1的时候爬取不到头条url和发布位置和reweet_id是为什么# 要搜索的微博类型，0代表搜索全部微博，1代表搜索全部原创微博，2代表热门微博，3代表关注人微博，4代表认证用户微博，5代表媒体微博，6代表观点微博 failed 程序运行出错
#623 opened Dec 18, 2024 by sansan303
3
安装依赖出现问题 failed 程序运行出错
#622 opened Dec 12, 2024 by Rexreak
1
爬取视频失败 failed 程序运行出错
#618 opened Dec 9, 2024 by cqc01
1
爬取近x天或近x条的功能 feature 新需求
#617 opened Dec 7, 2024 by Takigawamiu
1
请问一下这个spider和那个crawler有什么区别啊？哪个比较好用？
#613 opened Dec 5, 2024 by raymond8023
1
请问可以获取到某条微博的视频播放量数据吗？ feature 新需求
#612 opened Dec 3, 2024 by viyiY2K
3
cannot import name 'etree' from 'lxml' bug
#611 opened Nov 19, 2024 by Ehcochwy
2
简化cookie的获取教程 feature 新需求
#610 opened Nov 15, 2024 by Zemelee
1
end_date 设置为 now 无法正常爬取所有微博 failed 程序运行出错
#609 opened Nov 8, 2024 by cinyearchan
2
某个微博id无法抓取到全部微博 bug
#607 opened Oct 15, 2024 by wyslmt
8
能否获取某个地区的签到信息 feature 新需求
#606 opened Oct 13, 2024 by beautifulxu
1
报错indexerror failed 程序运行出错
#604 opened Sep 30, 2024 by Elena-zhan
3
爬取大量微博内容如何解除限速 failed 程序运行出错
#603 opened Sep 24, 2024 by bareawayme
1
line 1: b'ID C_5074630370399522 already defined' (line 1) failed 程序运行出错
#602 opened Sep 4, 2024 by cinyearchan
1
指定用户2011年8月4号之前的微博内容爬取失败 failed 程序运行出错
#601 opened Aug 26, 2024 by cinyearchan
2
关于微博爬虫对于“网页链接”的爬取 feature 新需求
#600 opened Aug 23, 2024 by mTommy777
4
运行出错 failed 程序运行出错
#599 opened Aug 4, 2024 by yinqinghe
3
在为特定用户加入独立since date时爬取失败 bug
#598 opened Aug 1, 2024 by abcabcaaaB
2
右上角的微博视频号水印能不能找到无水印的视频链接
#597 opened Jul 30, 2024 by yanghouqing
3
抓取一批账号信息，账号信息还没有抓取结束，但程序运行到一半就会报错，报错之后的数据抓取全部丢失，稳定复现，请问如何解决 failed 程序运行出错
#596 opened Jul 19, 2024 by tonymao51
3
无法安装环境lxml4.9.1 failed 程序运行出错
#594 opened Jul 3, 2024 by oliverance
7
运行出错，无法连接 failed 程序运行出错
#593 opened Jun 19, 2024 by alexhill2020
2
ProTip! Type g i on any issue or pull request to go back to the issue listing page.