We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
from POISpider import BaiduPOISpider
keylist=['PMLZOZz6vGSaX4oYIYdWOcKYgSFH76Ep','OTLl9wZMVFTh22Wy7Kie908sSMyu5HNF'] spider=BaiduPOISpider() spider.set_key(keylist,thread_protect=3)
#批量抓取POI spider.getPOI_byBatch('Demo/book1.csv')
运行结果：
动POI抓取批处理... ----------OSpider----------------------------------------- 自定义文件抓取任务：(幼儿园,教育培训,https://geo.datav.aliyun.com/areas_v2/bound/330200.json)启动： 读取抓取区域中... 抓取区域读取完毕... 开启多线程POI抓取任务... 正在执行切片分析... 分析切片中，队列剩余：14
Key:OTLl9wZMVFTh22Wy7Kie908sSMyu5HNF失效 Key:PMLZOZz6vGSaX4oYIYdWOcKYgSFH76Ep失效
分析切片中，队列剩余：14 分析切片中，队列剩余：14 分析切片中，队列剩余：14
The text was updated successfully, but these errors were encountered:
No branches or pull requests
from POISpider import BaiduPOISpider
keylist=['PMLZOZz6vGSaX4oYIYdWOcKYgSFH76Ep','OTLl9wZMVFTh22Wy7Kie908sSMyu5HNF']
spider=BaiduPOISpider()
spider.set_key(keylist,thread_protect=3)
#批量抓取POI
spider.getPOI_byBatch('Demo/book1.csv')
运行结果：
动POI抓取批处理...
----------OSpider-----------------------------------------
自定义文件抓取任务：(幼儿园,教育培训,https://geo.datav.aliyun.com/areas_v2/bound/330200.json)启动：
读取抓取区域中...
抓取区域读取完毕...
开启多线程POI抓取任务...
正在执行切片分析...
分析切片中，队列剩余：14
Key:OTLl9wZMVFTh22Wy7Kie908sSMyu5HNF失效
Key:PMLZOZz6vGSaX4oYIYdWOcKYgSFH76Ep失效
分析切片中，队列剩余：14
分析切片中，队列剩余：14
分析切片中，队列剩余：14
The text was updated successfully, but these errors were encountered: