在线时间:8:00-16:00
迪恩网络APP
随时随地掌握行业动态
扫描二维码
关注迪恩网络微信公众号
开源软件名称(OpenSource Name):YoongiKim/AutoCrawler开源软件地址(OpenSource Url):https://github.com/YoongiKim/AutoCrawler开源编程语言(OpenSource Language):Python 100.0%开源软件介绍(OpenSource Introduction):AutoCrawlerGoogle, Naver multiprocess image crawler (High Quality & Speed & Customizable) How to use
Argumentsusage:
Full Resolution ModeYou can download full resolution image of JPG, GIF, PNG files by specifying --full true Data Imbalance DetectionDetects data imbalance based on number of files. When crawling ends, the message show you what directory has under 50% of average files. I recommend you to remove those directories and re-download. Remote crawling through SSH on your server
CustomizeYou can make your own crawler by changing collect_links.py IssuesAs google site consistently changes, please make issues if it doesn't work. |
2023-10-27
2022-08-15
2022-08-17
2022-09-23
2022-08-13
请发表评论