在线时间:8:00-16:00
迪恩网络APP
随时随地掌握行业动态
扫描二维码
关注迪恩网络微信公众号
开源软件名称(OpenSource Name):gaspa93/googlemaps-scraper开源软件地址(OpenSource Url):https://github.com/gaspa93/googlemaps-scraper开源编程语言(OpenSource Language):Python 100.0%开源软件介绍(OpenSource Introduction):Google Maps ScraperScraper of Google Maps reviews. The code allows to extract the most recent reviews starting from the url of a specific Point Of Interest (POI) in Google Maps. An additional extension helps to monitor and incrementally store the reviews in a MongoDB instance. InstallationFollow these steps to use the scraper:
Note: Python >= 3.6 is required. Basic UsageThe scraper.py script needs two main parameters as input:
Example:
generates a csv file containing last 50 reviews of places present in urls.txt In current implementation, the CSV file is handled as an external function, so if you want to change path and/or name of output file, you need to modify that function. Additionally, other parameters can be provided:
For a basic description of logic and approach about this software development, have a look at the Medium post Monitoring functionalityThe monitor.py script can be used to have an incremental scraper and override the limitation about the number of reviews that can be retrieved. The only additional requirement is to install MongoDB on your laptop: you can find a detailed guide on the official site The script takes two input:
The main idea is to periodically run the script to obtain latest reviews: the scraper stores them in MongoDB up to get either the latest review of previous run or the day indicated in the input parameter. Take a look to this Medium post to have more details about the idea behind this feature. NotesUrl must be provided as expected, you can check the example file urls.txt to have an idea of what is a correct url. If you want to generate the correct url:
|
2023-10-27
2022-08-15
2022-08-17
2022-09-23
2022-08-13
请发表评论