在线时间:8:00-16:00
迪恩网络APP
随时随地掌握行业动态
扫描二维码
关注迪恩网络微信公众号
开源软件名称:gocolly/colly开源软件地址:https://github.com/gocolly/colly开源编程语言:Go 99.3%开源软件介绍:CollyLightning Fast and Elegant Scraping Framework for Gophers Colly provides a clean interface to write any kind of crawler/scraper/spider. With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Features
Examplefunc main() {
c := colly.NewCollector()
// Find and visit all links
c.OnHTML("a[href]", func(e *colly.HTMLElement) {
e.Request.Visit(e.Attr("href"))
})
c.OnRequest(func(r *colly.Request) {
fmt.Println("Visiting", r.URL)
})
c.Visit("http://go-colly.org/")
} See examples folder for more detailed examples. InstallationAdd colly to your
BugsBugs or suggestions? Visit the issue tracker or join Other Projects Using CollyBelow is a list of public, open source projects that use Colly:
If you are using Colly in a project please send a pull request to add it to the list. ContributorsThis project exists thanks to all the people who contribute. [Contribute]. BackersThank you to all our backers! |
2023-10-27
2022-08-15
2022-08-17
2022-09-23
2022-08-13
请发表评论