hu17889 / go_spider

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

Date Created 2014-05-19 (10 years ago)

Commits 178 (last one 9 years ago)

Stargazers 1,828 (0 this week)

Watchers 154 (0 this week)

Forks 470

License mpl-2.0

Ranking

RepositoryStats indexes 589,134 repositories, of these hu17889/go_spider is ranked #28,212 (95th percentile) for total stargazers, and #10,049 for total watchers. Github reports the primary language for this repository as Go, for repositories using this language it is ranked #1,974/25,833.

hu17889/go_spider is also tagged with popular topics, for these it's ranked: go (#770/5943), crawler (#72/567), pipeline (#36/438), spider (#48/335)

Other Information

hu17889/go_spider has 2 open pull requests on Github, 12 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there are 21 open issues and 3 closed issues.

There have been 4 releases, the latest one was published on 2015-01-13 (9 years ago) with the name Version 1.2.

All Topics

go spider crawler pipeline schedule

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

0 commits on the default branch (master) since jan '22

No recent commits to this repository

Yearly Commits

Commits to the default branch (master) per year

Issue History

Languages

The only known language in this repository is Go

updated: 2024-11-26 @ 08:57am, id: 19928024 / R_kgDOATAT2A