lizongying / go-crawler

A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middleware and supports various parsing and storage methods. Additionally, it supports distributed deployment. 基于golang实现的爬虫框架，编写简单，性能强劲。内置了丰富的实用中间件，支持多种解析、保存方式，支持分布式部署。

lizongying
lizongying
Date Created 2023-04-20 (about a year ago)
Commits 227 (last one 11 months ago)
Stargazers 111 (0 this week)
Watchers 4 (0 this week)
Forks 16
License unknown
Ranking

RepositoryStats indexes 579,238 repositories, of these lizongying/go-crawler is ranked #268,886 (54th percentile) for total stargazers, and #371,611 for total watchers. Github reports the primary language for this repository as Go, for repositories using this language it is ranked #13,550/25,472.

lizongying/go-crawler is also tagged with popular topics, for these it's ranked: golang (#4,723/8008),  crawler (#354/559),  scraping (#180/340),  spider (#222/332),  scrapy (#91/163)

Other Information

lizongying/go-crawler has Github issues enabled, there are 2 open issues and 5 closed issues.

There have been 5 releases, the latest one was published on 2023-11-23 (11 months ago)

Homepage URL: https://lizongying.github.io/go-crawler/

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

227 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The primary language is Go but there's also others...

updated: 2024-11-05 @ 09:01am, id: 630275096 / R_kgDOJZE8GA