Search Results - RepositoryStats

domains tb0hdan

102

662

bsd-3-clause

30

World’s single largest Internet domains dataset

yacy colly scrapy dataset search-engines internet-domains

Created 2020-01-12

191 commits to master branch, last one 3 months ago

go-movies hezhizheng

77

251

mit

10

golang spider Crawler 爬虫电影

go colly redis docker golang movies spider crawler gocolly fasthttp

Created 2019-12-04

171 commits to master branch, last one about a month ago

pagser foolin

7

102

mit

3

Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler

go html page colly golang parser scrapy crawler goquery deserialization

Created 2020-04-19

109 commits to master branch, last one 8 months ago

tonovel-go hipig

20

88

mit

3

tonovel是一个简洁，干净的小说聚合系统

iris colly

Created 2020-03-24

9 commits to master branch, last one 2 years ago

slurp slurpcode

75

54

gpl-3.0

19

One repo to rule them all !!?!?!! 🤓 😎

Created 2018-09-08

2,442 commits to main branch, last one 10 days ago

gentlemanSpider Youngkingman

0

48

mit

1

基于colly，支持标签(xp)筛选和多线程加速的绅士漫画爬虫优雅实现

colly erohon golang hentai scraper

Created 2022-09-06

42 commits to main branch, last one about a year ago

crawl chieund

20

42

unknown

1

Teach daily is web crawl by GoLang from web dev.to, freecodecamp.com, medium.com, hashnode.com, logrocket.com,infoq.com

go gorm colly corba crawl gonic mysql nginx viper docker golang makefile typesense docker-compose

Created 2022-07-13

304 commits to master branch, last one about a year ago

lsp sb-child

6

39

gpl-3.0

4

python 爬虫, golang 爬虫: 某网站视频爬取下载工具完美适配 miya(蜜芽)和 yysp(夜夜视频, 夜夜視頻)

go html m3u8 colly video ffmpeg golang python spider decrypt requests downloader beautifulsoup4 multiprocessing

Created 2021-03-13

178 commits to main branch, last one 3 months ago