Search Results - RepositoryStats

domains tb0hdan

114

724

bsd-3-clause

31

World’s single largest Internet domains dataset

yacy colly scrapy dataset search-engines internet-domains

Created 2020-01-12

198 commits to master branch, last one 13 days ago

go-movies hezhizheng

79

261

mit

10

golang spider Crawler 爬虫电影

go colly redis docker golang movies spider crawler gocolly fasthttp

Created 2019-12-04

172 commits to master branch, last one 4 months ago

pagser foolin

8

105

mit

3

Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler

go html page colly golang parser scrapy crawler goquery deserialization

Created 2020-04-19

109 commits to master branch, last one about a year ago

tonovel-go hipig

19

89

mit

3

tonovel是一个简洁，干净的小说聚合系统

iris colly

Created 2020-03-24

9 commits to master branch, last one 3 years ago

slurp slurpcode

76

55

gpl-3.0

20

One repo to rule them all !!?!?!! 🤓 😎

Created 2018-09-08

2,728 commits to main branch, last one 2 days ago

gentlemanSpider Youngkingman

1

48

mit

1

基于colly，支持标签(xp)筛选和多线程加速的绅士漫画爬虫优雅实现

colly erohon golang hentai scraper

Created 2022-09-06

42 commits to main branch, last one 2 years ago

lsp sb-child

7

46

gpl-3.0

4

python 爬虫, golang 爬虫: 涩涩网站学习资料视频爬取下载工具完美适配 miya(蜜芽)和 yysp(夜夜视频, 夜夜視頻)

go html m3u8 colly video ffmpeg golang python spider decrypt requests downloader beautifulsoup4 multiprocessing

Created 2021-03-13

188 commits to main branch, last one 5 months ago

crawl chieund

18

43

unknown

1

Teach daily is web crawl by GoLang from web dev.to, freecodecamp.com, medium.com, hashnode.com, logrocket.com,infoq.com

go gorm colly corba crawl gonic mysql nginx viper docker golang makefile typesense docker-compose

Created 2022-07-13

304 commits to master branch, last one 2 years ago