spatie / crawler

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.

spatie
spatie
Date Created 2015-11-02 (9 years ago)
Commits 471 (last one 7 days ago)
Stargazers 2,592 (4 this week)
Watchers 67 (0 this week)
Forks 360
License mit
Ranking

RepositoryStats indexes 622,366 repositories, of these spatie/crawler is ranked #20,418 (97th percentile) for total stargazers, and #29,699 for total watchers. Github reports the primary language for this repository as PHP, for repositories using this language it is ranked #549/15,606.

spatie/crawler is also tagged with popular topics, for these it's ranked: php (#357/5885),  crawler (#57/588),  concurrency (#40/462)

Other Information

There have been 112 releases, the latest one was published on 2025-02-24 (7 days ago) with the name 8.4.2.

Homepage URL: https://freek.dev/308-building-a-crawler-in-php

Star History

Github stargazers over time

3k3k2.5k2.5k2k2k1.5k1.5k1k1k5005000020162016201720172018201820192019202020202021202120222022202320232024202420252025

Watcher History

Github watchers over time, collection started in '23

676767676666666666666565656520232023Feb '23Feb '23Apr '23Apr '23Jun '23Jun '23Aug '23Aug '23Oct '23Oct '23Dec '23Dec '23Feb '24Feb '24Apr '24Apr '24Jun '24Jun '24Aug '24Aug '24Oct '24Oct '24Dec '24Dec '24Feb '25Feb '25

Recent Commit History

67 commits on the default branch (main) since jan '22

707060605050404030302020101000Jul '22Jul '2220232023Jul '23Jul '2320242024Jul '24Jul '2420252025

Yearly Commits

Commits to the default branch (main) per year

90908080707060605050404030302020101000201520152016201620172017201820182019201920202020202120212022202220242024

Issue History

Total Issues
Open Issues
Closed Issues
18018016016014014012012010010080806060404020200020162016201720172018201820192019202020202021202120222022202320232024202420252025

Languages

The primary language is PHP but there's also others...

PHPPHPJavaScriptJavaScriptShellShell

updated: 2025-03-03 @ 07:20pm, id: 45406338 / R_kgDOArTYgg