essamamdani / search-result-scraper-markdown

This project provides a powerful web scraping tool that fetches search results and converts them into Markdown format using FastAPI, SearXNG, and Browserless. It includes the capability to use proxies for web scraping and handles HTML content conversion to Markdown efficiently.

Date Created 2024-06-05 (5 months ago)

Commits 30 (last one 3 months ago)

Stargazers 171 (0 this week)

Watchers 1 (0 this week)

Forks 9

License mit

Ranking

RepositoryStats indexes 579,238 repositories, of these essamamdani/search-result-scraper-markdown is ranked #198,660 (66th percentile) for total stargazers, and #532,159 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #35,415/115,001.

essamamdani/search-result-scraper-markdown is also tagged with popular topics, for these it's ranked: python (#9,286/21862), ai (#1,575/3805), openai (#866/2153), markdown (#888/1914), proxy (#588/1190), fastapi (#241/746)

Other Information

Homepage URL: https://www.essamamdani.com/articles/search-result-scraper-markdown

All Topics

ai exa groq jina exaai httpx proxy openai python reader scrape fastapi searxng markdown requests firecrawl metasearch browserless

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

30 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The primary language is Python but there's also others...

updated: 2024-10-28 @ 10:36pm, id: 810620771 / R_kgDOMFEXYw