3 results found Sort:

fhamborg
news-please fhamborg
428
2.1k
apache-2.0
54
news-please - an integrated web crawler and information extractor for news that just works
nlp json news ccnews python cc-news crawler roberta extractor commoncrawl news-archive news-crawler news-scraper elasticsearch news-articles news-websites data-gathering news-extractor extract-articles extract-information
Created 2016-12-18
802 commits to master branch, last one about a month ago
SkywalkerDarren
chatWeb SkywalkerDarren
136
887
mit
20
ChatWeb can crawl web pages, read PDF, DOCX, TXT, and extract the main content, then answer your questions based on the content, or summarize the key points.
ai gpt pdf docx faiss openai chatgpt crawler pgvector embedding newspaper postgresql gpt-35-turbo news-extractor vector-database
Created 2023-03-09
61 commits to master branch, last one 5 months ago
currentslab
extractnet currentslab
22
240
mit
6
A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one package
news python text-mining webscraping web-scraping news-articles text-cleaning news-extractor date-extraction news-extraction machine-learning author-extraction content-extraction
Created 2020-12-04
434 commits to master branch, last one about a year ago