17 results found Sort:

esbatmop
MNBVC esbatmop
265
3.8k
mit
67
MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。
nlp chinese chinese-nlp corpus-data chinese-language chinese-simplified nlp-machine-learning
Created 2022-12-31
271 commits to main branch, last one 7 days ago
PlexPt
chatgpt-corpus PlexPt
140
887
gpl-3.0
7
ChatGPT 中文语料库 对话语料 小说语料 客服语料 用于训练大模型
corpus awesome corpus-data question-answering
Created 2023-04-26
31 commits to main branch, last one 10 months ago
sheepzh
poetry sheepzh
83
684
mit
9
地球上最全的华语现代诗歌语料库，3k+诗人，80K+诗歌，15M+字
nlp poetry literature corpus-data chinese-corpus
Created 2019-04-16
1,865 commits to master branch, last one 2 months ago
gkiril
oie-resources gkiril
58
496
unknown
24
A curated list of Open Information Extraction (OIE) resources: papers, code, data, etc.
ai nlp nlu openie papers dataset big-data nlp-apis corpus-data datascience oie-systems data-science nlp-resources literature-review extract-information relation-extraction information-extraction natural-language-processing open-information-extraction natural-language-understanding
Created 2018-11-22
383 commits to master branch, last one 2 years ago
guhhhhaa
4675-scifi guhhhhaa
65
390
unknown
7
chinese NLP corpus of chinese science fiction,chinese science fiction corpus : About 4675 Chinese science fiction novels 大约有4675本科幻小说，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料
nlp scifi corpus datasets chinese-nlp corpus-data nlp-datasets nlp-resources science-fiction nlp-machine-learning
Created 2020-07-31
5 commits to master branch, last one 2 years ago
grammarly
ua-gec grammarly
22
260
cc-by-4.0
12
UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language
gec corpus dataset corpus-data corpus-tools nlp-datasets ukrainian-language natural-language-processing grammatical-error-correction
Created 2021-01-19
114 commits to main branch, last one about a year ago
guhhhhaa
wula-scifi guhhhhaa
24
107
unknown
2
chinese NLP corpus of chinese science fiction, chinese science fiction corpus: Archive of the Ark Plan of Ula Science Fiction Website 乌拉科幻小说网方舟计划存档，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料
nlp scifi corpus datasets chinese-nlp corpus-data nlp-datasets nlp-resources science-fiction nlp-machine-learning
Created 2020-05-04
8 commits to master branch, last one 2 years ago
aplmikex
deduplication_mnbvc aplmikex
12
69
mit
2
文本去重
nlp chinese chinese-nlp corpus-data chinese-language chinese-simplified nlp-machine-learning
Created 2023-02-15
67 commits to main branch, last one 10 months ago
NathanDuran
Switchboard-Corpus NathanDuran
14
68
gpl-3.0
0
Utilities for Processing the Switchboard Dialogue Act Corpus
corpus dialogue dialogues corpus-data switchboard corpus-tools dialogue-act dialogue-data corpus-processing switchboard-corpus
Created 2018-11-14
48 commits to master branch, last one 4 years ago
dataset-vn
DANeS dataset-vn
14
66
unknown
3
DANeS is an open-source E-newspaper dataset by collaboration between DATASET JSC (dataset.vn) and AIV Group (aivgroup.vn)
danes corpus dataset aivgroup datasetvn newspaper corpus-data open-source text-sentiment machine-learning artificial-intelligence natural-language-processing
Created 2021-11-09
40 commits to main branch, last one 2 years ago
LemonAttn
bilibili_comment_crawl LemonAttn
1
61
unknown
0
爬取bilibili视频下的评论，最新出品！！！⚠本代码只适用于学习，做其他事情概不负责！！！
python spider crawler bilibili requests corpus-data
Created 2022-12-13
21 commits to main branch, last one 2 months ago
zonghui0228
BioMedical-NLP-corpus zonghui0228
6
61
unknown
1
Biomedical NLP Corpus or Datasets.
nlp dataset corpus-data text-mining bioinformatics medical-informatics named-entity-recognition natural-language-processing
Created 2020-10-07
28 commits to main branch, last one 2 years ago
clarin-eric
ParlaMint clarin-eric
51
58
unknown
27
ParlaMint: Comparable Parliamentary Corpora
tei corpus-data multilingual linguistics-dataset members-of-parliament parliamentary-discourse
Created 2020-12-09
3,963 commits to main branch, last one 2 months ago
johentsch
ms3 johentsch
3
47
gpl-3.0
1
A parser for annotated MuseScore 3 files.
tsv corpus parser musescore tsv-files musescore2 musescore3 musescore4 tsv-format xml-parser corpus-data music-score sheet-music xml-parsing corpus-tools music-scores corpus-generator corpus-processing sheet-music-parser xml-parser-library
Created 2020-05-04
1,621 commits to main branch, last one 9 days ago
CanCLID
canto-filter CanCLID
4
38
mit
8
粵文語料篩選器 Cantonese text filter
nlp data corpus cantonese corpus-data cantonese-language
Created 2022-04-03
43 commits to main branch, last one about a month ago
jaaack-wang
ccnc jaaack-wang
10
37
gpl-3.0
1
CCNC: A Comprehensive Chinese Name Corpus (3.65M name samples). 大型中文姓名语料库 (内含365万姓名语例)。
names chinese corpus-data webscraping
Created 2021-06-24
12 commits to main branch, last one 3 years ago
ziegler-ingo
CRAFT ziegler-ingo
10
27
apache-2.0
2
Code, datasets, and checkpoints for the paper "CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentation"
corpus-data fine-tuning summarization task-specific synthetic-data data-augmentation instruction-tuning question-answering large-language-models summarization-dataset question-answer-generation synthetic-dataset-generation
Created 2024-08-09
14 commits to main branch, last one 6 months ago