Scraps: dataset
1 items
monology/pile-uncopyrighted · Datasets at Hugging Face
**Summary of "monology/pile-uncopyrighted" Dataset on Hugging Face**
• **Dataset Name**: Pile (uncopyrighted) by Monology
• **Source**: Hugging Face Datasets Hub (<https://huggingface.co/datasets/monology/pile-uncopyrighted>)
• **Purpose**: A large-scale, uncopyrighted text corpus for training and evaluating language models.
• **Size**: Approximately 825GB of text data, containing around 825,000 documents.
• **Content**: Sourced from various public domain books, websites, and other uncopyrighted materials.
• **Languages**: Primarily English, but includes other languages as well, with English comprising about 90% of the dataset.
• **License**: The dataset is released under the CC0 1.0 Universal license, making it freely usable and modifiable.
• **Hugging Face Datasets Version**: v1.0.0
• **Release Date**: April 2022
• **Citation**: Cite the dataset using the provided Citation JSON file on the Hugging Face page.
• **Use Cases**: Ideal for training and evaluating large language models, as well as for natural language processing (NLP) research and applications.
• **Comparison**: Larger than the Pile dataset (10GB) by an order of magnitude, providing more data for training and evaluating language models.
• **Author's Insight**: The authors note that while the dataset is large, it may still suffer from biases present in the source materials, and further curation may be necessary for specific use cases.
• **Why Saved**: This dataset was saved for its size, uncopyrighted nature, and potential use in training and evaluating large language models, contributing to advancements in NLP research and applications.
pinboardbookmarkarticleJun 7, 2024
datasetdatadatajournalismopen_data_initiativelarge_language_model_training_datapublic_domain_text_corpus_expansion
image shared
Conf: tags 84% summary 100%