bigscience/bloom · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

BigScience Large Open-science Open-access Multilingual Language Model Version 1.3 / 6 July 2022 Current Checkpoint: Training Iteration 95000 Link to paper: here Total seen tokens: 366B Model Details BLOOM is an autoregressive Large Language Model (LLM), trained to continue text from a prompt on vast amounts of text data using industrial-scale computational resources. As such, it is able to output coherent text in 46 languages and 13 programming languages that is hardly distinguishable from text written by humans. BLOOM can also be instructed to perform text tasks it hasn't been…

related reading

• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
• Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrouai.googleblog.com
• Productizing Large Language Modelsblog.replit.com
• Hugging Face – The AI community building the future.huggingface.co
• GitHub - eugeneyan/open-llms: 📋 A list of open LLMs available for commercial use.github.com
• Large Language Diffusion Modelsarxiv.org
• AI Timeline — Complete History of 194+ Large Language Modelsllm-timeline.com
• GitHub - Hannibal046/Awesome-LLM: Awesome-LLM: a curated list of Large Language Modelgithub.com
• A Family of Large Language Models from GLM-130B to GLM-4 All Toolsarxiv.org
• [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
• Generalized Language Models | Lil'Loglilianweng.github.io