Video recording: Unblacking the Box of ChatGPT
On February 23, 2023, CBDALN member Karsten Lübke, Professor of Statistics and Data Literacy Education Researcher at FOM University of Applied Sciences in Dortmund (Germany), gave an online workshop on “Unblacking the Box of ChatGPT”. In the workshop, he gave a conceptual overview of ChatGPT and presented the basic ideas of large language models in order to facilitate the critical discussion. The recording of Karsten Lübke’s talk is now available:
Literature References:
- Bender et al. (2021): On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜 https://doi.org/10.1145/3442188.3445922
- ELIZA: https://dl.acm.org/doi/pdf/10.1145/365153.365168
- BERT: https://arxiv.org/abs/1810.04805
- GPT-3: https://arxiv.org/abs/2005.14165
- Galactica: https://arxiv.org/abs/2211.09085
- Foundation Model: https://arxiv.org/abs/2108.07258
- Transformer: https://arxiv.org/abs/1706.03762
- Zero-Shot: https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
- Enviroment: https://arxiv.org/abs/2104.10350
- RLHF/ InstructGPT: https://arxiv.org/abs/2203.02155
- Time Article Kenya Worker: https://time.com/6247678/openai-chatgpt-kenya-workers/
- Fair Use: https://www.uspto.gov/sites/default/files/documents/OpenAI_RFC-84-FR-58141.pdf
- Linguistic Experience: https://arxiv.org/abs/2208.07998
- Stereotypes: https://www.fastcompany.com/90844066/chatgpt-write-performance-reviews-sexist-and-racist
- Jailbreak: https://www.reddit.com/r/ChatGPT/comments/10urbdj/new_jailbreak_based_on_virtual_functions_smuggle/
- Poisoning: https://arxiv.org/abs/2302.10149
- Cognitive science: https://arxiv.org/abs/2301.06627
- External tools: https://arxiv.org/abs/2302.04761
- Time Article Bard error (note: a causal statement is not statistically justified): https://time.com/6254226/alphabet-google-bard-100-billion-ai-error/
- Beat Döbeli Honegger: ChatGPT – der iPhone-Moment für KI?: https://doebe.li/talks/phsz23/
- Anna Mills: Teaching with AI: Using Writing Generators in the Classroom: https://bit.ly/teachingwithAI