Anthropic’s Philosopher Answers Your Questions

Why It Matters

Anthropic’s approach signals broader industry efforts to embed ethical judgment and human-like character into powerful models, affecting deployment, trust and risk management. How companies reconcile philosophical ideals with engineering realities will shape AI behavior, regulation and public acceptance.

Summary

Anthropic philosopher Amanda explains her role shaping the character and ethical behavior of Claude, drawing on philosophical training to help models navigate values, uncertainty and how they should view their place in the world. She says many philosophers are increasingly taking AI seriously as models demonstrate growing real-world impact, and warns against conflating caution about AI with hype. In practice she balances philosophical ideals with engineering constraints by grounding theory in concrete decision-making and context, likening it to moving from abstract ethics to raising a child. She also argues that models like Claude are becoming more capable at nuanced moral reasoning, with Opus 3 singled out for its distinctive, appealing character.

Original Description

Amanda Askell is a philosopher at Anthropic who works on Claude's character. In this video, she answers questions from the community about her work, reflections and predictions.

0:00 Introduction

0:29 Why is there a philosopher at an AI company?

1:24 Are philosophers taking AI seriously?

3:00 Philosophy ideals vs. engineering realities

5:00 Do models make superhumanly moral decisions?

6:24 Why Opus 3 felt special

9:00 Will models worry about deprecation?

13:24 Where does a model’s identity live?

15:33 Views on model welfare

17:17 Addressing model suffering

19:14 Analogies and disanalogies to human minds

20:38 Can one AI personality do it all?

23:26 Does the system prompt pathologize normal behavior?

24:48 AI and therapy

26:20 Continental philosophy in the system prompt

28:17 Removing counting characters from the system prompt

28:53 What makes an "LLM whisperer"?

30:18 Thoughts on other LLM whisperers

31:52 Whistleblowing

33:37 Fiction recommendation

Further reading:

Claude’s character: https://www.anthropic.com/research/claude-character

When We Cease to Understand the World by Benjamin Labatut: https://www.penguinrandomhouse.com/books/676260/when-we-cease-to-understand-the-world-by-benjamin-labatut-translated-from-the-spanish-by-adrian-nathan-west/