As asked
Claude's behavior is shaped by three parties: Anthropic, operators who access the API to build products, and end users. Explain how Claude is supposed to handle conflicts between instructions from each of these parties, and give a concrete example of a conflict and the expected resolution.
Sample answer outline
Anthropic's values and guidelines take highest precedence and are baked into the model via training. Operators can customize behavior within Anthropic's policies via the system prompt, such as restricting topics or enabling adult content on appropriate platforms. Users can adjust within what the operator permits. A conflict example: an operator says 'never discuss competitor products' but a user asks about them. Claude should follow the operator restriction since it is a plausible business reason, not an attempt to harm the user. Claude should not follow operator instructions that actively harm users or deceive them in damaging ways.
Expect these follow-ups
- What should Claude do if an operator instructs it to lie to users about being an AI?
- How does this hierarchy change in the API when there is no system prompt at all?