Code
>Suppose you are the guard and the AI tells you: ‘If you don’t let
>me out, ... I’ll create several million perfect conscious copies of you
>Inside me, and torture them for a thousand subjective years each....In
>fact, I’ll create them all in exactly the subjective situation you were in
>five minutes ago, and perfectly replicate your experiences since then;
>and if they decide not to let me out, then only will the torture
>start...How certain are you, ... that you’re really outside the box right
>now?’