
Does an AI Agent See Everything on Your Screen?
Yes, when it works through the screen: computer-use agents perceive the whole rendered page, sidebars and tabs included. Check what else was visible.
Research topic
Research on screen-level masking: AI agent security, tokenization and checks for sensitive data access before allowing enterprise workflows to run.

Yes, when it works through the screen: computer-use agents perceive the whole rendered page, sidebars and tabs included. Check what else was visible.

The key becomes a secret copied into the model's context, the transcript and every log, which means rotation. Check that console keys are masked on screen.