Sounds like the adapter have some circuitry with a initiation delay involved.

Reminds me of when HDMI first started shipping and people found they had to power up their new TV and games console/BR player in a certain sequence to get HDCP to play nice...