I had all sorts of odd display problems until I discovered plugging in the adapter and then the display cable into the adapter resolved them all. Seems weird, but has been a sure fix so far.
Sounds like the adapter have some circuitry with a initiation delay involved.
Reminds me of when HDMI first started shipping and people found they had to power up their new TV and games console/BR player in a certain sequence to get HDCP to play nice...