Did I invade his space that he needed?

Yes, you did invade his space, but it was a forgivable breach. He'll come around and talk to you in his time. Don't make a pest of yourself though - leave the next move to him.