Hello, so, I need your help.

I started my new character, played game, conquered castles, started own kingdom... I wanted to start Targaryen invasion, so I went to Varys for his questline.

I did first two quests (Dorne spy and Spy hunter) successfully. But when he asked me for the third quest, I refused (I had no time). Many days passed since, but Varys always tells me how he's busy and I should talk to him "later"...

Do I need to wait more? Like month or something? Or did I messed up and can't have Invasion anymore?

Thanks in advance!