Shigeru Ishiba likes the nitty gritty of policy and making military models, but his dream job as Japanese prime minister looked at risk of coming unstuck on Sunday.