"your opponent declined or did not respond"

[Spedy 17]

I was matched with the same person in RM four times in a row and that message popped up all 4 times. how does that work? did we have internet problems or someone has to accept before the other? I find it hard to believe he just declined all 4 times. I haven't battled them before and you can't really be picky about your opponents in reborn's OP anyway (?)