Disconnected from lobby. Again. And again

I recently got forza and was having no problem getting matches in multiplayer. Although most of the people got confused and thought they were demolition derby 6 instead of Forza 6 I was having a good time. Until I started getting the "disconnected from lobby message whenever I tried to find a match. I can’t even get into a lobby on any playlist, it just starts searching for one and 20 seconds later it gives me that goddamn message. My internet is far from godly but I can assure you I’m not living in a cave with dialup Internet so the connection on my end isn’t the problem. This is really starting to get me frustrated and would greatly appreciate help or even a reason as to why this is happening.