You cant access prison through Fast Travel. Go back to the Radio thingy, where you go to to get transported to Prison, to get back to Prison.
There is no way in or out of the Prison. Once your mission is to go to the Prison through the radio and you go through it. You are stuck at Prison and cant get in or out.
Your game just probably didn't save so thats why u were sent back out of the Prison.