It seems that Steam is having some issues with group chats at the moment. If anyone is experiencing these issues try disconnecting and reconnecting. Should resolve the issue and get you back into the right chat.
A big thanks to Geracht for letting me know this was happening so that we could get the word out. Happy hunting everyone!