In order to talk to the cat on the castle you need to have all Characters invited in the castle and before ending the game by talking to one of your sisters or lovers, you need to climb up the ladder on top of the building. The cat is on the right side. Took me some time to figure out so I wanted to help out all of u fellow weebs.