It seems like bullets do the trick.

Mines and other explosives too.

By using the information in the last section, shooting Goatman with a lot of bullets will reduce his health bar.

For better results use the explosives mentioned in the last section to reduce his health bar faster. You can even place them in a pile for a greater effect.

Shoot him enough and he'll probably die and the more explosions the better.