I originally made this because these quests had a hidden timer and you could fail them.
Map is a heavy alteration of a map I found that only had the location of the hooded figures.
The dot is a location of the fish. Crab pots have a square instead of a dot.
These are not the only location of these fish, just one of the locations close to a port.
Blue 3 does have a spot to fish at N10 next to Red 2. I didn't prefer it but you might.

Red Figure is at 14-L

Violet/Purple Figure is at 10-E

Blue Figure is at 7-M

Gold/Yellow Figure is at 2-K

I hope you found this helpful.