Buildings don't have to be around resources to work. The only effect a resource has for a building is if an animation is played or not.

The mine and the fishing hut are the exception.
Fish hut requires water to be built on and the mine can only be built on an entrance to a mine.

Hunters built near animal spawns will go out and hunt but it doesn't effect the amount produced,

Extraction hut is the same. If built near a node the villager will go to a node and play animations but it doesn't effect production if the node is empty or if no node is present.

So don't worry about finding a clay site/stone pile and building a building near it or if wood is near a woodcutter.

Feel free to create your industrial town area and spam multiple of the same building because they will create the same amount of resources regardless!