The Builders have a magic hammer that is perfected especially for building and upgrading walls. This is why you need a free builder to upgrade your walls, even though the upgrade itself is instantaneous.