Equipping a shovel changes how you gather resources. For example, using a shovel on a sapling awards you the typical twig but then adds the sapling itself. You can replant the sapling at a more convenient location for future harvesting.
Digging up graves yields some interesting items that can be traded to the Pig King, but watch your sanity.