Armor and weapons can be upgraded using a mix of Souls and materials found in the world. Once you have located NPCs who can assist you in modifying your equipment, get your gear upgraded!
Weapon upgrades are most important, especially early on, where they can greatly increase your offensive power, but armor upgrades (including shields) can be very helpful in the mid and late game, once you have settled into an armor set that you favor.