Cook food to make it a more valuable resource. Roasting it directly on the campfire is fine until you get cooking vessels.
Don’t eat it just because it’s edible! If there’s something new, try it only when you’re desperate for food or you have food in your inventory to counter any negative effects. Either way, remember what effect the new item had so you know what to do the next time you encounter it.