Unless otherwise stated, the Gildorf and The Bits quests are accessible during your exploration of Velen and Novigrad during Act I.
