Watering is an essential part of growing herbs. Water your herbs regularly, but don't overwater them. Most herbs prefer to be slightly dry rather than constantly moist.
To check if your herbs need water, stick your finger about an inch into the soil. If it feels dry, it's time to water. When watering, pour water slowly over the soil until it drains out the bottom.