I haven't done this in quite a while... so here is a good one for you. In Maine, you are required to have a permit to harvest worms (PDF). There are no real requirements, other than you must be a resident, and you have to pay $43... to dig for worms.
Disclaimer The opinions expressed herein are my own personal opinions and do not represent my employer's view in anyway.