Robots.txt GeneratorA few months ago I wrote a blurb about robots.txt - what it is and how to use it. Google Webmaster Central just released their own Robots.txt Generator. To access the tool, log-in to your Google Webmaster Tools account, then click on the Tools menu option on the left-hand side of the screen after you select one of your verified sites. You'll see a "Generate robots.txt" link among the tool options. That's what you want.
The tool lets you craft specific rules for these particular Google crawlers:
For more about Google's webmaster tools, be sure to check out the quick start guide they offer.