User-agent: PetalBot Disallow: / # There is really no point in the image indexers looking at icons, # thumbnails and other non-content User-agent: * Disallow: /images/ Disallow: /img/ Disallow: /tmp/ Disallow: /svn/ Disallow: /testinput/ Disallow: /webhg/ Disallow: /websvn/ Disallow: /pipermail/ Disallow: /jars/ Disallow: /mkgmap/mkgmap/build Disallow: /mkgmap/splitter/build