User-agent: * Disallow: /*? Disallow: /temp/ Disallow: /db/ Disallow: /files/ Disallow: /wp-content/ Disallow: /wp-includes/ Disallow: /WP/ User-agent: Twiceler Disallow: / User-agent: Twiceler-0.9 Disallow: /