politicsinminnesota.com
robots.txt

Robots Exclusion Standard data for politicsinminnesota.com

Resource Scan

Scan Details

Site Domain politicsinminnesota.com
Base Domain politicsinminnesota.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-29T23:19:19+00:00
Next Scan 2024-11-27T23:19:19+00:00

Last Successful Scan

Scanned2024-02-02T22:25:45+00:00
URL http://politicsinminnesota.com/robots.txt
Domain IPs 63.137.115.28
Response IP 63.137.115.28
Found Yes
Hash 79d3ffd70b220187a3f51e524b3efeaefe579235edfe0c6a469c1ba102f1a26f
SimHash 89084c415673

Groups

*

Rule Path Comment
Disallow /cgi-bin/ -
Disallow /wp-admin/ -
Disallow /wp-includes/ -
Disallow /wp-content/plugins/ -
Disallow /wp-content/cache/ -
Disallow /wp-content/themes/ -
Allow /wp-content/uploads/ -
Disallow /feed/ -
Disallow /trackback/ -
Disallow /print/ wp-print block
Disallow /index.php separate directive for the main script file of WP
Disallow /*? search results
Disallow /*.php$ -
Disallow /*.js$ -
Disallow /*.inc$ -
Disallow /*.css$ -
Disallow */feed/ -
Disallow */trackback/ -
Disallow */print/ -
Disallow /maryland-family-law/wp-files/family-law/*.pdf$ -
Disallow /maryland-family-law/files/2015/9/*.pdf$ -
Disallow /maryland-family-law/*.pdf$ -

Comments

  • User-agent: Googlebot-Image
  • Disallow:
  • Allow: /
  • User-agent: Mediapartners-Google
  • Disallow:
  • Allow: /
  • Sitemap: http://yourdomain.com/sitemap.xml