Log In Sign Up

gravytrainproductions.com
robots.txt

Robots Exclusion Standard data for gravytrainproductions.com

Resource Scan

Scan Details

Site Domain gravytrainproductions.com
Base Domain gravytrainproductions.com
Scan Status Ok
Last Scan2024-10-28T18:30:37+00:00
Next Scan 2024-11-27T18:30:37+00:00

Last Scan

Scanned2024-10-28T18:30:37+00:00
URL https://gravytrainproductions.com/robots.txt
Domain IPs 192.254.185.228
Response IP 192.254.185.228
Found Yes
Hash e37344fda48c573205796ed49cdb0ba0e8ade14a1f9507bbd66be4583b9d1431
SimHash ac70c5034e55

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /bigbrothernetwork/
Disallow /hwhills/
Disallow /snarkfood/
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.txt$
Disallow /wp-*/
Disallow /stats*

googlebot-image

Rule Path
Disallow
Allow /*
Back to top

Other Records

Field Value
sitemap http://www.gravytrainproductions.com/gtp/sitemap.xml.gz
Back to top

Comments

  • disallow files in the following folders
  • disallow all files ending in .php
  • disallow all files in /wp- directorys
  • disallow all files with ? in url
  • disallow any files that are stats related
  • Sitemap location for auto-discovery
Back to top