realityrewind.com
robots.txt

Robots Exclusion Standard data for realityrewind.com

Resource Scan

Scan Details

Site Domain realityrewind.com
Base Domain realityrewind.com
Scan Status Ok
Last Scan2024-11-03T22:28:14+00:00
Next Scan 2024-11-10T22:28:14+00:00

Last Scan

Scanned2024-11-03T22:28:14+00:00
URL https://realityrewind.com/robots.txt
Domain IPs 64.91.249.62
Response IP 64.91.249.62
Found Yes
Hash 022baa19a5ec29a7abb4cb1532df66fe107ceb12efaccca3f58c79acef8c71a9
SimHash 2a79471346d7

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /*.inc$
Disallow /*.txt$
Disallow /wp-admin/
Disallow /wp-content/themes/
Disallow /wp-content/upgrade/
Disallow /wp-content/w3tc/
Disallow /ads/
Disallow /stats*

googlebot-image

Rule Path
Disallow
Allow /*

Other Records

Field Value
sitemap http://americanidolnet.com/sitemap.xml.gz

Comments

  • disallow files in the following folders
  • disallow all files ending in .php
  • Disallow: /*.js$
  • Disallow: /*.css$
  • disallow all files in /wp- directories
  • Disallow: /wp-includes/
  • Disallow: /wp-content/plugins/
  • Disallow: /wp-content/wptouch-data/
  • disallow all files with ? in url
  • disallow any files that are stats related
  • Sitemap location for auto-discovery