speedrunhype.com
robots.txt

Robots Exclusion Standard data for speedrunhype.com

Resource Scan

Scan Details

Site Domain speedrunhype.com
Base Domain speedrunhype.com
Scan Status Ok
Last Scan2024-11-12T01:54:52+00:00
Next Scan 2024-11-19T01:54:52+00:00

Last Scan

Scanned2024-11-12T01:54:52+00:00
URL https://speedrunhype.com/robots.txt
Redirect https://www.speedrunhype.com/robots.txt
Redirect Domain www.speedrunhype.com
Redirect Base speedrunhype.com
Domain IPs 34.174.133.231
Redirect IPs 172.66.41.44, 172.66.42.212, 2606:4700:3108::ac42:292c, 2606:4700:3108::ac42:2ad4
Response IP 172.66.41.44
Found Yes
Hash 5283f992099536f93c0d9a83838e82172cb6d4d7262cfc4e8cbb9fd96bbcb09a
SimHash c852cad66c99

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /category/
Disallow /tag/
Disallow /*?s=
Disallow /*?replytocom
Disallow /*/trackback/
Allow /wp-content/uploads/

googlebot

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /category/
Disallow /tag/
Disallow /*?s=
Disallow /*?replytocom
Disallow /*/trackback/

bingbot

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /category/
Disallow /tag/
Disallow /*?s=
Disallow /*?replytocom
Disallow /*/trackback/

slurp

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /category/
Disallow /tag/
Disallow /*?s=
Disallow /*?replytocom
Disallow /*/trackback/

duckduckbot

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /category/
Disallow /tag/
Disallow /*?s=
Disallow /*?replytocom
Disallow /*/trackback/

baiduspider

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /category/
Disallow /tag/
Disallow /*?s=
Disallow /*?replytocom
Disallow /*/trackback/

yandex

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /category/
Disallow /tag/
Disallow /*?s=
Disallow /*?replytocom
Disallow /*/trackback/

Other Records

Field Value
sitemap https://www.speedrunhype.com/sitemap.xml

Comments

  • Allow all crawlers to access the necessary content
  • Specific directives for major crawlers
  • Sitemap location