hyperstv.com
robots.txt

Robots Exclusion Standard data for hyperstv.com

Resource Scan

Scan Details

Site Domain hyperstv.com
Base Domain hyperstv.com
Scan Status Ok
Last Scan2024-09-30T20:08:22+00:00
Next Scan 2024-10-07T20:08:22+00:00

Last Scan

Scanned2024-09-30T20:08:22+00:00
URL https://hyperstv.com/robots.txt
Domain IPs 198.23.159.154
Response IP 198.23.159.154
Found Yes
Hash 39f6115c016e611f94e8c8bf91c2ba3981780fdb69627351a5e9ac36a08daa13
SimHash 6820cd506ea1

Groups

*

Rule Path
Disallow
Allow /wp-content/uploads/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /feed/

Other Records

Field Value
sitemap https://hyperstv.com/sitemap_index.xml

Comments

  • Allow search engines to crawl all content
  • Specify the location of the sitemap
  • Allow crawling of specific directories
  • Disallow crawling of specific directories
  • Set crawl delay (optional, only if you want to slow down crawlers)
  • Crawl delay in seconds
  • Crawl-Delay: 10