Log In Sign Up

hackverses.com
robots.txt

Robots Exclusion Standard data for hackverses.com

Resource Scan

Scan Details

Site Domain hackverses.com
Base Domain hackverses.com
Scan Status Ok
Last Scan2025-06-15T19:20:22+00:00
Next Scan 2025-06-22T19:20:22+00:00

Last Scan

Scanned2025-06-15T19:20:22+00:00
URL https://hackverses.com/robots.txt
Domain IPs 2a02:4780:39:a0a7:94ed:e309:e75c:a405, 84.32.84.145
Response IP 91.108.100.23
Found Yes
Hash bbc66b7a8df91423fce57c7b4dfa5d469f70d61e365799e7c09f55c8beb55504
SimHash 6016c85166e2

Groups

googlebot

Rule Path
Disallow

badbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /private/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.hackverses.com/post-sitemap.xml
Back to top

Comments

  • 1. Allow Googlebot to crawl everything
  • 2. Block specific bots (if needed)
  • 3. Block private or sensitive directories
  • 4. Allow public access to certain files
  • 5. Sitemap location (important for search engines)
  • 6. Crawl delay (optional, specify a delay for bots to prevent server overload)
Back to top