Log In Sign Up

hackverses.com
robots.txt

Robots Exclusion Standard data for hackverses.com

Resource Scan

Scan Details

Site Domain hackverses.com
Base Domain hackverses.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-01T07:27:02+00:00
Next Scan 2025-12-31T07:27:02+00:00

Last Successful Scan

Scanned2025-11-01T12:24:44+00:00
URL https://hackverses.com/robots.txt
Domain IPs 2a02:4780:84:8321:c51b:46df:7072:e937, 2a02:4780:84:8363:7d8c:68de:71b6:31ec, 77.37.115.65, 77.37.66.47
Response IP 77.37.75.134
Found Yes
Hash bbc66b7a8df91423fce57c7b4dfa5d469f70d61e365799e7c09f55c8beb55504
SimHash 6016c85166e2

Groups

googlebot

Rule Path
Disallow

badbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /private/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.hackverses.com/post-sitemap.xml
Back to top

Comments

  • 1. Allow Googlebot to crawl everything
  • 2. Block specific bots (if needed)
  • 3. Block private or sensitive directories
  • 4. Allow public access to certain files
  • 5. Sitemap location (important for search engines)
  • 6. Crawl delay (optional, specify a delay for bots to prevent server overload)
Back to top