theshiv.club
robots.txt

Robots Exclusion Standard data for theshiv.club

Resource Scan

Scan Details

Site Domain theshiv.club
Base Domain theshiv.club
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-18T18:20:57+00:00
Next Scan 2024-12-18T18:20:57+00:00

Last Successful Scan

Scanned2024-09-27T06:56:16+00:00
URL https://theshiv.club/robots.txt
Redirect https://www.theshiv.club/robots.txt
Redirect Domain www.theshiv.club
Redirect Base theshiv.club
Domain IPs 104.21.40.38, 172.67.175.45, 2606:4700:3035::ac43:af2d, 2606:4700:3037::6815:2826
Redirect IPs 104.21.40.38, 172.67.175.45, 2606:4700:3035::ac43:af2d, 2606:4700:3037::6815:2826
Response IP 104.21.40.38
Found Yes
Hash 81749a756a3976ebf681b4ef8e0cd737bf9bc7b639959f9dc44e004587e2b576
SimHash 410148000993

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.theshiv.club/wp-sitemap.xml