urdu.siasat.pk
robots.txt

Robots Exclusion Standard data for urdu.siasat.pk

Resource Scan

Scan Details

Site Domain urdu.siasat.pk
Base Domain siasat.pk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-02T08:02:57+00:00
Next Scan 2024-07-31T08:02:57+00:00

Last Successful Scan

Scanned2023-01-06T04:06:53+00:00
URL https://urdu.siasat.pk/robots.txt
Domain IPs 104.26.10.173, 104.26.11.173, 172.67.69.26, 2606:4700:20::681a:aad, 2606:4700:20::681a:bad, 2606:4700:20::ac43:451a
Response IP 104.26.11.173
Found Yes
Hash 919d7c17b7838a65c2ea93120117d2b1ac5b90273ee3bbffea4670010e470e21
SimHash e854d200c733

Groups

*

Rule Path
Disallow /tag/
Disallow /page/
Disallow /mobile/
Allow /