bytes.pk
robots.txt

Robots Exclusion Standard data for bytes.pk

Resource Scan

Scan Details

Site Domain bytes.pk
Base Domain bytes.pk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-25T13:03:39+00:00
Next Scan 2024-10-09T13:03:39+00:00

Last Successful Scan

Scanned2024-08-18T13:02:38+00:00
URL https://bytes.pk/robots.txt
Redirect https://www.bytes.pk/robots.txt
Redirect Domain www.bytes.pk
Redirect Base bytes.pk
Domain IPs 192.200.160.248
Redirect IPs 192.200.160.248
Response IP 192.200.160.248
Found Yes
Hash eda316144afa68912f4f66f5952d4201863485d3edc9020ed754c1f4f1836605
SimHash 2940d6024393

Groups

*

Rule Path
Disallow /

google-xrawler

Rule Path
Allow /feeds/*

*

Rule Path
Disallow /*?_bc_fsnf=1*
Disallow /*%26_bc_fsnf%3D1*