bytea.info
robots.txt

Robots Exclusion Standard data for bytea.info

Resource Scan

Scan Details

Site Domain bytea.info
Base Domain bytea.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-09T21:58:16+00:00
Next Scan 2024-12-08T21:58:16+00:00

Last Successful Scan

Scanned2024-08-11T11:59:20+00:00
URL https://bytea.info/robots.txt
Redirect https://www.bytea.info/robots.txt
Redirect Domain www.bytea.info
Redirect Base bytea.info
Domain IPs 74.125.130.121
Redirect IPs 172.253.118.121, 2404:6800:4003:c01::79
Response IP 142.251.10.121
Found Yes
Hash d74d9dd5dc6613ed03926a3f170e9306974a36533b1d11277a91a0148c031fd0
SimHash 4b04d2604f13

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.bytea.info/sitemap.xml