xenews.net
robots.txt

Robots Exclusion Standard data for xenews.net

Resource Scan

Scan Details

Site Domain xenews.net
Base Domain xenews.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-04-19T04:46:07+00:00
Next Scan 2025-07-18T04:46:07+00:00

Last Successful Scan

Scanned2023-06-29T23:30:20+00:00
URL https://xenews.net/robots.txt
Domain IPs 104.21.77.36, 172.67.204.4, 2606:4700:3033::6815:4d24, 2606:4700:3037::ac43:cc04
Response IP 104.21.77.36
Found Yes
Hash b5b0e4d7174dca5a7829ed9f9ece3f5ef62ab4e580d83c32d3375ee723f76587
SimHash 7905dd640a93

Groups

*

Rule Path
Disallow /search
Disallow /api
Disallow /cgi-bin

Other Records

Field Value
sitemap https://xenews.net/sitemap.xml