xarg.org
robots.txt

Robots Exclusion Standard data for xarg.org

Resource Scan

Scan Details

Site Domain xarg.org
Base Domain xarg.org
Scan Status Ok
Last Scan2025-02-13T07:28:43+00:00
Next Scan 2025-03-15T07:28:43+00:00

Last Scan

Scanned2025-02-13T07:28:43+00:00
URL https://xarg.org/robots.txt
Redirect https://raw.org/robots.txt
Redirect Domain raw.org
Redirect Base raw.org
Domain IPs 185.244.195.154
Redirect IPs 104.21.84.26, 172.67.185.10, 2606:4700:3031::ac43:b90a, 2606:4700:3037::6815:541a
Response IP 104.21.84.26
Found Yes
Hash 5471ed9bcda557d58bef11322b722470351084e04c7ecaaadc6f7a67361715d8
SimHash 68015804ea93

Groups

*

Rule Path
Disallow /trap/
Disallow /ref/

Other Records

Field Value
sitemap https://raw.org/sitemap.xml