rob.cat
robots.txt

Robots Exclusion Standard data for rob.cat

Resource Scan

Scan Details

Site Domain rob.cat
Base Domain rob.cat
Scan Status Ok
Last Scan2025-09-12T06:32:49+00:00
Next Scan 2025-09-19T06:32:49+00:00

Last Scan

Scanned2025-09-12T06:32:49+00:00
URL https://rob.cat/robots.txt
Redirect https://www.xnite.me/robots.txt
Redirect Domain www.xnite.me
Redirect Base xnite.me
Domain IPs 15.204.3.226
Redirect IPs 15.204.3.226
Response IP 15.204.3.226
Found Yes
Hash fb44ade90d1eaf8f9e1a20296b8b6de95290ff687fc848b245329001e8d40f19
SimHash 48084a328f13

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /text/

Other Records

Field Value
sitemap https://www.xnite.me/sitemap.xml