gathr.ai
robots.txt

Robots Exclusion Standard data for gathr.ai

Resource Scan

Scan Details

Site Domain gathr.ai
Base Domain gathr.ai
Scan Status Ok
Last Scan2025-06-20T02:45:24+00:00
Next Scan 2025-07-20T02:45:24+00:00

Last Scan

Scanned2025-06-20T02:45:24+00:00
URL https://www.gathr.ai/robots.txt
Domain IPs 13.35.202.125, 13.35.202.46, 13.35.202.62, 13.35.202.8, 2600:9000:2078:5c00:1e:55ca:cbc0:93a1, 2600:9000:2078:7600:1e:55ca:cbc0:93a1, 2600:9000:2078:800:1e:55ca:cbc0:93a1, 2600:9000:2078:8e00:1e:55ca:cbc0:93a1, 2600:9000:2078:9000:1e:55ca:cbc0:93a1, 2600:9000:2078:b200:1e:55ca:cbc0:93a1, 2600:9000:2078:da00:1e:55ca:cbc0:93a1, 2600:9000:2078:e600:1e:55ca:cbc0:93a1
Response IP 13.35.202.8
Found Yes
Hash d551fc52031055c7cb6c53103d9a85ee6aadc6fd01c643be15902b2870f159ef
SimHash b1055844cb91

Groups

*

Rule Path
Disallow
Disallow /tag/*

Other Records

Field Value
sitemap https://www.gathr.ai/sitemap_index.xml