gathered.how
robots.txt

Robots Exclusion Standard data for gathered.how

Resource Scan

Scan Details

Site Domain gathered.how
Base Domain gathered.how
Scan Status Ok
Last Scan2024-11-10T21:14:19+00:00
Next Scan 2024-11-17T21:14:19+00:00

Last Scan

Scanned2024-11-10T21:14:19+00:00
URL https://gathered.how/robots.txt
Redirect https://www.gathered.how/robots.txt
Redirect Domain www.gathered.how
Redirect Base gathered.how
Domain IPs 3.124.189.64
Redirect IPs 18.66.248.129, 18.66.248.46, 18.66.248.49, 18.66.248.71, 2600:9000:224a:1a00:12:baff:7180:93a1, 2600:9000:224a:1e00:12:baff:7180:93a1, 2600:9000:224a:2800:12:baff:7180:93a1, 2600:9000:224a:4c00:12:baff:7180:93a1, 2600:9000:224a:a400:12:baff:7180:93a1, 2600:9000:224a:a600:12:baff:7180:93a1, 2600:9000:224a:aa00:12:baff:7180:93a1, 2600:9000:224a:cc00:12:baff:7180:93a1
Response IP 18.165.122.125
Found Yes
Hash c5c401780851d493dca88f9251bc7cefaa75166d2382b543824c6a03d20c413f
SimHash 6040d840c313

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /.*?preview=true
Allow /

Other Records

Field Value
sitemap https://www.gathered.how/sitemap/index.xml.gz
sitemap https://www.gathered.how/sitemap/news.xml.gz