gathered.how
robots.txt

Robots Exclusion Standard data for gathered.how

Resource Scan

Scan Details

Site Domain gathered.how
Base Domain gathered.how
Scan Status Ok
Last Scan2024-06-23T05:29:24+00:00
Next Scan 2024-06-30T05:29:24+00:00

Last Scan

Scanned2024-06-23T05:29:24+00:00
URL https://gathered.how/robots.txt
Redirect https://www.gathered.how/robots.txt
Redirect Domain www.gathered.how
Redirect Base gathered.how
Domain IPs 3.124.189.64
Redirect IPs 2600:9000:263a:1c00:12:baff:7180:93a1, 2600:9000:263a:2800:12:baff:7180:93a1, 2600:9000:263a:7400:12:baff:7180:93a1, 2600:9000:263a:7e00:12:baff:7180:93a1, 2600:9000:263a:ac00:12:baff:7180:93a1, 2600:9000:263a:d600:12:baff:7180:93a1, 2600:9000:263a:d800:12:baff:7180:93a1, 2600:9000:263a:e800:12:baff:7180:93a1, 65.9.112.110, 65.9.112.3, 65.9.112.5, 65.9.112.84
Response IP 18.165.171.82
Found Yes
Hash c5c401780851d493dca88f9251bc7cefaa75166d2382b543824c6a03d20c413f
SimHash 6040d840c313

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /.*?preview=true
Allow /

Other Records

Field Value
sitemap https://www.gathered.how/sitemap/index.xml.gz
sitemap https://www.gathered.how/sitemap/news.xml.gz