gathr.one
robots.txt

Robots Exclusion Standard data for gathr.one

Resource Scan

Scan Details

Site Domain gathr.one
Base Domain gathr.one
Scan Status Ok
Last Scan2024-11-10T19:42:57+00:00
Next Scan 2024-12-10T19:42:57+00:00

Last Scan

Scanned2024-11-10T19:42:57+00:00
URL https://www.gathr.one/robots.txt
Domain IPs 108.157.254.104, 108.157.254.34, 108.157.254.75, 108.157.254.77, 2600:9000:2816:4e00:3:5bf9:d100:93a1, 2600:9000:2816:7800:3:5bf9:d100:93a1, 2600:9000:2816:a000:3:5bf9:d100:93a1, 2600:9000:2816:ba00:3:5bf9:d100:93a1, 2600:9000:2816:cc00:3:5bf9:d100:93a1, 2600:9000:2816:ce00:3:5bf9:d100:93a1, 2600:9000:2816:de00:3:5bf9:d100:93a1, 2600:9000:2816:f800:3:5bf9:d100:93a1
Response IP 108.157.254.104
Found Yes
Hash a71e6e2e26ab2cd902fabe525553ee2d91d0c8325703fbe9d64f9182325070bf
SimHash 25051c048f13

Groups

*

Rule Path
Disallow
Disallow /tag/*

Other Records

Field Value
sitemap https://www.gathr.one/post-sitemap.xml
sitemap https://www.gathr.one/page-sitemap.xml
sitemap https://www.gathr.one/press-release-sitemap.xml