octobat.com
robots.txt
Robots Exclusion Standard data for octobat.com
Resource Scan
Scan Details
Site Domain | octobat.com |
Base Domain | octobat.com |
Scan Status | Ok |
Last Scan | 2025-09-17T10:49:22+00:00 |
Next Scan | 2025-10-17T10:49:22+00:00 |
Last Scan
Scanned | 2025-09-17T10:49:22+00:00 |
URL | https://www.octobat.com/robots.txt |
Domain IPs | 15.197.129.158, 75.2.43.161, 76.223.11.49, 99.83.217.1 |
Response IP | 15.197.129.158 |
Found | Yes |
Hash | 77c136ff3a408e42754c192530eaa7b43ff3f5877796f70058e8aec3f2f02a4a |
SimHash | 021c2982c999 |
Groups
ahrefsbot
ia_archiver
ia_archiver/1.6
mozilla/4.0 (compatible; bullseye; windows 95)
ms search 4.0 robot
ms search 5.0 robot
naverbot
semrushbot
seznambot/3.0
sogou web spider
xenu link sleuth/1.3.8
xenu's
xenu's link sleuth 1.1c
yandex
yandexbot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Allow | / |
Disallow | /terms-of-service.html |
Disallow | /privacy-notice.html |
Disallow | /data-processing-agreement.html |
Other Records
Field | Value |
---|---|
sitemap | https://www.octobat.com/sitemap.xml |