dojo.tech
robots.txt
Robots Exclusion Standard data for dojo.tech
Resource Scan
Scan Details
Site Domain | dojo.tech |
Base Domain | dojo.tech |
Scan Status | Ok |
Last Scan | 2024-10-27T07:24:54+00:00 |
Next Scan | 2024-11-26T07:24:54+00:00 |
Last Scan
Scanned | 2024-10-27T07:24:54+00:00 |
URL | https://dojo.tech/robots.txt |
Domain IPs | 34.144.236.132 |
Response IP | 34.144.236.132 |
Found | Yes |
Hash | 74cd49c6beb0ad30cb6c841a5693c42c188976c19eef1122a20725a201a68ab8 |
SimHash | c7045f3087b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/lp/ |
Disallow | /dev/* |
Disallow | /loyalty/* |
Disallow | /playwright-test-page/* |
Disallow | /metrics/* |
Disallow | /*/en-es/ |
Disallow | /*/en-it/ |
Other Records
Field | Value |
---|---|
sitemap | https://dojo.tech/sitemapindex |
Warnings
- `host` is not a known field.