outdoorbillboard.com
robots.txt
Robots Exclusion Standard data for outdoorbillboard.com
Resource Scan
Scan Details
Site Domain | outdoorbillboard.com |
Base Domain | outdoorbillboard.com |
Scan Status | Ok |
Last Scan | 2024-11-15T04:50:58+00:00 |
Next Scan | 2024-11-22T04:50:58+00:00 |
Last Scan
Scanned | 2024-11-15T04:50:58+00:00 |
URL | https://outdoorbillboard.com/robots.txt |
Redirect | https://www.outdoorbillboard.com/robots.txt |
Redirect Domain | www.outdoorbillboard.com |
Redirect Base | outdoorbillboard.com |
Domain IPs | 13.248.244.96, 35.71.179.82, 75.2.60.68, 99.83.220.108 |
Redirect IPs | 13.248.244.96, 35.71.179.82, 75.2.60.68, 99.83.220.108 |
Response IP | 99.83.220.108 |
Found | Yes |
Hash | dfb6094b8d170ff3707f8f33ada86c108330153e3b4fcb6dfc5e482e74d9a3bb |
SimHash | 6b0d9861ebb1 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
*
Rule | Path |
---|---|
Disallow | /tools |
Disallow | /site/privacy_policy |
Disallow | /site/user_agreement |
Other Records
Field | Value |
---|---|
sitemap | https://www.outdoorbillboard.com/sitemap.xml |