offthebus.org
robots.txt
Robots Exclusion Standard data for offthebus.org
Resource Scan
Scan Details
Site Domain | offthebus.org |
Base Domain | offthebus.org |
Scan Status | Ok |
Last Scan | 2024-06-10T10:22:28+00:00 |
Next Scan | 2024-06-17T10:22:28+00:00 |
Last Scan
Scanned | 2024-06-10T10:22:28+00:00 |
URL | https://www.offthebus.org/robots.txt |
Domain IPs | 104.21.51.13, 172.67.216.99, 2606:4700:3033::6815:330d, 2606:4700:3037::ac43:d863 |
Response IP | 172.67.216.99 |
Found | Yes |
Hash | cf26f55979734012cd09b8f414080a5e15720dbf8173513e6735518919b34688 |
SimHash | 4bbf53526f83 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*?* |
Disallow | /com/ |
Disallow | /api/ |
Disallow | /error_page/ |
Disallow | /*.php$ |
Disallow | /*.php?* |
Other Records
Field | Value |
---|---|
sitemap | https://www.offthebus.org/sitemap.xml |
sitemap | https://www.offthebus.org/wz20000_sort_sitemap_1_1.xml |
sitemap | https://www.offthebus.org/wz20000_sort_sitemap_2_1.xml |
sitemap | https://www.offthebus.org/wz20000_sort_sitemap_2_2.xml |
sitemap | https://www.offthebus.org/wz20000_sort_sitemap_2_3.xml |
sitemap | https://www.offthebus.org/wz20000_sort_sitemap_3_1.xml |
sitemap | https://www.offthebus.org/wz20000_sort_sitemap_10_1.xml |
sitemap | https://www.offthebus.org/search-index-sitemap.xml |
Comments