webmoto.bg
robots.txt
Robots Exclusion Standard data for webmoto.bg
Resource Scan
Scan Details
Site Domain | webmoto.bg |
Base Domain | webmoto.bg |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-04-30T22:08:21+00:00 |
Next Scan | 2024-07-29T22:08:21+00:00 |
Last Successful Scan
Scanned | 2023-12-10T21:23:54+00:00 |
URL | https://webmoto.bg/robots.txt |
Redirect | https://www.webmoto.bg/robots.txt |
Redirect Domain | www.webmoto.bg |
Redirect Base | webmoto.bg |
Domain IPs | 104.21.60.220, 172.67.201.240, 2606:4700:3030::6815:3cdc, 2606:4700:3030::ac43:c9f0 |
Redirect IPs | 104.21.60.220, 172.67.201.240, 2606:4700:3030::6815:3cdc, 2606:4700:3030::ac43:c9f0 |
Response IP | 104.21.60.220 |
Found | Yes |
Hash | 4c1bdf3c230dfb595de1431908e2f49be5e4004c13056fa1c9f97bb6f0458a4f |
SimHash | 492074444c70 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /vendor/ |
Disallow | /routes/ |
Disallow | /resources/ |
Disallow | /node_modules/ |
Disallow | /database/ |
Disallow | /config/ |
Disallow | /bootstrap/ |
Disallow | /app/ |
Disallow | /storage/ |