acme.com
robots.txt
Robots Exclusion Standard data for acme.com
Resource Scan
Scan Details
Site Domain | acme.com |
Base Domain | acme.com |
Scan Status | Ok |
Last Scan | 2024-11-08T17:12:13+00:00 |
Next Scan | 2024-11-15T17:12:13+00:00 |
Last Scan
Scanned | 2024-11-08T17:12:13+00:00 |
URL | https://acme.com/robots.txt |
Domain IPs | 23.93.86.2 |
Response IP | 23.93.86.2 |
Found | Yes |
Hash | 63a125efadfdae11e063ba68564f7b05cb406679a86c694032b2f8792467fba0 |
SimHash | 98110edde752 |
Groups
*
Rule | Path |
---|---|
Disallow | /calendar/calendar.cgi |
Disallow | /chumaker/chumaker.cgi |
Disallow | /comments/comments.cgi |
Disallow | /heartmaker/heartmaker.cgi |
Disallow | /jef/tmp |
Disallow | /jef/tmp/ |
Disallow | /jef/notes |
Disallow | /jef/notes/ |
Disallow | /jef/weather/tides/tides.html |
Disallow | /labelmaker/labelmaker.cgi |
Disallow | /licensemaker/licensemaker.cgi |
Disallow | /mailto/ |
Disallow | /mapper1/ |
Disallow | /mapper/find.cgi |
Disallow | /mapper/nearby.cgi |
Disallow | /mapper1/mapper.cgi |
Disallow | /mapper1/click_zoom.cgi |
Disallow | /mapper1/parse_latlong.cgi |
Disallow | /mapper1/find.cgi |
Disallow | /mapper1/gen_loc.cgi |
Disallow | /mapper2/find.cgi |
Disallow | /mapper2/nearby.cgi |
Disallow | /tmp |
Disallow | /tmp/ |
Disallow | /webstats.html |
Other Records
Field | Value |
---|---|
sitemap | http://acme.com/sitemap.xml |