bestonmachinery.com
robots.txt

Robots Exclusion Standard data for bestonmachinery.com

Resource Scan

Scan Details

Site Domain bestonmachinery.com
Base Domain bestonmachinery.com
Scan Status Ok
Last Scan2025-05-15T08:19:03+00:00
Next Scan 2025-06-14T08:19:03+00:00

Last Scan

Scanned2025-05-15T08:19:03+00:00
URL https://bestonmachinery.com/robots.txt
Domain IPs 194.1.147.5, 194.1.147.80
Response IP 194.1.147.5
Found Yes
Hash 2a6cd7f7c5ab297aa8131b0699b765219bdc5db91e82a2670a9c2f68d7d8fe45
SimHash ea2ad8a28aa3

Groups

facebookexternalhit

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 20