bes-reporter.com
robots.txt
Robots Exclusion Standard data for bes-reporter.com
Resource Scan
Scan Details
Site Domain | bes-reporter.com |
Base Domain | bes-reporter.com |
Scan Status | Ok |
Last Scan | 6/8/2025, 1:47:55 PM |
Next Scan | 6/15/2025, 1:47:55 PM |
Last Scan
Scanned | 6/8/2025, 1:47:55 PM |
URL | https://bes-reporter.com/robots.txt |
Domain IPs | 104.21.59.171, 172.67.181.93, 2606:4700:3036::ac43:b55d, 2606:4700:3037::6815:3bab |
Response IP | 172.67.181.93 |
Found | Yes |
Hash | 92997b77570b95b7de3befbc1397e70b405f11a92c7f83289e0081be76421227 |
SimHash | e90ad600c665 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
*
Rule | Path |
---|---|
Disallow | /wp-content/uploads/wp-import-export-lite/ |
Comments