simplemachines.org
robots.txt
Robots Exclusion Standard data for simplemachines.org
Resource Scan
Scan Details
Site Domain | simplemachines.org |
Base Domain | simplemachines.org |
Scan Status | Ok |
Last Scan | 2024-05-29T22:16:55+00:00 |
Next Scan | 2024-06-05T22:16:55+00:00 |
Last Scan
Scanned | 2024-05-29T22:16:55+00:00 |
URL | https://simplemachines.org/robots.txt |
Domain IPs | 104.26.0.72, 104.26.1.72, 172.67.70.118, 2606:4700:20::681a:148, 2606:4700:20::681a:48, 2606:4700:20::ac43:4676 |
Response IP | 104.26.0.72 |
Found | Yes |
Hash | b37f5aa58db3720b10201d297c3fe6803e08927567093d3a5f9dc7f3197ce139 |
SimHash | 6a09fa74c395 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /adsystem/ |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |