azgolfhomes.com
robots.txt
Robots Exclusion Standard data for azgolfhomes.com
Resource Scan
Scan Details
Site Domain | azgolfhomes.com |
Base Domain | azgolfhomes.com |
Scan Status | Ok |
Last Scan | 2025-03-14T13:46:19+00:00 |
Next Scan | 2025-04-13T13:46:19+00:00 |
Last Scan
Scanned | 2025-03-14T13:46:19+00:00 |
URL | https://azgolfhomes.com/robots.txt |
Domain IPs | 104.21.77.211, 172.67.211.197, 2606:4700:3030::ac43:d3c5, 2606:4700:3035::6815:4dd3 |
Response IP | 104.21.77.211 |
Found | Yes |
Hash | 787a73ae0d2f6bc9431783963a37b5d56710150f29a14ca00a0fce7198c49cdb |
SimHash | 501dd942c7b7 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | wp-login.php |
Disallow | /page/ |
Disallow | /page/* |
Disallow | /amp/ |
Disallow | %26srt* |
Allow | /wp-admin/admin-ajax.php |
Allow | /wp-content/plugins/.js |
Allow | /wp-content/themes/.js |
Allow | /wp-content/themes/.css |
Allow | /wp-content/cache/.js |
Allow | /wp-content/cache/.css |
Allow | /wp-includes/.js |
Allow | /wp-includes/*.png |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Warnings
- 4 invalid lines.