fest.afi.com
robots.txt
Robots Exclusion Standard data for fest.afi.com
Resource Scan
Scan Details
Site Domain | fest.afi.com |
Base Domain | afi.com |
Scan Status | Ok |
Last Scan | 2024-11-18T23:00:34+00:00 |
Next Scan | 2024-12-18T23:00:34+00:00 |
Last Scan
Scanned | 2024-11-18T23:00:34+00:00 |
URL | https://fest.afi.com/robots.txt |
Domain IPs | 23.185.0.3, 2620:12a:8000::3, 2620:12a:8001::3 |
Response IP | 23.185.0.3 |
Found | Yes |
Hash | fc8c4a4e8cfcad35b45566fb6186cfa8f768b9f86ed28491870f2a0c353fc0e9 |
SimHash | e4144540c1b0 |
Groups
*
Rule | Path |
---|---|
Disallow | /Assets/bod/ |
Disallow | /Assets/bot/ |
Disallow | /Assets/bot/Assets/vax/result1.html |
Disallow | /Assets/bot/Assets/vax/result2.html |
Disallow | /Assets/handbooks/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.afi.com/sitemap.xml |