findagrave.net
robots.txt
Robots Exclusion Standard data for findagrave.net
Resource Scan
Scan Details
Site Domain | findagrave.net |
Base Domain | findagrave.net |
Scan Status | Ok |
Last Scan | 2024-11-11T01:46:01+00:00 |
Next Scan | 2024-11-18T01:46:01+00:00 |
Last Scan
Scanned | 2024-11-11T01:46:01+00:00 |
URL | https://findagrave.net/robots.txt |
Redirect | https://www.findagrave.com/robots.txt |
Redirect Domain | www.findagrave.com |
Redirect Base | findagrave.com |
Domain IPs | 18.210.204.193, 54.173.180.93 |
Redirect IPs | 104.18.33.242, 172.64.154.14, 2606:4700:4400::6812:21f2, 2606:4700:4400::ac40:9a0e |
Response IP | 172.64.154.14 |
Found | Yes |
Hash | 9e01060464c61d931826044b26416b9ec3dca14e4f8d56f27941c7820d303b57 |
SimHash | ac08094a6e13 |
Groups
*
Rule | Path |
---|---|
Disallow | /missing.html |
Disallow | /500.html |
Disallow | /memorial/search |
Disallow | /cemetery/*/memorial-search |
Comments