ifastrology.com
robots.txt
Robots Exclusion Standard data for ifastrology.com
Resource Scan
Scan Details
Site Domain | ifastrology.com |
Base Domain | ifastrology.com |
Scan Status | Ok |
Last Scan | 2024-10-30T04:13:27+00:00 |
Next Scan | 2024-11-06T04:13:27+00:00 |
Last Scan
Scanned | 2024-10-30T04:13:27+00:00 |
URL | https://ifastrology.com/robots.txt |
Redirect | https://www.ifastrology.com/robots.txt |
Redirect Domain | www.ifastrology.com |
Redirect Base | ifastrology.com |
Domain IPs | 91.215.216.107 |
Redirect IPs | 91.215.216.107 |
Response IP | 91.215.216.107 |
Found | Yes |
Hash | 2b8066c0baafbd7f5561d914d025e82c93e23eb32b1e2a292973b1a250998656 |
SimHash | c8047b37d753 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /adm/ |
Disallow | /classes/ |
Disallow | /css/ |
Disallow | /mailer/ |
Allow | / |