horoscopefree.com
robots.txt

Robots Exclusion Standard data for horoscopefree.com

Resource Scan

Scan Details

Site Domain horoscopefree.com
Base Domain horoscopefree.com
Scan Status Ok
Last Scan2024-05-16T04:49:29+00:00
Next Scan 2024-05-23T04:49:29+00:00

Last Scan

Scanned2024-05-16T04:49:29+00:00
URL https://horoscopefree.com/robots.txt
Redirect https://en.horoscopofree.com/robots.txt
Redirect Domain en.horoscopofree.com
Redirect Base horoscopofree.com
Domain IPs 85.94.197.210
Redirect IPs 85.94.197.210, 85.94.197.211, 86.106.75.6, 86.106.75.7
Response IP 85.94.197.210
Found Yes
Hash 248a3b1838688c876e998f4436a0516248d76550147266cdb1ae698cb1eaefa1
SimHash 0450d2d08052

Groups

mediapartners-google

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /search-results
Disallow /privacy
Disallow /logout
Disallow /login
Disallow /page-not-found

Comments

  • Others