geniushoroscope.com
robots.txt

Robots Exclusion Standard data for geniushoroscope.com

Resource Scan

Scan Details

Site Domain geniushoroscope.com
Base Domain geniushoroscope.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-03T07:17:27+00:00
Next Scan 2024-12-02T07:17:27+00:00

Last Successful Scan

Scanned2024-05-07T06:36:00+00:00
URL https://geniushoroscope.com/robots.txt
Domain IPs 35.214.208.122
Response IP 35.214.208.122
Found Yes
Hash f7aad27f6c372d857dbb95fd8ee283b3981673784507fa4340a8e19fb88d6980
SimHash 4940daf276b1

Groups

*

Rule Path
Allow /?display=wide
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /readme.html

Other Records

Field Value
crawl-delay 10

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

Other Records

Field Value
sitemap https://geniushoroscope.com/sitemap_index.xml