geeksaresexy.com
robots.txt

Robots Exclusion Standard data for geeksaresexy.com

Resource Scan

Scan Details

Site Domain geeksaresexy.com
Base Domain geeksaresexy.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-04-28T10:52:59+00:00
Next Scan 2024-06-27T10:52:59+00:00

Last Successful Scan

Scanned2021-10-19T15:57:58+00:00
URL http://geeksaresexy.com/robots.txt
Redirect https://www.geeksaresexy.net/robots.txt
Redirect Domain www.geeksaresexy.net
Redirect Base geeksaresexy.net
Found Yes
Hash b66dbac7e0096971a929a9cae08150d2c6d2a39886cd54c22267279924b53c87
SimHash 4b04df5252d5

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /cgi-bin/
Disallow /contact-us/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /feed/
Disallow /trackback/
Disallow */feed/
Disallow */trackback/
Disallow /page/
Disallow /archives/
Disallow /author/
Disallow /*?

googlebot-image

Rule Path
Allow /wp-content/uploads/

googlebot-news

Rule Path
Allow /

mozilla/5.0 (compatible;contxbot/1.0)

Rule Path
Allow /

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://www.geeksaresexy.net/sitemap.xml