Log In Sign Up

jenngrover.com
robots.txt

Robots Exclusion Standard data for jenngrover.com

Resource Scan

Scan Details

Site Domain jenngrover.com
Base Domain jenngrover.com
Scan Status Ok
Last Scan2025-12-03T01:34:00+00:00
Next Scan 2026-01-02T01:34:00+00:00

Last Scan

Scanned2025-12-03T01:34:00+00:00
URL https://jenngrover.com/robots.txt
Domain IPs 199.16.172.80, 199.16.173.218
Response IP 199.16.172.80
Found Yes
Hash ba018d50bc67261d26a997c71744d16937ea1e56927533bf79f119a1166727fb
SimHash 8d5085d05476

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /search/*/feed
Disallow /search/*/*

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap http://www.askapache.com/sitemap.xml
Back to top

Comments

  • User-agent: ia_archiver-web.archive.org
  • Disallow: /
  • __ __
  • ____ ______/ /______ _____ ____ ______/ /_ ___
  • / __ `/ ___/ //_/ __ `/ __ \/ __ `/ ___/ __ \/ _ \
  • / /_/ (__ ) ,< / /_/ / /_/ / /_/ / /__/ / / / __/
  • \__,_/____/_/|_|\__,_/ .___/\__,_/\___/_/ /_/\___/
  • /_/
Back to top