Log In Sign Up

astrologie.info
robots.txt

Robots Exclusion Standard data for astrologie.info

Resource Scan

Scan Details

Site Domain astrologie.info
Base Domain astrologie.info
Scan Status Ok
Last Scan2025-11-27T22:07:28+00:00
Next Scan 2025-12-04T22:07:28+00:00

Last Scan

Scanned2025-11-27T22:07:28+00:00
URL https://astrologie.info/robots.txt
Redirect https://www.astrologie.info/robots.txt
Redirect Domain www.astrologie.info
Redirect Base astrologie.info
Domain IPs 195.201.47.99
Redirect IPs 195.201.47.99
Response IP 195.201.47.99
Found Yes
Hash 678c711bf92b0c6f8765ccf0e65f27a3ca7ca81973dd1121f3948e2dbb16421a
SimHash f86d9d5fcdc4

Groups

*

Rule Path
Disallow /auth/
Disallow /safe/
Disallow /tmp/
Disallow /temp/
Disallow /work/
Disallow /security/
Disallow /component/
Disallow /reqa/
Disallow /map/
Disallow */booking/*
Disallow *bookmark*
Disallow *gallery*
Disallow accommodation/**/print.pdf
Disallow */advanced.html
Disallow /*?

mediapartners-google

Rule Path
Allow /
Back to top

Comments

  • (c) triplemind.com
  • Version: $Id: robots.xsl 165988 2015-09-03 08:36:06Z cgaffga $
  • dyn-gen robots text, robots = '${robots}'
  • Please, we do NOT allow nonauthorized robots.
  • Any unauthorized bot running will result in IP's being banned. Agent spoofing
  • is considered a bot. Fair warning to the clueless - honey pots are - and have
  • been - running. If you have been banned for bot running - please contact an
  • admin for a reinclusion request.
  • We use wildcard extensions for dynamic areas of the site which we don't need
  • spidered. Note: these are extensions to the basic standard as defined here:
  • http://www.google.com/support/webmasters/bin/answer.py?answer=40367
  • only certain robots (only Googlebot?) may acknowledge them.
Back to top