Log In Sign Up

diplak.anj.home.pl
robots.txt

Robots Exclusion Standard data for diplak.anj.home.pl

Resource Scan

Scan Details

Site Domain diplak.anj.home.pl
Base Domain home.pl
Scan Status Ok
Last Scan2024-05-31T10:27:15+00:00
Next Scan 2024-06-30T10:27:15+00:00

Last Scan

Scanned2024-05-31T10:27:15+00:00
URL http://diplak.anj.home.pl/robots.txt
Domain IPs 79.96.29.172
Response IP 79.96.29.172
Found Yes
Hash 0f43555a885e3d39181cae67021e79f4696791f76b165c3048650552ee9de3c2
SimHash 0854c45045b5

Groups

mediapartners-google
googlemediabot
googlebot
gulliver
slurp
fast
scooter
vscooter
ia_archiver
nutch
fast-webcrawler
teoma
lycos_spider_(t-rex)
bingbot
msnbot
msnptc
msnbot-media/1.0
architextspider
zyborg
surveybot
alexabot
baiduspider
yandex
jikespider

Rule Path
Disallow /cgi-bin
Disallow /htdocs
Disallow /private
Disallow /pub
Disallow /testowy
Disallow /tmp
Disallow /.hatacces
Disallow /paker.php

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://anj.home.pl/sitemap.xml
Back to top

Comments

  • The crawlers listed below are allowed on the anj.home.pl site.
  • anj.home.pl allows other crawlers on a case by case basis.
  • Disallow all other crawlers
Back to top