uainkrakow.pl
robots.txt

Robots Exclusion Standard data for uainkrakow.pl

Resource Scan

Scan Details

Site Domain uainkrakow.pl
Base Domain uainkrakow.pl
Scan Status Ok
Last Scan2024-11-15T11:13:46+00:00
Next Scan 2024-11-22T11:13:46+00:00

Last Scan

Scanned2024-11-15T11:13:46+00:00
URL https://uainkrakow.pl/robots.txt
Domain IPs 195.78.67.54
Response IP 195.78.67.54
Found Yes
Hash 7bb2994849587542be658c939bdd5aa609d3f301139967ba13778ebb1735ee65
SimHash 62255b214039

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /*add-to-cart%3D*
Allow /wp-admin/admin-ajax.php

googlebot-image

Rule Path
Allow /
Disallow

mediapartners-google

Rule Path
Allow /
Disallow

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /wp-content/uploads/

applebot

Rule Path
Allow /

yandeximages

Rule Path
Allow /wp-content/uploads/

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

qwantify

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider/2.0

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

sogou spider

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

sosospider

Rule Path
Allow /

sosospider+

Rule Path
Allow /

sosospider/2.0

Rule Path
Allow /

yodao

Rule Path
Allow /

youdao

Rule Path
Allow /

youdaobot

Rule Path
Allow /

youdaobot/1.0

Rule Path
Allow /

facebookexternalhit/1.0

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

facebookplatform/1.0

Rule Path
Allow /

facebot/1.0

Rule Path
Allow /

visionutils/0.2

Rule Path
Allow /

datagnionbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot/1.0

Rule Path
Allow /

pinterest/0.1

Rule Path
Allow /

pinterest/0.2

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://uainkrakow.pl/sitemaps.xml