kuponykoszyk.pl
robots.txt

Robots Exclusion Standard data for kuponykoszyk.pl

Resource Scan

Scan Details

Site Domain kuponykoszyk.pl
Base Domain kuponykoszyk.pl
Scan Status Ok
Last Scan2024-09-17T14:43:18+00:00
Next Scan 2024-09-24T14:43:18+00:00

Last Scan

Scanned2024-09-17T14:43:18+00:00
URL https://www.kuponykoszyk.pl/robots.txt
Domain IPs 13.33.88.33, 13.33.88.34, 13.33.88.49, 13.33.88.53, 2600:9000:223b:2a00:1b:601b:80c0:93a1, 2600:9000:223b:4e00:1b:601b:80c0:93a1, 2600:9000:223b:6400:1b:601b:80c0:93a1, 2600:9000:223b:9c00:1b:601b:80c0:93a1, 2600:9000:223b:a800:1b:601b:80c0:93a1, 2600:9000:223b:b000:1b:601b:80c0:93a1, 2600:9000:223b:c00:1b:601b:80c0:93a1, 2600:9000:223b:da00:1b:601b:80c0:93a1
Response IP 13.33.88.33
Found Yes
Hash 4182980609b8499fc8313caa6d52ecf9bdaaea8132186c0ad65c178d808a4e57
SimHash 6800db10c291

Groups

*

Rule Path
Disallow /api
Disallow /dashboard

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

adsbot-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

googlebot-image

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

googlebot-mobile

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yahoo! slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kuponykoszyk.pl/sitemap.xml