public.cy
robots.txt

Robots Exclusion Standard data for public.cy

Resource Scan

Scan Details

Site Domain public.cy
Base Domain public.cy
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-09T18:53:42+00:00
Next Scan 2024-12-08T18:53:42+00:00

Last Successful Scan

Scanned2023-10-23T06:54:30+00:00
URL https://public.cy/robots.txt
Redirect https://www.public.cy/robots.txt
Redirect Domain www.public.cy
Redirect Base public.cy
Domain IPs 23.205.106.74, 23.205.106.79
Redirect IPs 2600:1413:b000:6::17d5:2bc6, 2600:1413:b000:6::17d5:2be0, 96.17.96.24, 96.17.96.6
Response IP 104.88.70.120
Found Yes
Hash 4fccef9bf5be27166eced330a2c924a3f1294c13a8c54cdb4f22bbdcb0ccc344
SimHash 6911386ac1d3

Groups

*

Rule Path
Disallow /my-account/
Disallow /checkout/
Allow /checkout/mobile/
Disallow /search
Disallow /testPerformance/
Disallow /rb_97220701-bc42-4df7-88c6-057ab004c551
Disallow /public/v1/
Disallow /public/v2
Disallow /rest/model/atg/
Disallow /common/public
Disallow /*?*jsessionid=
Disallow /undefined
Allow /checkout/cyprus
Allow /search/cyprus
Allow *search/public/searchResultsRefinements.jsp?*

adsbot-google-mobile

Rule Path
Allow /checkout/

adsbot-google

Rule Path
Allow /checkout/

facebookexternalhit/*

Rule Path
Allow /checkout/

alexibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu’s

Rule Path
Disallow /

xenu’s link sleuth 1.1c

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.public.cy/sitemap.xml

Comments

  • Disallow: /*;*jsessionid=
  • Whitelist
  • Blocking bad link checker robots