petbirds.gr
robots.txt

Robots Exclusion Standard data for petbirds.gr

Resource Scan

Scan Details

Site Domain petbirds.gr
Base Domain petbirds.gr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-09T21:37:03+00:00
Next Scan 2024-10-23T21:37:03+00:00

Last Successful Scan

Scanned2024-09-30T21:36:13+00:00
URL https://petbirds.gr/robots.txt
Domain IPs 172.66.40.196, 172.66.43.60, 2606:4700:3108::ac42:28c4, 2606:4700:3108::ac42:2b3c
Response IP 172.66.43.60
Found Yes
Hash 46eb4c374d16ef273a3ba03aed7207f4c6eb26024c1172d47a9bbce1aaafa712
SimHash 7b84c8c0e040

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Disallow /?s=*
Disallow /community/misc/cookies*
Disallow /misc/cookies*
Disallow /search/*
Disallow /wp-json/
Disallow /wp-admin/
Disallow /wp-content/plugins/

googlebot-image

Rule Path
Disallow

adsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://petbirds.gr/sitemap_index.xml

Comments

  • Global rules
  • Allow Google Images
  • Block Unwanted Bots
  • Sitemap