anosacosta.es
robots.txt

Robots Exclusion Standard data for anosacosta.es

Resource Scan

Scan Details

Site Domain anosacosta.es
Base Domain anosacosta.es
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-16T08:19:50+00:00
Next Scan 2024-11-15T08:19:50+00:00

Last Successful Scan

Scanned2024-07-19T08:18:01+00:00
URL https://anosacosta.es/robots.txt
Domain IPs 185.34.192.106
Response IP 185.34.192.106
Found Yes
Hash 8380bd68c21fb6fe3b27a8a7788bda84d78791b533225976ef9a0af22bcdeeca
SimHash b8180890c9e3

Groups

*

Rule Path
Disallow

*

Rule Path
Disallow /wp-admin/

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /

twitterbot

Rule Path
Allow /images

facebookexternalhit

Rule Path
Allow /images

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
  • Disallow everything.
  • Certain social media sites are whitelisted to allow crawlers to access page markup when links to /images are shared.