cdn.lopezdoriga.com
robots.txt

Robots Exclusion Standard data for cdn.lopezdoriga.com

Resource Scan

Scan Details

Site Domain cdn.lopezdoriga.com
Base Domain lopezdoriga.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-20T15:19:33+00:00
Next Scan 2024-06-18T15:19:33+00:00

Last Successful Scan

Scanned2023-07-30T08:04:12+00:00
URL https://cdn.lopezdoriga.com/robots.txt
Domain IPs 104.26.12.3, 104.26.13.3, 172.67.72.74, 2606:4700:20::681a:c03, 2606:4700:20::681a:d03, 2606:4700:20::ac43:484a
Response IP 172.67.72.74
Found Yes
Hash 5ad1659e7a50588ef219853e9b9e431397a662ee699962b66fe0ae8ddd276caf
SimHash 6b284ae0e2b3

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /
Allow /wp-content/uploads/

googlebot-video

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

petalbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://lopezdoriga.com/sitemap_index.xml
sitemap https://lopezdoriga.com/author-sitemap.xml
sitemap https://lopezdoriga.com/category-sitemap.xml
sitemap https://lopezdoriga.com/channel-sitemap.xml