mipuntodevista.com.mx
robots.txt

Robots Exclusion Standard data for mipuntodevista.com.mx

Resource Scan

Scan Details

Site Domain mipuntodevista.com.mx
Base Domain mipuntodevista.com.mx
Scan Status Ok
Last Scan2024-11-14T14:10:27+00:00
Next Scan 2024-11-21T14:10:27+00:00

Last Scan

Scanned2024-11-14T14:10:27+00:00
URL https://mipuntodevista.com.mx/robots.txt
Redirect https://www.mipuntodevista.com.mx/robots.txt
Redirect Domain www.mipuntodevista.com.mx
Redirect Base mipuntodevista.com.mx
Domain IPs 104.21.61.31, 172.67.205.165, 2606:4700:3032::ac43:cda5, 2606:4700:3033::6815:3d1f
Redirect IPs 104.21.61.31, 172.67.205.165, 2606:4700:3032::ac43:cda5, 2606:4700:3033::6815:3d1f
Response IP 104.21.61.31
Found Yes
Hash e22f1943580d32ce8d0d05a856fb380da152d427c1daef43afed6314d60ce4ed
SimHash 4b5bdf428003

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-login.php
Disallow /*.exe$
Disallow /*.gif$
Disallow /*.Gif$
Disallow /*.GIF$
Disallow /*.gz$
Disallow /*.jpg$
Disallow /*.Jpg$
Disallow /*.JPG$
Disallow /*.jpeg$
Disallow /*.Jpeg$
Disallow /*.JPEG$
Disallow /*.pdf$
Disallow /*.Pdf$
Disallow /*.PDF$
Disallow /*.png$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$

Other Records

Field Value
crawl-delay 30.0

Other Records

Field Value
sitemap https://www.mipuntodevista.com/sitemap.xml