clubjuridico.com
robots.txt

Robots Exclusion Standard data for clubjuridico.com

Resource Scan

Scan Details

Site Domain clubjuridico.com
Base Domain clubjuridico.com
Scan Status Ok
Last Scan2024-11-07T01:04:13+00:00
Next Scan 2024-11-14T01:04:13+00:00

Last Scan

Scanned2024-11-07T01:04:13+00:00
URL https://clubjuridico.com/robots.txt
Redirect https://www.clubjuridico.com/robots.txt
Redirect Domain www.clubjuridico.com
Redirect Base clubjuridico.com
Domain IPs 104.21.19.154, 172.67.186.203, 2606:4700:3034::6815:139a, 2606:4700:3037::ac43:bacb
Redirect IPs 104.21.19.154, 172.67.186.203, 2606:4700:3034::6815:139a, 2606:4700:3037::ac43:bacb
Response IP 104.21.19.154
Found Yes
Hash 6db136f2cb4a43329d2284b3c4793724fb7e994f3b37f91a91b3aa65e04c5d8d
SimHash 4a1bdc428203

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-login.php
Disallow /*.exe$
Disallow /*.gif$
Disallow /*.Gif$
Disallow /*.GIF$
Disallow /*.gz$
Disallow /*.jpg$
Disallow /*.Jpg$
Disallow /*.JPG$
Disallow /*.jpeg$
Disallow /*.Jpeg$
Disallow /*.JPEG$
Disallow /*.pdf$
Disallow /*.Pdf$
Disallow /*.PDF$
Disallow /*.png$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$

Other Records

Field Value
crawl-delay 30.0

Other Records

Field Value
sitemap https://www.clubjuridico.com/sitemap.xml