elcomercio.com
robots.txt

Robots Exclusion Standard data for elcomercio.com

Resource Scan

Scan Details

Site Domain elcomercio.com
Base Domain elcomercio.com
Scan Status Ok
Last Scan2024-11-09T16:56:09+00:00
Next Scan 2024-11-16T16:56:09+00:00

Last Scan

Scanned2024-11-09T16:56:09+00:00
URL https://www.elcomercio.com/robots.txt
Domain IPs 2600:9000:25f0:1a00:7:f1d6:8cc0:93a1, 2600:9000:25f0:1e00:7:f1d6:8cc0:93a1, 2600:9000:25f0:9200:7:f1d6:8cc0:93a1, 2600:9000:25f0:9c00:7:f1d6:8cc0:93a1, 2600:9000:25f0:ce00:7:f1d6:8cc0:93a1, 2600:9000:25f0:de00:7:f1d6:8cc0:93a1, 2600:9000:25f0:e000:7:f1d6:8cc0:93a1, 2600:9000:25f0:fe00:7:f1d6:8cc0:93a1, 3.160.150.48, 3.160.150.5, 3.160.150.71, 3.160.150.92
Response IP 3.164.206.76
Found Yes
Hash 8d110b9e14507976d73ec7184f931c0afba7161d980e2ecf02445344aca558ca
SimHash 6305ce026b94

Groups

mediapartners-google

Rule Path
Disallow

mediapartners

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

yahooseeker/m1a1-r2d2

Rule Path
Disallow

msnbot_mobile

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

petalbot

Rule Path
Allow

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-uploads/wpcf7_captcha/

Other Records

Field Value
sitemap https://www.elcomercio.com/sitemapindex.xml
sitemap https://www.elcomercio.com/post_google_news.xml