elcomercio.com
robots.txt

Robots Exclusion Standard data for elcomercio.com

Resource Scan

Scan Details

Site Domain elcomercio.com
Base Domain elcomercio.com
Scan Status Ok
Last Scan2024-06-22T11:29:52+00:00
Next Scan 2024-06-29T11:29:52+00:00

Last Scan

Scanned2024-06-22T11:29:52+00:00
URL https://elcomercio.com/robots.txt
Domain IPs 3.131.118.244
Response IP 3.131.118.244
Found Yes
Hash 8d110b9e14507976d73ec7184f931c0afba7161d980e2ecf02445344aca558ca
SimHash 6305ce026b94

Groups

mediapartners-google

Rule Path
Disallow

mediapartners

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

yahooseeker/m1a1-r2d2

Rule Path
Disallow

msnbot_mobile

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

petalbot

Rule Path
Allow

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-uploads/wpcf7_captcha/

Other Records

Field Value
sitemap https://www.elcomercio.com/sitemapindex.xml
sitemap https://www.elcomercio.com/post_google_news.xml