iberojet.com
robots.txt

Robots Exclusion Standard data for iberojet.com

Resource Scan

Scan Details

Site Domain iberojet.com
Base Domain iberojet.com
Scan Status Ok
Last Scan2024-09-12T02:55:17+00:00
Next Scan 2024-10-12T02:55:17+00:00

Last Scan

Scanned2024-09-12T02:55:17+00:00
URL https://iberojet.com/robots.txt
Redirect https://www.iberojet.com/robots.txt
Redirect Domain www.iberojet.com
Redirect Base iberojet.com
Domain IPs 13.33.88.110, 13.33.88.125, 13.33.88.54, 13.33.88.60
Redirect IPs 13.33.88.110, 13.33.88.125, 13.33.88.54, 13.33.88.60
Response IP 13.33.88.54
Found Yes
Hash 613c5da64bd90a115bc26febcad53b5be41ea4453582424ab505cdc0fc69d7b9
SimHash 20d22b8687b5

Groups

*

Rule Path
Disallow /es/select
Disallow /en/select
Disallow /pt/select

shopwiki

Rule Path
Disallow /

adnettrack

Rule Path
Disallow /

searchtone2.0

Rule Path
Disallow /

leiacrawler

Rule Path
Disallow /

whatsup_gold/5.01

Rule Path
Disallow /

mindcrawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /robto

Warnings

  • 4 invalid lines.