desguaceonline.com
robots.txt

Robots Exclusion Standard data for desguaceonline.com

Resource Scan

Scan Details

Site Domain desguaceonline.com
Base Domain desguaceonline.com
Scan Status Ok
Last Scan6/2/2025, 6:38:48 AM
Next Scan 7/2/2025, 6:38:48 AM

Last Scan

Scanned6/2/2025, 6:38:48 AM
URL https://desguaceonline.com/robots.txt
Redirect https://www.desguaceonline.com/robots.txt
Redirect Domain www.desguaceonline.com
Redirect Base desguaceonline.com
Domain IPs 82.223.203.17
Redirect IPs 82.223.203.17
Response IP 82.223.203.17
Found Yes
Hash b10a8b231b5748c26a03b3457ccf9ec31537c53fe5c5c2c3daad3ca182431413
SimHash 48545310c5a7

Groups

applebot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

bingbot

Rule Path
Allow /

facebot

Rule Path
Allow /

googlebot

Rule Path
Allow /

msnbot

Rule Path
Allow /

naverbot

Rule Path
Allow /

seznambot

Rule Path
Allow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

twitterbot

Rule Path
Allow /

yandex

Rule Path
Allow /

yeti

Rule Path
Allow /

*

Rule Path
Disallow /