Log In Sign Up

compadex.com
robots.txt

Robots Exclusion Standard data for compadex.com

Resource Scan

Scan Details

Site Domain compadex.com
Base Domain compadex.com
Scan Status Ok
Last Scan2025-09-10T04:46:58+00:00
Next Scan 2025-10-10T04:46:58+00:00

Last Scan

Scanned2025-09-10T04:46:58+00:00
URL https://compadex.com/robots.txt
Redirect https://www.compadex.com/robots.txt
Redirect Domain www.compadex.com
Redirect Base compadex.com
Domain IPs 76.76.21.21
Redirect IPs 66.33.60.129, 76.76.21.22
Response IP 76.76.21.123
Found Yes
Hash 0c6a3c6f8b8f2d36d25d763f31f5a79a5e61d492522dd6f009aeca20474cd19e
SimHash 920c5352de30

Groups

*

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

buck

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

urlmetrics

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.compadex.com/sitemap.xml
Back to top