1stexpress.com
robots.txt

Robots Exclusion Standard data for 1stexpress.com

Resource Scan

Scan Details

Site Domain 1stexpress.com
Base Domain 1stexpress.com
Scan Status Ok
Last Scan2025-12-15T11:45:00+00:00
Next Scan 2026-01-14T11:45:00+00:00

Last Scan

Scanned2025-12-15T11:45:00+00:00
URL https://1stexpress.com/robots.txt
Redirect https://www.1stexpress.com/robots.txt
Redirect Domain www.1stexpress.com
Redirect Base 1stexpress.com
Domain IPs 104.21.30.30, 172.67.150.115, 2606:4700:3033::6815:1e1e, 2606:4700:3036::ac43:9673
Redirect IPs 104.21.30.30, 172.67.150.115, 2606:4700:3033::6815:1e1e, 2606:4700:3036::ac43:9673
Response IP 172.67.150.115
Found Yes
Hash fe4dfcd451d5e161b07ea5374c0e16aa157b8ebc939b46fd78ef129984f0b396
SimHash c536c572775b

Groups

yisouspider

Rule Path
Disallow

applebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

sogou inst spider

Rule Path
Disallow

sogou web spider

Rule Path
Disallow

googlebot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

archive.org_bot

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

bytespider

Rule Path
Disallow

petalbot

Rule Path
Disallow

*

Rule Path
Disallow /
Disallow /common/
Disallow /confjs
Disallow /api/

Warnings

  • 2 invalid lines.