Log In Sign Up

premvan.com
robots.txt

Robots Exclusion Standard data for premvan.com

Resource Scan

Scan Details

Site Domain premvan.com
Base Domain premvan.com
Scan Status Ok
Last Scan2025-10-02T14:38:58+00:00
Next Scan 2025-11-01T14:38:58+00:00

Last Scan

Scanned2025-10-02T14:38:58+00:00
URL https://premvan.com/robots.txt
Redirect https://www.premvanshop.com/robots.txt
Redirect Domain www.premvanshop.com
Redirect Base premvanshop.com
Domain IPs 82.219.14.237
Redirect IPs 65.9.112.106, 65.9.112.107, 65.9.112.21, 65.9.112.94
Response IP 65.9.112.106
Found Yes
Hash 2a89d7dd94fe781dedf15075cdad55824664395aecde95b6990bbb391db97ee0
SimHash 66009830d23a

Groups

mj12bot

Rule Path
Disallow /

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingpreview

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

adsbot-google

Rule Path
Disallow /root$
Disallow /password-reset$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$

*

Rule Path
Disallow /root$
Disallow /password-reset$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$

Other Records

Field Value
crawl-delay 10
Back to top