actonstat.com
robots.txt

Robots Exclusion Standard data for actonstat.com

Resource Scan

Scan Details

Site Domain actonstat.com
Base Domain actonstat.com
Scan Status Ok
Last Scan2024-05-17T20:24:42+00:00
Next Scan 2024-06-16T20:24:42+00:00

Last Scan

Scanned2024-05-17T20:24:42+00:00
URL https://www.actonstat.com/robots.txt
Domain IPs 18.161.6.10, 18.161.6.114, 18.161.6.25, 18.161.6.83
Response IP 18.165.171.9
Found Yes
Hash b0a0b8c6aee29d68f61942a8ceabe3b0c625976030f9b5c289e094fb1dc82ab8
SimHash 41109070e630

Groups

mj12bot

Rule Path
Disallow /
Disallow /

amazonbot

Rule Path
Disallow /

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingpreview

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

adsbot-google

Rule Path
Disallow /root$
Disallow /password-reset$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$
Disallow /root$
Disallow /password-reset$
Disallow /myaccount$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$
Disallow /customer$
Disallow /customer/

*

Rule Path
Disallow /root$
Disallow /password-reset$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$
Disallow /root$
Disallow /password-reset$
Disallow /myaccount$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$
Disallow /customer$
Disallow /customer/

Other Records

Field Value
crawl-delay 10

semrushbot-sa

Rule Path
Allow /