actonstat.com
robots.txt

Robots Exclusion Standard data for actonstat.com

Resource Scan

Scan Details

Site Domain actonstat.com
Base Domain actonstat.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-14T22:49:57+00:00
Next Scan 2024-11-21T22:49:57+00:00

Last Successful Scan

Scanned2024-10-14T22:48:49+00:00
URL https://www.actonstat.com/robots.txt
Domain IPs 65.9.112.7, 65.9.112.76, 65.9.112.84, 65.9.112.90
Response IP 3.164.206.118
Found Yes
Hash b0a0b8c6aee29d68f61942a8ceabe3b0c625976030f9b5c289e094fb1dc82ab8
SimHash 41109070e630

Groups

mj12bot

Rule Path
Disallow /
Disallow /

amazonbot

Rule Path
Disallow /

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingpreview

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

adsbot-google

Rule Path
Disallow /root$
Disallow /password-reset$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$
Disallow /root$
Disallow /password-reset$
Disallow /myaccount$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$
Disallow /customer$
Disallow /customer/

*

Rule Path
Disallow /root$
Disallow /password-reset$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$
Disallow /root$
Disallow /password-reset$
Disallow /myaccount$
Disallow /cart$
Disallow /checkout$
Disallow /checkout/
Disallow /register$
Disallow /customer$
Disallow /customer/

Other Records

Field Value
crawl-delay 10

semrushbot-sa

Rule Path
Allow /