Log In Sign Up

b-corsairs.com
robots.txt

Robots Exclusion Standard data for b-corsairs.com

Resource Scan

Scan Details

Site Domain b-corsairs.com
Base Domain b-corsairs.com
Scan Status Ok
Last Scan2025-08-13T14:31:44+00:00
Next Scan 2025-09-12T14:31:44+00:00

Last Scan

Scanned2025-08-13T14:31:44+00:00
URL https://b-corsairs.com/robots.txt
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Response IP 151.101.66.133
Found Yes
Hash 43c9d466d16528226b172fd450ff49cc2e62a36bc4fb7f50ccb196acf70975ab
SimHash 125fd4014698

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /
Back to top