f1fullraces.com
robots.txt

Robots Exclusion Standard data for f1fullraces.com

Resource Scan

Scan Details

Site Domain f1fullraces.com
Base Domain f1fullraces.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-05T15:04:12+00:00
Next Scan 2024-10-04T15:04:12+00:00

Last Successful Scan

Scanned2024-06-07T15:02:49+00:00
URL https://f1fullraces.com/robots.txt
Domain IPs 104.21.92.164, 172.67.196.9, 2606:4700:3036::6815:5ca4, 2606:4700:3037::ac43:c409
Response IP 172.67.196.9
Found Yes
Hash b14f8179417be372fdf44109cdaccbf2ddb8a33feef54ba0e5dc0edc00d4597e
SimHash c90c11016751

Groups

googlebot

Rule Path
Allow /
Allow /full-races/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /livestream/
Disallow /?blackhole

bingbot

Rule Path
Allow /
Allow /full-races/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /livestream/
Disallow /?blackhole

cfnetwork

Rule Path
Disallow /
Disallow /full-races/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /livestream/
Disallow /?blackhole

robot

Rule Path
Disallow /
Disallow /full-races/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /livestream/
Disallow /?blackhole

proximic

Rule Path
Disallow /
Disallow /full-races/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /livestream/
Disallow /?blackhole

bot\*

Rule Path
Disallow /
Disallow /full-races/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /livestream/
Disallow /?blackhole

ahrefsbot

Rule Path
Disallow /
Disallow /full-races/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /livestream/
Disallow /?blackhole

cliqzbot

Rule Path
Disallow /
Disallow /full-races/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /?blackhole

mj12bot

Rule Path
Disallow /
Disallow /full-races/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /?blackhole

mj12bot

Rule Path
Disallow /
Disallow /full-races/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /?blackhole