clubracer.eu
robots.txt

Robots Exclusion Standard data for clubracer.eu

Resource Scan

Scan Details

Site Domain clubracer.eu
Base Domain clubracer.eu
Scan Status Ok
Last Scan2024-09-23T04:55:49+00:00
Next Scan 2024-09-30T04:55:49+00:00

Last Scan

Scanned2024-09-23T04:55:49+00:00
URL https://clubracer.eu/robots.txt
Redirect https://www.clubracer.eu/robots.txt
Redirect Domain www.clubracer.eu
Redirect Base clubracer.eu
Domain IPs 31.193.181.19
Redirect IPs 31.193.181.19
Response IP 31.193.181.19
Found Yes
Hash f3d476c47aab93759ee179357ed762cda6040d239c77e0fc9bfbc6bc87195c83
SimHash 6b0f1107d2d0

Groups

*

Rule Path
Disallow /wp-admin/*
Disallow /wp-login.php
Disallow /wp-includes/*
Disallow /wp-content/*
Disallow /trackback
Disallow /feed
Disallow */comments
Disallow *?replytocom*
Disallow */comments-page-*
Disallow */trackback
Disallow */feed
Disallow */comments

ahrefsbot/7.0

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

awariorssbot/1.0

Rule Path
Disallow /

bidswitchbot/1.0

Rule Path
Disallow /

buck/2.4.2

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot/1.0

Rule Path
Disallow /

coccocbot-web/1.0

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

dataforseobot/1.0

Rule Path
Disallow /

dotbot/1.2

Rule Path
Disallow /

friendly_crawler/nutch-1.20-snapshot

Rule Path
Disallow /

grapeshotcrawler/2.0

Rule Path
Disallow /

jooblebot/2.0

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

mojeekbot/0.11

Rule Path
Disallow /

lamarkbot

Rule Path
Disallow /

livelapbot/0.2

Rule Path
Disallow /

magpie-crawler/1.1

Rule Path
Disallow /

paqlebot/2.0

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

sentibot/1.0

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

wirereaderbot/1.0

Rule Path
Disallow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.clubracer.eu/sitemap_index.xml