clubracer.be
robots.txt

Robots Exclusion Standard data for clubracer.be

Resource Scan

Scan Details

Site Domain clubracer.be
Base Domain clubracer.be
Scan Status Ok
Last Scan2024-09-22T18:02:20+00:00
Next Scan 2024-09-29T18:02:20+00:00

Last Scan

Scanned2024-09-22T18:02:20+00:00
URL https://clubracer.be/robots.txt
Redirect https://www.clubracer.be/robots.txt
Redirect Domain www.clubracer.be
Redirect Base clubracer.be
Domain IPs 31.193.181.19
Redirect IPs 31.193.181.19
Response IP 31.193.181.19
Found Yes
Hash fc976fdfe437cfd7646ab7f529a51256b3d938dab24dfef0b9a297b68470de22
SimHash 69061b07e0c4

Groups

*

Rule Path
Disallow /wp-admin/*
Disallow /wp-login.php
Disallow /wp-includes/*
Disallow /wp-content/*
Disallow /trackback
Disallow /feed
Disallow */comments
Disallow *?replytocom*
Disallow */comments-page-*
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow *post_type%3Dtribe_events*
Disallow *hide_subsequent_recurrences%3D*
Disallow *tribe-bar-date%3D*
Disallow *tribe-venue%3D*
Disallow *eventDisplay%3D*
Disallow *eventDate%3D*
Disallow *paged%3D*
Disallow *pagename%3D*
Disallow *shortcode%3D*
Disallow *ical%3D*
Disallow *outlook-ical%3D*
Disallow *related_series%3D*
Disallow *tribe_geofence%3D*

ahrefsbot/7.0

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

awariobot/1.0

Rule Path
Disallow /

awariorssbot/1.0

Rule Path
Disallow /

bidswitchbot/1.0

Rule Path
Disallow /

buck/2.4.2

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot/1.0

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

coccocbot-web/1.0

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dataforseobot/1.0

Rule Path
Disallow /

dotbot/1.2

Rule Path
Disallow /

friendly_crawler/nutch-1.20-snapshot

Rule Path
Disallow /

grapeshotcrawler/2.0

Rule Path
Disallow /

jooblebot/2.0

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

mojeekbot/0.11

Rule Path
Disallow /

lamarkbot

Rule Path
Disallow /

livelapbot/0.2

Rule Path
Disallow /

magpie-crawler/1.1

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

mojeekbot/0.11

Rule Path
Disallow /

omgili/0.5

Rule Path
Disallow /

paqlebot/2.0

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

pinterestbot/1.0

Rule Path
Disallow /

pressenginebot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot/1.0

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

wirereaderbot/1.0

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.clubracer.be/sitemap_index.xml