leadingcourses.com
robots.txt

Robots Exclusion Standard data for leadingcourses.com

Resource Scan

Scan Details

Site Domain leadingcourses.com
Base Domain leadingcourses.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-24T06:41:19+00:00
Next Scan 2024-11-22T06:41:19+00:00

Last Successful Scan

Scanned2024-01-28T06:39:42+00:00
URL https://leadingcourses.com/robots.txt
Redirect https://www.leadingcourses.com/robots.txt
Redirect Domain www.leadingcourses.com
Redirect Base leadingcourses.com
Domain IPs 18.196.135.19, 52.57.101.168, 54.93.143.125
Redirect IPs 18.196.135.19, 52.57.101.168, 54.93.143.125
Response IP 18.196.135.19
Found Yes
Hash 965ad5714de9ccfdf5cc01f4683d3e9df706140318413a08adbbc580198bb3cf
SimHash 6b079921c091

Groups

*
adsbot-google-mobile
adsbot-google

Rule Path
Allow /
Disallow /user/
Disallow */users/*
Disallow /info/
Disallow /booking/
Disallow */golf-club-review*
Disallow /api/*

baiduspider
cazoodlebot
fasterfox
teracent-feed-processing
jyxobot
mj12bot
shopwiki
ahrefsbot
semrushbot
dotbot
yandexbot
petalbot
aspiegelbot

Rule Path
Disallow /

msnbot
slurp
yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.leadingcourses.com/sitemap.xml