tutora.co.uk
robots.txt

Robots Exclusion Standard data for tutora.co.uk

Resource Scan

Scan Details

Site Domain tutora.co.uk
Base Domain tutora.co.uk
Scan Status Ok
Last Scan2025-11-24T20:10:38+00:00
Next Scan 2025-12-24T20:10:38+00:00

Last Scan

Scanned2025-11-24T20:10:38+00:00
URL https://tutora.co.uk/robots.txt
Redirect https://tutorful.co.uk/robots.txt
Redirect Domain tutorful.co.uk
Redirect Base tutorful.co.uk
Domain IPs 138.68.185.140
Redirect IPs 138.68.185.140
Response IP 138.68.185.140
Found Yes
Hash 1665312c808cef099929bc260c4c1cf6376384e817f826af7c7e314b904acdad
SimHash e23d9830e081

Groups

imagesiftbot

Rule Path
Disallow /message/
Disallow /tutor/
Disallow /docs/
Disallow /tutors/
Disallow /results
Disallow /student/
Disallow /referral-landing
Disallow *?sort*

Other Records

Field Value
crawl-delay 5

mj12bot

Rule Path
Disallow /message/
Disallow /tutor/
Disallow /docs/
Disallow /tutors/
Disallow /results
Disallow /student/
Disallow /referral-landing
Disallow *?sort*

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /message/
Disallow /tutor/
Disallow /docs/
Disallow /tutors/
Disallow /results
Disallow /student/
Disallow /referral-landing
Disallow *?sort*

Other Records

Field Value
crawl-delay 5

ahrefsbot

Rule Path
Disallow /message/
Disallow /tutor/
Disallow /docs/
Disallow /tutors/
Disallow /results
Disallow /student/
Disallow /referral-landing
Disallow *?sort*

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /message/
Disallow /tutor/
Disallow /docs/
Disallow /tutors/
Disallow /results
Disallow /student/
Disallow /referral-landing
Disallow *?sort*

Other Records

Field Value
crawl-delay 5

dotbot

Rule Path
Disallow /message/
Disallow /tutor/
Disallow /docs/
Disallow /tutors/
Disallow /results
Disallow /student/
Disallow /referral-landing
Disallow *?sort*

Other Records

Field Value
crawl-delay 5

petalbot

Rule Path
Disallow /message/
Disallow /tutor/
Disallow /docs/
Disallow /tutors/
Disallow /results
Disallow /student/
Disallow /referral-landing
Disallow *?sort*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /message/
Disallow /tutor/
Disallow /docs/
Disallow /tutors/
Disallow /results
Disallow /student/
Disallow /referral-landing
Disallow *?sort*

Other Records

Field Value
sitemap https://tutorful.co.uk/sitemap.xml
sitemap https://tutorful.co.uk/sitemap_index.xml