Log In Sign Up

fulhamboysschool.org
robots.txt

Robots Exclusion Standard data for fulhamboysschool.org

Resource Scan

Scan Details

Site Domain fulhamboysschool.org
Base Domain fulhamboysschool.org
Scan Status Ok
Last Scan2026-02-06T16:27:07+00:00
Next Scan 2026-03-08T16:27:07+00:00

Last Scan

Scanned2026-02-06T16:27:07+00:00
URL https://fulhamboysschool.org/robots.txt
Domain IPs 35.214.72.69
Response IP 35.214.72.69
Found Yes
Hash a596911f5f43ded5bc7955349cc3997611b4656a8aa0dabf96d6ee66cb6fec68
SimHash 480d0bd388e7

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

google-pagespeed

Rule Path
Allow /

google-site-verification

Rule Path
Allow /

lighthouse

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

bardbot

Rule Path
Disallow /

komobot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

youbot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

webzio

Rule Path
Disallow /

stablediffusionbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

grok

Rule Path
Disallow /

grokai

Rule Path
Disallow /

xai

Rule Path
Disallow /

xbot

Rule Path
Disallow /

ai2bot-dolma

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

openaicontentcrawler

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

aimatrixcrawler

Rule Path
Disallow /

amazon-ai

Rule Path
Disallow /

anthropicbot

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

chatglm-spider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

erniebot

Rule Path
Disallow /

deepseekbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://fulhamboysschool.org/sitemap.xml
sitemap https://fulhamboysschool.org/news-sitemap.xml
Back to top

Comments

  • START AI Scrape Protect block
  • ---------------------------
  • ---------------------------
  • END AI Scrape Protect block
Back to top

Warnings

  • 2 invalid lines.
Back to top