Log In Sign Up

railcard.co.uk
robots.txt

Robots Exclusion Standard data for railcard.co.uk

Resource Scan

Scan Details

Site Domain railcard.co.uk
Base Domain railcard.co.uk
Scan Status Ok
Last Scan2024-09-27T21:07:06+00:00
Next Scan 2024-10-11T21:07:06+00:00

Last Scan

Scanned2024-09-27T21:07:06+00:00
URL https://railcard.co.uk/robots.txt
Redirect https://www.railcard.co.uk/robots.txt
Redirect Domain www.railcard.co.uk
Redirect Base railcard.co.uk
Domain IPs 13.35.238.79, 13.35.238.8, 13.35.238.85, 13.35.238.97, 2600:9000:2085:2a00:f:6e6b:4bc0:93a1, 2600:9000:2085:b200:f:6e6b:4bc0:93a1, 2600:9000:2085:b600:f:6e6b:4bc0:93a1, 2600:9000:2085:c000:f:6e6b:4bc0:93a1, 2600:9000:2085:da00:f:6e6b:4bc0:93a1, 2600:9000:2085:dc00:f:6e6b:4bc0:93a1, 2600:9000:2085:e200:f:6e6b:4bc0:93a1, 2600:9000:2085:fc00:f:6e6b:4bc0:93a1
Redirect IPs 13.35.238.79, 13.35.238.8, 13.35.238.85, 13.35.238.97, 2600:9000:2816:1600:f:6e6b:4bc0:93a1, 2600:9000:2816:1c00:f:6e6b:4bc0:93a1, 2600:9000:2816:5000:f:6e6b:4bc0:93a1, 2600:9000:2816:5400:f:6e6b:4bc0:93a1, 2600:9000:2816:9000:f:6e6b:4bc0:93a1, 2600:9000:2816:9a00:f:6e6b:4bc0:93a1, 2600:9000:2816:ce00:f:6e6b:4bc0:93a1, 2600:9000:2816:fc00:f:6e6b:4bc0:93a1
Response IP 13.35.238.8
Found Yes
Hash 6c8901caf845c2290bd0dee977d14cd4a639b962f9ee21ebcbfdf00acb990e7b
SimHash 2046ccf64613

Groups

*

Rule Path
Disallow /.htaccess
Disallow /admin/
Disallow /toolbar/
Disallow /ajax/
Disallow /?
Disallow /%3D
Disallow /complete/
Disallow /search/

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

yandex

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.railcard.co.uk/sitemap.xml
sitemap https://www.16-25railcard.co.uk/sitemap.xml
sitemap https://www.disabledpersons-railcard.co.uk/sitemap.xml
sitemap https://www.familyandfriends-railcard.co.uk/sitemap.xml
sitemap https://www.network-railcard.co.uk/sitemap.xml
sitemap https://www.twotogether-railcard.co.uk/sitemap.xml
sitemap https://www.26-30railcard.co.uk/sitemap.xml
sitemap https://www.senior-railcard.co.uk/sitemap.xml
sitemap https://www.16-17saver.co.uk/sitemap.xml
sitemap https://www.veterans-railcard.co.uk/sitemap.xml
Back to top