Log In Sign Up

revolution.co.uk
robots.txt

Robots Exclusion Standard data for revolution.co.uk

Resource Scan

Scan Details

Site Domain revolution.co.uk
Base Domain revolution.co.uk
Scan Status Ok
Last Scan2024-05-21T07:45:04+00:00
Next Scan 2024-06-20T07:45:04+00:00

Last Scan

Scanned2024-05-21T07:45:04+00:00
URL https://revolution.co.uk/robots.txt
Domain IPs 104.26.0.60, 104.26.1.60, 172.67.69.153, 2606:4700:20::681a:13c, 2606:4700:20::681a:3c, 2606:4700:20::ac43:4599
Response IP 104.26.1.60
Found Yes
Hash dde9b2ed3c656ccc16c75da84fde7f9be92bb6856cbe62addc94add0a7e76903
SimHash 28035481c89b

Groups

googlebot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 30

googlebot-image

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 30

bingbot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

msnbot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

applebot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

slurp

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

duckduckbot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

semrushbot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

facebookexternalhit

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

pinterestbot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

linkedinbot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

telegrambot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

discordbot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

twitterbot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

ia_archiver

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

screaming frog seo spider

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

baiduspider

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

yandexbot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

exabot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

naverbot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

seznambot

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

teoma

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 600
Back to top

Other Records

Field Value
sitemap https://revolution.co.uk/sitemap_index.xml
Back to top