ukscrambles.com
robots.txt

Robots Exclusion Standard data for ukscrambles.com

Resource Scan

Scan Details

Site Domain ukscrambles.com
Base Domain ukscrambles.com
Scan Status Ok
Last Scan2025-04-09T15:30:41+00:00
Next Scan 2025-04-16T15:30:41+00:00

Last Scan

Scanned2025-04-09T15:30:41+00:00
URL https://ukscrambles.com/robots.txt
Domain IPs 104.21.87.21, 172.67.168.170, 2606:4700:3031::ac43:a8aa, 2606:4700:3037::6815:5715
Response IP 104.21.87.21
Found Yes
Hash b0f209562f434b3628ed003bf986480bf856d6b29b9e7564ec6a2243095c7a89
SimHash 67575761d4d2

Groups

ccbot/2.0

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

photon/1.0

Rule Path
Disallow /

yahoomailproxy

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

twitterbot/1.0

Rule Path
Disallow /

wprocketbot

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

nimbostratus-bot/v1.3.2

Rule Path
Disallow /

changedetection/7.0

Rule Path
Disallow /

yandeximages/3.0

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

seoterritory.com bot

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

semantic-visions.com crawler

Rule Path
Disallow /

seznambot/3.2

Rule Path
Disallow /
Allow /

Other Records

Field Value
sitemap https://www.ukscrambles.com/sitemap_index.xml