escortsinlondon.co.uk
robots.txt

Robots Exclusion Standard data for escortsinlondon.co.uk

Resource Scan

Scan Details

Site Domain escortsinlondon.co.uk
Base Domain escortsinlondon.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-18T08:15:11+00:00
Next Scan 2025-01-16T08:15:11+00:00

Last Successful Scan

Scanned2023-12-01T07:46:02+00:00
URL https://escortsinlondon.co.uk/robots.txt
Redirect https://www.escortsinlondon.co.uk/robots.txt
Redirect Domain www.escortsinlondon.co.uk
Redirect Base escortsinlondon.co.uk
Domain IPs 212.91.26.8
Redirect IPs 212.91.26.8
Response IP 212.91.26.8
Found Yes
Hash 6490a5956af5e5a2f4d3be8c58c84b3c6b1649b5d086d460651a64abf4332e75
SimHash 904541015b36

Groups

*

Rule Path
Allow /

stress-agent

Rule Path
Disallow /

e-societyrobot

Rule Path
Disallow /

psbot/0.1

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

mj12bot/v1.0.4

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefsbot/2.0

Rule Path
Disallow /

mj12bot/v1.4.0

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ahrefsbot/3.1

Rule Path
Disallow /

ahrefsbot/4.0

Rule Path
Disallow /

ahrefsbot/3.0

Rule Path
Disallow /

ahrefsbot/5.0

Rule Path
Disallow /

sitebot/0.1

Rule Path
Disallow /
Disallow /bin
Disallow /inc
Disallow /views
Disallow /icmsphotos
Disallow /icms