latestdeals.co.uk
robots.txt

Robots Exclusion Standard data for latestdeals.co.uk

Resource Scan

Scan Details

Site Domain latestdeals.co.uk
Base Domain latestdeals.co.uk
Scan Status Ok
Last Scan2024-09-21T17:31:58+00:00
Next Scan 2024-09-28T17:31:58+00:00

Last Scan

Scanned2024-09-21T17:31:58+00:00
URL https://latestdeals.co.uk/robots.txt
Redirect https://www.latestdeals.co.uk/robots.txt
Redirect Domain www.latestdeals.co.uk
Redirect Base latestdeals.co.uk
Domain IPs 108.156.133.107, 108.156.133.118, 108.156.133.43, 108.156.133.75
Redirect IPs 13.35.210.25, 13.35.210.46, 13.35.210.65, 13.35.210.69, 2600:9000:2078:1000:17:96ff:3b80:93a1, 2600:9000:2078:1600:17:96ff:3b80:93a1, 2600:9000:2078:1a00:17:96ff:3b80:93a1, 2600:9000:2078:3800:17:96ff:3b80:93a1, 2600:9000:2078:5a00:17:96ff:3b80:93a1, 2600:9000:2078:9c00:17:96ff:3b80:93a1, 2600:9000:2078:e200:17:96ff:3b80:93a1, 2600:9000:2078:ee00:17:96ff:3b80:93a1
Response IP 13.35.210.46
Found Yes
Hash 7180485d7990d6d2aaae4041f7ffd80ad306a67e5e1c8e871fbf29ba2e1bddad
SimHash 6b11db34eed2

Groups

*

Rule Path
Disallow /go/
Disallow /go
Disallow /claim
Disallow /claim/
Disallow /login
Disallow /join
Disallow /%40*

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://assets.latestdeals.co.uk/sitemaps/sitemap-index.xml