menuprice.uk
robots.txt

Robots Exclusion Standard data for menuprice.uk

Resource Scan

Scan Details

Site Domain menuprice.uk
Base Domain menuprice.uk
Scan Status Ok
Last Scan2024-09-21T12:56:59+00:00
Next Scan 2024-09-28T12:56:59+00:00

Last Scan

Scanned2024-09-21T12:56:59+00:00
URL https://menuprice.uk/robots.txt
Redirect https://www.menuprice.uk/robots.txt
Redirect Domain www.menuprice.uk
Redirect Base menuprice.uk
Domain IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Redirect IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Response IP 52.221.42.138
Found Yes
Hash cee29dda0a5f1c3cc24b13d244be1d39a75d229ca84bd878302c7f5addf998bf
SimHash 485cd8736eb1

Groups

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

photon

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /api/*
Disallow /privacy
Disallow /terms
Disallow /dmca
Disallow /contact
Allow /

Other Records

Field Value
sitemap https://www.menuprice.uk/sitemap/sitemap-main.xml