furnituredirectuk.net
robots.txt
Robots Exclusion Standard data for furnituredirectuk.net
Resource Scan
Scan Details
Site Domain | furnituredirectuk.net |
Base Domain | furnituredirectuk.net |
Scan Status | Ok |
Last Scan | 2024-11-04T16:18:11+00:00 |
Next Scan | 2024-12-04T16:18:11+00:00 |
Last Scan
Scanned | 2024-11-04T16:18:11+00:00 |
URL | https://furnituredirectuk.net/robots.txt |
Domain IPs | 172.66.40.82, 172.66.43.174, 2606:4700:3108::ac42:2852, 2606:4700:3108::ac42:2bae |
Response IP | 172.66.40.82 |
Found | Yes |
Hash | e631f574c54a7c331ddf4912976036b987535859152bd47c36aaf02f1a53d150 |
SimHash | 481858016db8 |
Groups
googlebot
bingbot
yahoo! slurp
duckduckgo
baiduspider
facebookbot
twitterbot
linkedinbot
pinterest
whatsapp
applebot
ia_archiver
facebot
slackbot
discordbot
skypeuripreview
tumblr
flipboard
pocketbot
linebot
tinderbot
snapchat
zoominfobot
semrushbot
ahrefsbot
mj12bot
blexbot
archive.org_bot
uptimerobot
dotbot
paperlibot
scooperbot
feedlybot
newsblur
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://furnituredirectuk.net/sitemap.xml |
sitemap | https://furnituredirectuk.net/sitemap-1-1.xml |
sitemap | https://furnituredirectuk.net/sitemap-1-2.xml |
sitemap | https://furnituredirectuk.net/sitemap-1-3.xml |
sitemap | https://furnituredirectuk.net/sitemap-1-4.xml |