furnituredirectuk.net
robots.txt

Robots Exclusion Standard data for furnituredirectuk.net

Resource Scan

Scan Details

Site Domain furnituredirectuk.net
Base Domain furnituredirectuk.net
Scan Status Ok
Last Scan2024-11-04T16:18:11+00:00
Next Scan 2024-12-04T16:18:11+00:00

Last Scan

Scanned2024-11-04T16:18:11+00:00
URL https://furnituredirectuk.net/robots.txt
Domain IPs 172.66.40.82, 172.66.43.174, 2606:4700:3108::ac42:2852, 2606:4700:3108::ac42:2bae
Response IP 172.66.40.82
Found Yes
Hash e631f574c54a7c331ddf4912976036b987535859152bd47c36aaf02f1a53d150
SimHash 481858016db8

Groups

googlebot
bingbot
yahoo! slurp
duckduckgo
baiduspider
facebookbot
twitterbot
linkedinbot
pinterest
whatsapp
applebot
ia_archiver
facebot
slackbot
discordbot
skypeuripreview
tumblr
flipboard
pocketbot
linebot
tinderbot
snapchat
zoominfobot
semrushbot
ahrefsbot
mj12bot
blexbot
archive.org_bot
uptimerobot
dotbot
paperlibot
scooperbot
feedlybot
newsblur

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://furnituredirectuk.net/sitemap.xml
sitemap https://furnituredirectuk.net/sitemap-1-1.xml
sitemap https://furnituredirectuk.net/sitemap-1-2.xml
sitemap https://furnituredirectuk.net/sitemap-1-3.xml
sitemap https://furnituredirectuk.net/sitemap-1-4.xml