valesdedescontos.pt
robots.txt

Robots Exclusion Standard data for valesdedescontos.pt

Resource Scan

Scan Details

Site Domain valesdedescontos.pt
Base Domain valesdedescontos.pt
Scan Status Ok
Last Scan2024-10-07T19:25:15+00:00
Next Scan 2024-10-14T19:25:15+00:00

Last Scan

Scanned2024-10-07T19:25:15+00:00
URL https://valesdedescontos.pt/robots.txt
Redirect https://www.valesdedescontos.pt/robots.txt
Redirect Domain www.valesdedescontos.pt
Redirect Base valesdedescontos.pt
Domain IPs 104.21.19.131, 172.67.186.103, 2606:4700:3030::6815:1383, 2606:4700:3035::ac43:ba67
Redirect IPs 104.21.19.131, 172.67.186.103, 2606:4700:3030::6815:1383, 2606:4700:3035::ac43:ba67
Response IP 104.21.19.131
Found Yes
Hash d435fb65f5fdc66b840412cc69db491768a5a8cbeb5769e4f160b3346bcd1c06
SimHash ca38136a8cb2

Groups

*

Rule Path
Allow /
Disallow /*?s=*
Disallow /*?q=*
Disallow /*?goid=*
Disallow /*?hkcache=*
Disallow /*?amzn=*
Disallow /*ajax.php
Disallow /out/
Disallow /*?sitesearchbar=*

axur

Rule Path
Disallow /

netnames

Rule Path
Disallow /

hostingabusereporting.com

Rule Path
Disallow /

convey.it

Rule Path
Disallow /

getcouponhere-bot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

voltron

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

zoominfo

Rule Path
Disallow /

obot

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

bubing

Rule Path
Disallow /

lcc

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.valesdedescontos.pt/sitemap.xml