andrelug.com
robots.txt

Robots Exclusion Standard data for andrelug.com

Resource Scan

Scan Details

Site Domain andrelug.com
Base Domain andrelug.com
Scan Status Ok
Last Scan2025-11-28T19:57:21+00:00
Next Scan 2025-12-05T19:57:21+00:00

Last Scan

Scanned2025-11-28T19:57:21+00:00
URL https://andrelug.com/robots.txt
Domain IPs 104.21.47.34, 172.67.144.46, 2606:4700:3034::6815:2f22, 2606:4700:3035::ac43:902e
Response IP 104.21.47.34
Found Yes
Hash 4209ff52fa236dd8a3f8feb31eddbf79c5cf535412b5e7ae07f8b142a315d854
SimHash 001c8d606e93

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://andrelug.com/?feed=xmlsitemap1612