Log In Sign Up

nandos.mu
robots.txt

Robots Exclusion Standard data for nandos.mu

Resource Scan

Scan Details

Site Domain nandos.mu
Base Domain nandos.mu
Scan Status Ok
Last Scan2025-05-20T02:25:37+00:00
Next Scan 2025-06-03T02:25:37+00:00

Last Scan

Scanned2025-05-20T02:25:37+00:00
URL https://nandos.mu/robots.txt
Redirect https://www.nandos.mu/robots.txt
Redirect Domain www.nandos.mu
Redirect Base nandos.mu
Domain IPs 104.21.9.41, 172.67.141.121, 2606:4700:3035::6815:929, 2606:4700:3035::ac43:8d79
Redirect IPs 104.21.9.41, 172.67.141.121, 2606:4700:3035::6815:929, 2606:4700:3035::ac43:8d79
Response IP 172.67.141.121
Found Yes
Hash 2a624232af35715a76316eba06fa1c0460914ef1cbfbd6403dfc94adb8009165
SimHash 201eda72a222

Groups

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow /help/79

Other Records

Field Value
crawl-delay 1
Back to top

Comments

  • Baiduspider
  • end of file
Back to top

Warnings

  • 1 invalid line.
Back to top