nandos.ae
robots.txt

Robots Exclusion Standard data for nandos.ae

Resource Scan

Scan Details

Site Domain nandos.ae
Base Domain nandos.ae
Scan Status Ok
Last Scan2026-01-05T02:01:32+00:00
Next Scan 2026-02-04T02:01:32+00:00

Last Scan

Scanned2026-01-05T02:01:32+00:00
URL https://www.nandos.ae/robots.txt
Domain IPs 104.21.65.48, 172.67.140.167, 2606:4700:3031::ac43:8ca7, 2606:4700:3037::6815:4130
Response IP 104.21.65.48
Found Yes
Hash 2a624232af35715a76316eba06fa1c0460914ef1cbfbd6403dfc94adb8009165
SimHash 201eda72a222

Groups

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow /help/79

Other Records

Field Value
crawl-delay 1

Comments

  • Baiduspider
  • end of file

Warnings

  • 1 invalid line.