foodpanda.my
robots.txt

Robots Exclusion Standard data for foodpanda.my

Resource Scan

Scan Details

Site Domain foodpanda.my
Base Domain foodpanda.my
Scan Status Ok
Last Scan2024-09-24T16:11:43+00:00
Next Scan 2024-10-08T16:11:43+00:00

Last Scan

Scanned2024-09-24T16:11:43+00:00
URL https://foodpanda.my/robots.txt
Redirect https://www.foodpanda.my/robots.txt
Redirect Domain www.foodpanda.my
Redirect Base foodpanda.my
Domain IPs 104.18.38.5, 172.64.149.251
Redirect IPs 104.18.38.5, 172.64.149.251
Response IP 104.18.38.5
Found Yes
Hash 65f199c4438ab81ab4d245656307aebf02b07dc40b15e786436a1c3b1c744cf0
SimHash 5b81b5a27214

Groups

*

Rule Path
Disallow /login_check
Disallow /referral
Disallow /login
Disallow */city/new
Disallow */cuisine/new
Disallow */contents/new
Disallow */home
Disallow */landing-page
Disallow */restaurant/new
Disallow */campaign/*
Disallow */dine-in/*

adsbot-google

Rule Path
Allow */campaign/*

adsbot-google-mobile

Rule Path
Allow */campaign/*

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449