foodpanda.com.bd
robots.txt

Robots Exclusion Standard data for foodpanda.com.bd

Resource Scan

Scan Details

Site Domain foodpanda.com.bd
Base Domain foodpanda.com.bd
Scan Status Ok
Last Scan2024-09-25T00:54:38+00:00
Next Scan 2024-10-09T00:54:38+00:00

Last Scan

Scanned2024-09-25T00:54:38+00:00
URL https://foodpanda.com.bd/robots.txt
Redirect https://www.foodpanda.com.bd/robots.txt
Redirect Domain www.foodpanda.com.bd
Redirect Base foodpanda.com.bd
Domain IPs 104.18.35.213, 172.64.152.43
Redirect IPs 104.18.35.213, 172.64.152.43
Response IP 104.18.35.213
Found Yes
Hash ba35307d2b32af56fd99e79b7cc4e81ce21696f6d420ff8027fb3fb8442c025f
SimHash 5b81b5a27214

Groups

*

Rule Path
Disallow /login_check
Disallow /referral
Disallow /login
Disallow */city/new
Disallow */cuisine/new
Disallow */contents/new
Disallow */home
Disallow */landing-page
Disallow */restaurant/new
Disallow */campaign/*
Disallow */dine-in/*

adsbot-google

Rule Path
Allow */campaign/*

adsbot-google-mobile

Rule Path
Allow */campaign/*

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449