profoodworld.com
robots.txt

Robots Exclusion Standard data for profoodworld.com

Resource Scan

Scan Details

Site Domain profoodworld.com
Base Domain profoodworld.com
Scan Status Ok
Last Scan2024-11-15T20:59:44+00:00
Next Scan 2024-11-22T20:59:44+00:00

Last Scan

Scanned2024-11-15T20:59:44+00:00
URL https://profoodworld.com/robots.txt
Redirect https://www.profoodworld.com/robots.txt
Redirect Domain www.profoodworld.com
Redirect Base profoodworld.com
Domain IPs 89.106.200.1
Redirect IPs 104.21.72.139, 172.67.151.39, 2606:4700:3034::6815:488b, 2606:4700:3035::ac43:9727
Response IP 104.21.72.139
Found Yes
Hash 06ec6009841078b9bbf9275afd96aecd185129983b2f98fbdf3bd6fbf4225c25
SimHash 3321f0692212

Groups

*

Rule Path
Disallow /__
Disallow /print/content

gptbot

Rule Path
Disallow /*/product/

chatgpt-user

Rule Path
Disallow /*/product/

Other Records

Field Value
sitemap https://www.profoodworld.com/sitemap.xml
sitemap https://www.profoodworld.com/sitemap-google-news.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449