foodeist.com
robots.txt

Robots Exclusion Standard data for foodeist.com

Resource Scan

Scan Details

Site Domain foodeist.com
Base Domain foodeist.com
Scan Status Ok
Last Scan2026-02-21T08:00:58+00:00
Next Scan 2026-02-28T08:00:58+00:00

Last Scan

Scanned2026-02-21T08:00:58+00:00
URL https://foodeist.com/robots.txt
Domain IPs 104.21.25.151, 172.67.134.85, 2606:4700:3031::6815:1997, 2606:4700:3034::ac43:8655
Response IP 172.67.134.85
Found Yes
Hash e77dc76c63259592803966c81841b8182988eea177adba15f70653940e16bc86
SimHash f41888aa9e10

Groups

*

Rule Path
Allow /
Disallow /login
Disallow /register
Disallow /forgot-password
Disallow /reset-password
Disallow /password/
Disallow /email/verify
Disallow /profile/*/setting
Disallow /widget/
Disallow /link/review%3A

blexbot
amazonbot
petalbot
sentibot
magpie-crawler
bytespider
claudebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://foodeist.com/sitemap.xml