edamam.com
robots.txt

Robots Exclusion Standard data for edamam.com

Resource Scan

Scan Details

Site Domain edamam.com
Base Domain edamam.com
Scan Status Ok
Last Scan2024-06-03T04:18:43+00:00
Next Scan 2024-06-17T04:18:43+00:00

Last Scan

Scanned2024-06-03T04:18:43+00:00
URL https://www.edamam.com/robots.txt
Domain IPs 107.20.173.119
Response IP 107.20.173.119
Found Yes
Hash 5cec37c5b84528f9ba9b22b03edeb0ba340166cc42c887887ecb7c4de0a9872d
SimHash a1400c08d5d3

Groups

gigabot

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

bdfetch

Rule Path
Disallow /

bigcliquebot

Rule Path
Disallow /

euripbot

Rule Path
Disallow /

everbeecrawler

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

gonzo1

Rule Path
Disallow /

kinjabot

Rule Path
Disallow /

lapozzbot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

miva

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

rosaliawebcrawler

Rule Path
Disallow /

zeus

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /email.php
Disallow /contact.php
Disallow /msg.php
Disallow /widget-email.php
Disallow /api/
Disallow /php/
Disallow /shorten
Disallow /m

Other Records

Field Value
sitemap https://www.edamam.com/sitemaps/sitemap-1.xml
sitemap https://www.edamam.com/sitemaps/sitemap-2.xml
sitemap https://www.edamam.com/sitemaps/sitemap-3.xml
sitemap https://www.edamam.com/sitemaps/sitemap-4.xml
sitemap https://www.edamam.com/sitemaps/sitemap-5.xml
sitemap https://www.edamam.com/sitemaps/sitemap-6.xml
sitemap https://www.edamam.com/sitemaps/sitemap-7.xml
sitemap https://www.edamam.com/sitemaps/sitemap-8.xml
sitemap https://www.edamam.com/sitemaps/sitemap-9.xml
sitemap https://www.edamam.com/sitemaps/sitemap-10.xml
sitemap https://www.edamam.com/sitemaps/sitemap-11.xml
sitemap https://www.edamam.com/sitemap.xml

Comments

  • stupid bots not welcome
  • other robots mostly welcome