amsterdamcafe.com
robots.txt

Robots Exclusion Standard data for amsterdamcafe.com

Resource Scan

Scan Details

Site Domain amsterdamcafe.com
Base Domain amsterdamcafe.com
Scan Status Ok
Last Scan2024-09-10T11:44:48+00:00
Next Scan 2024-10-10T11:44:48+00:00

Last Scan

Scanned2024-09-10T11:44:48+00:00
URL https://amsterdamcafe.com/robots.txt
Domain IPs 107.191.37.174, 2001:19f0:1000:2f42:5400:4ff:fe90:9f3b
Response IP 107.191.37.174
Found Yes
Hash 43296e5b3530081dedb2eeccf245b01729d43e32ee7ccc6ff1065d1b708a7dc7
SimHash 8e67cc209cd3

Groups

*

Rule Path
Disallow /wp-json/

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://amsterdamcafe.com/sitemap_index.xml

Comments

  • Global rules
  • -----------------
  • Sitemap
  • -----------------
  • Ban bots that don't benefit Amsterdam Cafe
  • --------------------------------