aizones.io
robots.txt

Robots Exclusion Standard data for aizones.io

Resource Scan

Scan Details

Site Domain aizones.io
Base Domain aizones.io
Scan Status Ok
Last Scan2025-11-03T03:29:40+00:00
Next Scan 2025-11-10T03:29:40+00:00

Last Scan

Scanned2025-11-03T03:29:40+00:00
URL https://aizones.io/robots.txt
Domain IPs 159.65.154.249
Response IP 159.65.154.249
Found Yes
Hash 73c57d315d9f76f3e1af93d92ccb9aa091f8041cf3a31e7e9422920f3c90dc7a
SimHash 6c088c11c5b7

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://api.aizones.io/sitemap-index.xml

Comments

  • https://www.robotstxt.org/robotstxt.html
  • Allow search engines
  • Allow social media crawlers
  • General rules for all other bots
  • Sitemap location