aiplex.com
robots.txt

Robots Exclusion Standard data for aiplex.com

Resource Scan

Scan Details

Site Domain aiplex.com
Base Domain aiplex.com
Scan Status Ok
Last Scan2026-01-02T20:15:37+00:00
Next Scan 2026-02-01T20:15:37+00:00

Last Scan

Scanned2026-01-02T20:15:37+00:00
URL https://aiplex.com/robots.txt
Domain IPs 104.21.58.13, 172.67.153.226, 2606:4700:3033::6815:3a0d, 2606:4700:3037::ac43:99e2
Response IP 172.67.153.226
Found Yes
Hash 2af12cecf74443d64574a25aa2db71a7e901a523c188ae46cd77ba806eeb4fbf
SimHash 64021b946457

Groups

*

Rule Path
Allow /
Disallow /privacy-policy
Disallow /terms-condition
Disallow /cookies

googlebot

Rule Path
Allow /
Disallow /privacy-policy
Disallow /terms-condition
Disallow /cookies

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Allow /
Disallow /privacy-policy
Disallow /terms-condition
Disallow /cookies

bingbot

Rule Path
Allow /
Disallow /privacy-policy
Disallow /terms-condition
Disallow /cookies

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Allow /
Disallow /privacy-policy
Disallow /terms-condition
Disallow /cookies

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://aiplex.com/sitemap.xml

Comments

  • robots.txt for [Your New Project]
  • https://aiplex.com
  • Allow all crawlers full access
  • Specific crawling instructions
  • Sitemap location