untarget.ai
robots.txt

Robots Exclusion Standard data for untarget.ai

Resource Scan

Scan Details

Site Domain untarget.ai
Base Domain untarget.ai
Scan Status Ok
Last Scan2025-09-14T03:52:40+00:00
Next Scan 2025-10-14T03:52:40+00:00

Last Scan

Scanned2025-09-14T03:52:40+00:00
URL https://untarget.ai/robots.txt
Domain IPs 2a11:27c0:10::182, 95.181.182.182
Response IP 95.181.182.182
Found Yes
Hash 2e435507b24153ca0a87dcd5d7429109aa451d031d82572a8c2069bdbed2a823
SimHash 6d04ba6ad773

Groups

*

Rule Path
Allow /
Disallow /?
Disallow /app/
Disallow /legal/

adsbot-google-mobile
adsbot-google

Rule Path
Allow /
Disallow /?
Disallow /app/
Disallow /legal/

yandex

Rule Path
Allow /
Disallow /app/
Disallow /legal/

Other Records

Field Value
sitemap https://untarget.ai/sitemap.xml

Comments

  • Optimization for Google Ads Bot

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.