aidirectori.es
robots.txt

Robots Exclusion Standard data for aidirectori.es

Resource Scan

Scan Details

Site Domain aidirectori.es
Base Domain aidirectori.es
Scan Status Ok
Last Scan2026-02-05T00:50:38+00:00
Next Scan 2026-03-07T00:50:38+00:00

Last Scan

Scanned2026-02-05T00:50:38+00:00
URL https://aidirectori.es/robots.txt
Redirect https://www.aidirectori.es/robots.txt
Redirect Domain www.aidirectori.es
Redirect Base aidirectori.es
Domain IPs 104.26.0.38, 104.26.1.38, 172.67.70.39, 2606:4700:20::681a:126, 2606:4700:20::681a:26, 2606:4700:20::ac43:4627
Redirect IPs 104.26.0.38, 104.26.1.38, 172.67.70.39, 2606:4700:20::681a:126, 2606:4700:20::681a:26, 2606:4700:20::ac43:4627
Response IP 104.26.1.38
Found Yes
Hash bd932ef49fda34d8a627f6b877ec3bfcd0b605a1ef80a80caa7a61e6a65252e8
SimHash 691c8820ef02

Groups

*

Rule Path
Allow /
Disallow /api/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.aidirectori.es/sitemap.xml