best-ai-tools.io
robots.txt

Robots Exclusion Standard data for best-ai-tools.io

Resource Scan

Scan Details

Site Domain best-ai-tools.io
Base Domain best-ai-tools.io
Scan Status Ok
Last Scan2025-10-07T09:33:52+00:00
Next Scan 2025-11-06T09:33:52+00:00

Last Scan

Scanned2025-10-07T09:33:52+00:00
URL https://best-ai-tools.io/robots.txt
Domain IPs 192.0.78.153, 192.0.78.216
Response IP 192.0.78.153
Found Yes
Hash 57f1ffb976d4cf0efffc3d8c785a1dcc028d57677c816530b8d443c2989d1f60
SimHash 6900c8428f92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

Other Records

Field Value
sitemap https://best-ai-tools.io/sitemap.xml
sitemap https://best-ai-tools.io/sitemap-news.xml