free-ai.tools
robots.txt

Robots Exclusion Standard data for free-ai.tools

Resource Scan

Scan Details

Site Domain free-ai.tools
Base Domain free-ai.tools
Scan Status Ok
Last Scan2024-06-28T19:15:23+00:00
Next Scan 2024-07-05T19:15:23+00:00

Last Scan

Scanned2024-06-28T19:15:23+00:00
URL https://free-ai.tools/robots.txt
Redirect https://www.free-ai.tools/robots.txt
Redirect Domain www.free-ai.tools
Redirect Base free-ai.tools
Domain IPs 104.21.16.206, 172.67.215.235, 2606:4700:3033::6815:10ce, 2606:4700:3035::ac43:d7eb
Redirect IPs 104.21.16.206, 172.67.215.235, 2606:4700:3033::6815:10ce, 2606:4700:3035::ac43:d7eb
Response IP 104.21.16.206
Found Yes
Hash b9b0539bedc0a72ea415bbc2be695b8c6034c7c5306640fcf8b942f3a7cf196f
SimHash 49059c7047d3

Groups

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.free-ai.tools/sitemap.xml