ilxor.com
robots.txt

Robots Exclusion Standard data for ilxor.com

Resource Scan

Scan Details

Site Domain ilxor.com
Base Domain ilxor.com
Scan Status Ok
Last Scan5/22/2025, 2:59:49 AM
Next Scan 5/29/2025, 2:59:49 AM

Last Scan

Scanned5/22/2025, 2:59:49 AM
URL https://ilxor.com/robots.txt
Domain IPs 104.26.4.37, 104.26.5.37, 172.67.74.59, 2606:4700:20::681a:425, 2606:4700:20::681a:525, 2606:4700:20::ac43:4a3b
Response IP 104.26.5.37
Found Yes
Hash a6d2efb60d220952b2f20bd58b4853072b000fd3af70ebcdb4190944c0eb15c7
SimHash 3818dd82cbe3

Groups

*

Rule Path
Disallow /ILX/Pages/confirmsubscription.jsp*
Disallow /ILX/LoginControllerServlet
Disallow /ILX/SearchControllerServlet
Disallow /ILX/SearchControllerServlet*

Other Records

Field Value
crawl-delay 2000

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-ocob

Rule Path
Disallow /

semrushbot-ft

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /