ib2-robot.it.com
robots.txt

Robots Exclusion Standard data for ib2-robot.it.com

Resource Scan

Scan Details

Site Domain ib2-robot.it.com
Base Domain it.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-13T00:51:31+00:00
Next Scan 2026-02-27T00:51:31+00:00

Last Successful Scan

Scanned2026-01-06T00:50:33+00:00
URL https://ib2-robot.it.com/robots.txt
Domain IPs 45.194.53.26, 45.194.53.52
Response IP 45.194.53.26
Found Yes
Hash de11d91bb39c8ee9e86d3235313b4db1813157d96edd9cd9ec8e3a1ce369f9c9
SimHash 6d454844c5d3

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://ib2-robot.it.com/sitemap.xml