itagle.it
robots.txt

Robots Exclusion Standard data for itagle.it

Resource Scan

Scan Details

Site Domain itagle.it
Base Domain itagle.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-12-04T01:39:18+00:00
Next Scan 2026-01-03T01:39:18+00:00

Last Successful Scan

Scanned2025-11-03T19:53:51+00:00
URL https://itagle.it/robots.txt
Redirect https://www.itagle.it/robots.txt
Redirect Domain www.itagle.it
Redirect Base itagle.it
Domain IPs 31.11.35.221
Redirect IPs 31.11.35.221
Response IP 31.11.35.221
Found Yes
Hash 92de56393d31fc7d57d38d254c602db5b40dfac857d61ca86cde007d019a46ed
SimHash 271b55557397

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Comments

  • Simple Robots.txt 0.1