arc.it
robots.txt

Robots Exclusion Standard data for arc.it

Resource Scan

Scan Details

Site Domain arc.it
Base Domain arc.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-09T03:29:02+00:00
Next Scan 2026-01-16T03:29:02+00:00

Last Successful Scan

Scanned2025-01-22T10:37:30+00:00
URL https://arc.it/robots.txt
Domain IPs 185.120.80.13
Response IP 185.120.80.13
Found Yes
Hash cf55ac9c1eff98d706433417d36d9d7cbb684500fd91ad52f863a3ec72634e5c
SimHash 420ff0a6c237

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://arc.it/sitemap.xml
sitemap https://arc.it/sitemapindex.xml
sitemap https://arc.it/sitemapmobileindex.xml
sitemap https://arc.it/sitemap-hot-2994906.xml
sitemap https://arc.it/sitemap-hot-2992906.xml
sitemap https://arc.it/sitemap-hot-2990906.xml
sitemap https://arc.it/sitemap-hot-2988906.xml
sitemap https://arc.it/sitemap-hot-2986906.xml
sitemap https://arc.it/sitemap-hot-2984906.xml
sitemap https://arc.it/sitemap-hot-2982906.xml
sitemap https://arc.it/sitemap-hot-2980906.xml
sitemap https://arc.it/sitemap-hot-2978906.xml
sitemap https://arc.it/sitemap-hot-2976906.xml
sitemap https://arc.it/sitemap-hot-2974906.xml
sitemap https://arc.it/sitemap-hot-2972906.xml
sitemap https://arc.it/sitemap-hot-2970906.xml
sitemap https://arc.it/sitemap-hot-2968906.xml
sitemap https://arc.it/sitemap-hot-2966906.xml
sitemap https://arc.it/sitemap-hot-2964906.xml