staging.arc.dev
robots.txt

Robots Exclusion Standard data for staging.arc.dev

Resource Scan

Scan Details

Site Domain staging.arc.dev
Base Domain arc.dev
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-03-24T21:45:23+00:00
Next Scan 2024-06-22T21:45:23+00:00

Last Successful Scan

Scanned2023-02-06T18:08:44+00:00
URL https://staging.arc.dev/robots.txt
Domain IPs 13.224.250.101, 13.224.250.5, 13.224.250.59, 13.224.250.71, 2600:9000:223b:2000:1a:282e:65c0:93a1, 2600:9000:223b:2800:1a:282e:65c0:93a1, 2600:9000:223b:9000:1a:282e:65c0:93a1, 2600:9000:223b:ae00:1a:282e:65c0:93a1, 2600:9000:223b:c000:1a:282e:65c0:93a1, 2600:9000:223b:c600:1a:282e:65c0:93a1, 2600:9000:223b:ea00:1a:282e:65c0:93a1, 2600:9000:223b:ee00:1a:282e:65c0:93a1
Response IP 13.33.88.119
Found Yes
Hash ace36a54d2c1c0ff06621871a728c5657fa53ff72e5e296ae0ef2eae5851d0c0
SimHash 4b1488c0af93

Groups

amazonbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /resume/builder/

Other Records

Field Value
sitemap https://arc.dev/sitemap.xml