asos.jp
robots.txt

Robots Exclusion Standard data for asos.jp

Resource Scan

Scan Details

Site Domain asos.jp
Base Domain asos.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-13T11:17:08+00:00
Next Scan 2024-06-11T11:17:08+00:00

Last Successful Scan

Scanned2023-10-22T15:08:46+00:00
URL https://asos.jp/robots.txt
Redirect https://www.asos.jp/robots.txt
Redirect Domain www.asos.jp
Redirect Base asos.jp
Domain IPs 52.84.251.115, 52.84.251.31, 52.84.251.7, 52.84.251.78
Redirect IPs 65.9.112.103, 65.9.112.27, 65.9.112.44, 65.9.112.55
Response IP 18.65.3.67
Found Yes
Hash 024f393e87b4216078db088d3fa4f55f90387b4cfca915fe841e68ff613896e9
SimHash e914d8514733

Groups

*

Rule Path
Allow /
Disallow /en-*

Other Records

Field Value
sitemap https://www.asos.jp/sitemap.xml