axr.co
robots.txt

Robots Exclusion Standard data for axr.co

Resource Scan

Scan Details

Site Domain axr.co
Base Domain axr.co
Scan Status Ok
Last Scan2025-05-22T10:33:57+00:00
Next Scan 2025-05-29T10:33:57+00:00

Last Scan

Scanned2025-05-22T10:33:57+00:00
URL https://axr.co/robots.txt
Redirect https://www.axr.co/robots.txt
Redirect Domain www.axr.co
Redirect Base axr.co
Domain IPs 34.250.153.99
Redirect IPs 3.164.85.126, 3.164.85.35, 3.164.85.46, 3.164.85.81
Response IP 18.165.140.78
Found Yes
Hash 12fc5da53a31b21141a50766b750cdf3e77010c2b7aaa36c22fdfa4edfea742a
SimHash 68225d148e92

Groups

*

Rule Path
Disallow /_hp/
Disallow /artist/
Disallow /asia/artist/
Disallow /hongkong/artist/
Disallow /jakarta/artist/
Disallow /manila/artist/
Disallow /singapore/artist/
Disallow /searchresults/

Other Records

Field Value
crawl-delay 8

Other Records

Field Value
sitemap https://www.axr.co/sitemap.xml