pia.az
robots.txt

Robots Exclusion Standard data for pia.az

Resource Scan

Scan Details

Site Domain pia.az
Base Domain pia.az
Scan Status Ok
Last Scan2025-02-14T07:11:59+00:00
Next Scan 2025-03-16T07:11:59+00:00

Last Scan

Scanned2025-02-14T07:11:59+00:00
URL https://pia.az/robots.txt
Redirect https://poliqon.info/robots.txt
Redirect Domain poliqon.info
Redirect Base poliqon.info
Domain IPs 104.21.65.147, 172.67.164.27, 2606:4700:3034::ac43:a41b, 2606:4700:3036::6815:4193
Redirect IPs 104.21.75.48, 172.67.213.196, 2606:4700:3030::ac43:d5c4, 2606:4700:3036::6815:4b30
Response IP 172.67.213.196
Found Yes
Hash e055012ab5fb93f9f7c84c08c158ed72e9c07b27cd9e5d01fafa6853897ba485
SimHash 6d5cdc54c717

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Warnings

  • `request-rate` is not a known field.