petra.mx
robots.txt

Robots Exclusion Standard data for petra.mx

Resource Scan

Scan Details

Site Domain petra.mx
Base Domain petra.mx
Scan Status Ok
Last Scan2025-03-06T16:39:44+00:00
Next Scan 2025-04-05T16:39:44+00:00

Last Scan

Scanned2025-03-06T16:39:44+00:00
URL https://www.petra.mx/robots.txt
Domain IPs 104.21.57.164, 172.67.164.233, 2606:4700:3034::ac43:a4e9, 2606:4700:3037::6815:39a4
Response IP 104.21.57.164
Found Yes
Hash 330c5ccc114a9933fc146c51012f8b7de9ba8aff1672fb846caf68cccf0b4dc8
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10