petpedia.net
robots.txt

Robots Exclusion Standard data for petpedia.net

Resource Scan

Scan Details

Site Domain petpedia.net
Base Domain petpedia.net
Scan Status Ok
Last Scan2024-11-09T12:53:45+00:00
Next Scan 2024-11-16T12:53:45+00:00

Last Scan

Scanned2024-11-09T12:53:45+00:00
URL https://petpedia.net/robots.txt
Domain IPs 52.68.12.114, 57.180.218.229
Response IP 52.68.12.114
Found Yes
Hash 78c3f00f2c32213d863045bdd231fe5a21f2272a55f113269a2bdf6f891b7f6b
SimHash 8d1dd2a2c162

Groups

megalodon

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /