planeta.pe
robots.txt

Robots Exclusion Standard data for planeta.pe

Resource Scan

Scan Details

Site Domain planeta.pe
Base Domain planeta.pe
Scan Status Ok
Last Scan2024-06-25T22:51:27+00:00
Next Scan 2024-07-02T22:51:27+00:00

Last Scan

Scanned2024-06-25T22:51:27+00:00
URL https://planeta.pe/robots.txt
Redirect https://www.planeta.pe/robots.txt
Redirect Domain www.planeta.pe
Redirect Base planeta.pe
Domain IPs 34.250.153.99
Redirect IPs 18.161.6.104, 18.161.6.108, 18.161.6.17, 18.161.6.63
Response IP 18.165.171.13
Found Yes
Hash 34e2572dc97d2fb4fd89c78d3bd0a23671c094ab3f3ee08cfbfb8ff05b8916ac
SimHash 6c604cd0cd93

Groups

*

Rule Path
Disallow /_hp/
Disallow /buscador/

Other Records

Field Value
crawl-delay 8

Other Records

Field Value
sitemap https://www.planeta.pe/sitemap.xml