webpin.com
robots.txt

Robots Exclusion Standard data for webpin.com

Resource Scan

Scan Details

Site Domain webpin.com
Base Domain webpin.com
Scan Status Ok
Last Scan2024-09-21T01:22:37+00:00
Next Scan 2024-10-21T01:22:37+00:00

Last Scan

Scanned2024-09-21T01:22:37+00:00
URL http://webpin.com/robots.txt
Redirect https://pagina.mx/robots.txt
Redirect Domain pagina.mx
Redirect Base pagina.mx
Domain IPs 207.182.143.50
Redirect IPs 207.182.143.50
Response IP 207.182.143.50
Found Yes
Hash 5fa9ded6edee43e3566e651ff90f4e2b611bc1bfb10f017004673b4345ba2122
SimHash 0214dc12c242

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ia_archiver

Rule Path
Disallow /