Log In Sign Up

wilkinsonpc.com.co
robots.txt

Robots Exclusion Standard data for wilkinsonpc.com.co

Resource Scan

Scan Details

Site Domain wilkinsonpc.com.co
Base Domain wilkinsonpc.com.co
Scan Status Ok
Last Scan2025-04-16T15:09:21+00:00
Next Scan 2025-04-23T15:09:21+00:00

Last Scan

Scanned2025-04-16T15:09:21+00:00
URL https://wilkinsonpc.com.co/robots.txt
Redirect https://www.wilkinsonpc.com.co/robots.txt
Redirect Domain www.wilkinsonpc.com.co
Redirect Base wilkinsonpc.com.co
Domain IPs 104.21.51.248, 172.67.192.67, 2606:4700:3036::6815:33f8, 2606:4700:3036::ac43:c043
Redirect IPs 104.21.51.248, 172.67.192.67, 2606:4700:3036::6815:33f8, 2606:4700:3036::ac43:c043
Response IP 172.67.192.67
Found Yes
Hash e915f113d1397c825493a24f3f3a2a3f1881a3a6d8a81a0ac9a7d2445f26111e
SimHash 2c0a48f007d7

Groups

*

Rule Path
Disallow /formbox/
Disallow /includes/

googlebot

Rule Path
Disallow /formbox/

msiecrawler

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

slurp

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 120

psbot

Rule Path
Disallow /
Back to top

Comments

  • wilkinsonpc follows robots.txt exclusion standards set
  • forth at <http://www.robotstxt.org/wc/exclusion.html>. Please
  • do not build any automated search engine without obeying those
  • rules.
  • wilkinsonpc sigue los estandares de exclusion robots.txt
  • descritos en <http://www.robotstxt.org/wc/exclusion.html>. Por
  • favor no disene ningun buscador automatizado sin cumplir dichas
  • normas.
Back to top