pacificwide.com
robots.txt

Robots Exclusion Standard data for pacificwide.com

Resource Scan

Scan Details

Site Domain pacificwide.com
Base Domain pacificwide.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-03T11:14:59+00:00
Next Scan 2026-04-03T11:14:59+00:00

Last Successful Scan

Scanned2025-02-15T06:40:09+00:00
URL https://pacificwide.com/robots.txt
Domain IPs 35.190.58.20
Response IP 35.190.58.20
Found Yes
Hash 87435b44d87b7e8de2f45b5e1ed88d385cd5c1fb32ccb72df78b909bc98cdd96
SimHash 0862da301c7b

Groups

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

red

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seekport

Rule Path
Disallow /

*

Rule Path
Disallow /backend
Disallow /blog/*/share.html
Disallow /blog/*/share/
Disallow /blog/*/print.html
Disallow /blog/*/print/
Disallow /idx/inc/php/ajax/
Disallow /idx/?refine
Disallow /*/idx/?refine
Disallow /idx/search/
Disallow /*/idx/search/
Disallow /idx/search.html
Disallow /*/idx/search.html
Disallow /idx/*/print.html
Disallow /idx/*/map.html
Disallow /idx/*/friend.html
Disallow /idx/*/inquire.html
Disallow /listing/*/inquire/
Disallow /listing/*/friend/
Disallow /listing/*/brochure/
Disallow /listing/*/brochure
Disallow /listing/*/mortgage/

Other Records

Field Value
crawl-delay 5

Comments

  • Block Baidu
  • http://help.baidu.com/question?prod_en=master&class=Baiduspider
  • Block Yandex
  • https://yandex.com/support/webmaster/controlling-robot/robots-txt.xml
  • Block Redbot
  • https://redbot.org/
  • Block Dotbot
  • https://wowrack.org/
  • Block Semrush
  • https://www.semrush.com/bot/
  • Block TrovitBot
  • https://www.trovit.com/bot.html
  • Block RogerBot
  • https://moz.com/help/moz-procedures/crawlers/rogerbot
  • Block SeekPort
  • http://seekport.com/
  • Generic bot rules