pro.napaprolink.com
robots.txt

Robots Exclusion Standard data for pro.napaprolink.com

Resource Scan

Scan Details

Site Domain pro.napaprolink.com
Base Domain napaprolink.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-21T15:31:32+00:00
Next Scan 2025-12-20T15:31:32+00:00

Last Successful Scan

Scanned2025-07-31T07:17:00+00:00
URL https://pro.napaprolink.com/robots.txt
Domain IPs 104.18.40.193, 172.64.147.63
Response IP 104.18.40.193
Found Yes
Hash 631ede4f29f59677f1874b95c4dc2eb6f7563788b10505f1338a87cd0794ccd3
SimHash bc46d726edf8

Groups

*
cazoodlebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

Comments

  • NAPA PROLink Common Section
  • For all robots
  • Block CazoodleBot as it does not present correct accept content headers
  • Block MJ12bot as it is just noise
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot