pnwx.com
robots.txt

Robots Exclusion Standard data for pnwx.com

Resource Scan

Scan Details

Site Domain pnwx.com
Base Domain pnwx.com
Scan Status Ok
Last Scan2024-10-23T11:44:48+00:00
Next Scan 2024-11-22T11:44:48+00:00

Last Scan

Scanned2024-10-23T11:44:48+00:00
URL https://www.pnwx.com/robots.txt
Domain IPs 50.43.65.86
Response IP 50.43.65.86
Found Yes
Hash fb7bfd9750a7523137efffefd786daf7e50531d8a5d692f7950469baa2252ac7
SimHash 491a49eb5aa1

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /Equipment/MDInternational/
Disallow /Equipment/GeneralMedical/
Disallow /Equipment/AngelusRefurb/
Disallow /Search/

sitecheck.internetseer.com

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

npbot

Rule Path
Disallow /

omniexplorer_bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

gingercrawler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.