Log In Sign Up

northwest-national.com
robots.txt

Robots Exclusion Standard data for northwest-national.com

Resource Scan

Scan Details

Site Domain northwest-national.com
Base Domain northwest-national.com
Scan Status Ok
Last Scan2025-03-14T10:51:57+00:00
Next Scan 2025-04-13T10:51:57+00:00

Last Scan

Scanned2025-03-14T10:51:57+00:00
URL https://northwest-national.com/robots.txt
Domain IPs 2607:9000:0:41::1:146, 68.235.39.146
Response IP 68.235.39.146
Found Yes
Hash abb734cf6bc4cce90cbc3d45e6b5b8a42576767ad3ff597efec08c4f0baddfe6
SimHash c1159462c69b

Groups

*

Rule Path
Disallow /report_listing/
Disallow /preview/
Disallow */slideshow.html
Disallow */request_catalog.html

googlebot-image

Rule Path
Disallow /pdf/
Disallow /font/

ahrefsbot
blexbot
dotbot
mj12bot
petalbot
rogerbot
smtbot
yak

Rule Path
Disallow /photo/
Disallow /resize/
Disallow /pdf/
Disallow /font/

Other Records

Field Value
crawl-delay 60

baiduspider
bytespider
dataforseobot
blexbot
ev-crawler
ioncrawl
gptbot
marketgoo
semrushbot
seokicks
yandexbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 3600
Back to top

Other Records

Field Value
sitemap https://northwest-national.com/sitemap.xml
Back to top