veng.no
robots.txt

Robots Exclusion Standard data for veng.no

Resource Scan

Scan Details

Site Domain veng.no
Base Domain veng.no
Scan Status Ok
Last Scan2025-08-21T21:52:53+00:00
Next Scan 2025-09-20T21:52:53+00:00

Last Scan

Scanned2025-08-21T21:52:53+00:00
URL https://veng.no/robots.txt
Redirect https://www.veng.no/veng/robots.txt
Redirect Domain www.veng.no
Redirect Base veng.no
Domain IPs 18.157.99.228
Redirect IPs 104.21.75.240, 172.67.183.166, 2606:4700:3030::ac43:b7a6, 2606:4700:3034::6815:4bf0
Response IP 172.67.183.166
Found Yes
Hash dffbf11ffea1c49c85027517cdf9a1c082fe09ff1c3cc9e34334a0d0b8ddd94f
SimHash 3c441345e508

Groups

*

Rule Path
Allow /
Disallow /customer/account
Disallow /inaticgoogleshoppingfeed
Disallow /vp_admin
Disallow /vda_app
Disallow /ext_services
Disallow /sync-job

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.veng.no/veng/sitemap.xml