resblockageapi-dev.dnv.com
robots.txt

Robots Exclusion Standard data for resblockageapi-dev.dnv.com

Resource Scan

Scan Details

Site Domain resblockageapi-dev.dnv.com
Base Domain dnv.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-01T17:07:24+00:00
Next Scan 2024-12-30T17:07:24+00:00

Last Successful Scan

Scanned2023-08-14T16:36:55+00:00
URL https://resblockageapi-dev.dnv.com/robots.txt
Domain IPs 20.212.64.11
Response IP 20.212.64.11
Found Yes
Hash 1465ece6256c9ca5752d2ff82271a0ae9de2b1582ca1354540d44d0134ff913a
SimHash 18189f02e820

Groups

ahrefssiteaudit

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mbcrawler/1.0

Rule Path
Disallow /