cosmedicnorge.com
robots.txt

Robots Exclusion Standard data for cosmedicnorge.com

Resource Scan

Scan Details

Site Domain cosmedicnorge.com
Base Domain cosmedicnorge.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-13T18:30:15+00:00
Next Scan 2024-12-12T18:30:15+00:00

Last Successful Scan

Scanned2023-05-21T08:55:42+00:00
URL https://cosmedicnorge.com/robots.txt
Domain IPs 104.21.29.62, 172.67.148.131, 2606:4700:3032::ac43:9483, 2606:4700:3036::6815:1d3e
Response IP 172.67.148.131
Found Yes
Hash bdfb030f1580462dd92561e23a810c42eab3a7db46efcad6c97387959d5d251b
SimHash 4f085cb40752

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

linguee

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cosmedicnorge.com/sitemap.xml

Warnings

  • `host` is not a known field.