sme.org
robots.txt

Robots Exclusion Standard data for sme.org

Resource Scan

Scan Details

Site Domain sme.org
Base Domain sme.org
Scan Status Ok
Last Scan2024-10-16T10:10:14+00:00
Next Scan 2024-11-15T10:10:14+00:00

Last Scan

Scanned2024-10-16T10:10:14+00:00
URL https://sme.org/robots.txt
Redirect https://www.sme.org/robots.txt
Redirect Domain www.sme.org
Redirect Base sme.org
Domain IPs 217.114.85.70
Redirect IPs 104.16.146.244, 104.16.147.244, 2606:4700::6810:92f4, 2606:4700::6810:93f4
Response IP 104.16.146.244
Found Yes
Hash 94b099b4130d91572435577f55d235779c045d88d50cb44fc3895157acd4376a
SimHash 611dd0517593

Groups

*

Rule Path
Disallow /EPiServer/
Disallow /Util/
Disallow /Search/
Disallow /sme-now/
Disallow /ui-kit/
Disallow /sme.org-redirects/
Disallow /qa-folder/

Other Records

Field Value
sitemap https://www.sme.org/Sitemap.xml