digitalshadows.com
robots.txt

Robots Exclusion Standard data for digitalshadows.com

Resource Scan

Scan Details

Site Domain digitalshadows.com
Base Domain digitalshadows.com
Scan Status Ok
Last Scan2024-05-27T19:02:29+00:00
Next Scan 2024-06-26T19:02:29+00:00

Last Scan

Scanned2024-05-27T19:02:29+00:00
URL https://digitalshadows.com/robots.txt
Redirect https://www.digitalshadows.com/robots.txt
Redirect Domain www.digitalshadows.com
Redirect Base digitalshadows.com
Domain IPs 13.227.254.10, 13.227.254.18, 13.227.254.32, 13.227.254.5, 2600:9000:200a:2600:9:91af:d140:93a1, 2600:9000:200a:2e00:9:91af:d140:93a1, 2600:9000:200a:3e00:9:91af:d140:93a1, 2600:9000:200a:5a00:9:91af:d140:93a1, 2600:9000:200a:6a00:9:91af:d140:93a1, 2600:9000:200a:8400:9:91af:d140:93a1, 2600:9000:200a:da00:9:91af:d140:93a1, 2600:9000:200a:ec00:9:91af:d140:93a1
Redirect IPs 13.227.254.10, 13.227.254.18, 13.227.254.32, 13.227.254.5, 2600:9000:200a:1000:9:91af:d140:93a1, 2600:9000:200a:1400:9:91af:d140:93a1, 2600:9000:200a:7a00:9:91af:d140:93a1, 2600:9000:200a:a800:9:91af:d140:93a1, 2600:9000:200a:ae00:9:91af:d140:93a1, 2600:9000:200a:da00:9:91af:d140:93a1, 2600:9000:200a:ea00:9:91af:d140:93a1, 2600:9000:200a:f600:9:91af:d140:93a1
Response IP 13.227.254.10
Found Yes
Hash 8048198ba56a947d0c8e31a11c8c44879cc270a930191368dda4a836ddc61ed5
SimHash 610c0c6089b3

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /*/tag/*
Disallow /*/news-and-press/*
Disallow /blog-and-research/page/*
Disallow /uploads/assets/docs/tdsa_eula.pdf
Disallow /blog-and-research/category/*

Other Records

Field Value
sitemap https://www.digitalshadows.com/sitemap.xml
sitemap https://www.digitalshadows.com/sitemap.rss

Warnings

  • 2 invalid lines.