digitalshadows.com
robots.txt

Robots Exclusion Standard data for digitalshadows.com

Resource Scan

Scan Details

Site Domain digitalshadows.com
Base Domain digitalshadows.com
Scan Status Ok
Last Scan2024-10-24T19:03:40+00:00
Next Scan 2024-11-23T19:03:40+00:00

Last Scan

Scanned2024-10-24T19:03:40+00:00
URL https://digitalshadows.com/robots.txt
Redirect https://www.digitalshadows.com/robots.txt
Redirect Domain www.digitalshadows.com
Redirect Base digitalshadows.com
Domain IPs 13.227.254.10, 13.227.254.18, 13.227.254.32, 13.227.254.5, 2600:9000:200a:2800:9:91af:d140:93a1, 2600:9000:200a:3800:9:91af:d140:93a1, 2600:9000:200a:3c00:9:91af:d140:93a1, 2600:9000:200a:6c00:9:91af:d140:93a1, 2600:9000:200a:7e00:9:91af:d140:93a1, 2600:9000:200a:ce00:9:91af:d140:93a1, 2600:9000:200a:de00:9:91af:d140:93a1, 2600:9000:200a:e000:9:91af:d140:93a1
Redirect IPs 13.227.254.10, 13.227.254.18, 13.227.254.32, 13.227.254.5, 2600:9000:200a:1e00:9:91af:d140:93a1, 2600:9000:200a:2c00:9:91af:d140:93a1, 2600:9000:200a:3400:9:91af:d140:93a1, 2600:9000:200a:6000:9:91af:d140:93a1, 2600:9000:200a:6800:9:91af:d140:93a1, 2600:9000:200a:7200:9:91af:d140:93a1, 2600:9000:200a:c600:9:91af:d140:93a1, 2600:9000:200a:e200:9:91af:d140:93a1
Response IP 13.227.254.32
Found Yes
Hash 8048198ba56a947d0c8e31a11c8c44879cc270a930191368dda4a836ddc61ed5
SimHash 610c0c6089b3

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /*/tag/*
Disallow /*/news-and-press/*
Disallow /blog-and-research/page/*
Disallow /uploads/assets/docs/tdsa_eula.pdf
Disallow /blog-and-research/category/*

Other Records

Field Value
sitemap https://www.digitalshadows.com/sitemap.xml
sitemap https://www.digitalshadows.com/sitemap.rss

Warnings

  • 2 invalid lines.