scdecorum.com
robots.txt

Robots Exclusion Standard data for scdecorum.com

Resource Scan

Scan Details

Site Domain scdecorum.com
Base Domain scdecorum.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-16T03:13:04+00:00
Next Scan 2024-12-15T03:13:04+00:00

Last Successful Scan

Scanned2023-05-25T04:30:15+00:00
URL https://scdecorum.com/robots.txt
Redirect https://www.scdecorum.com/robots.txt
Redirect Domain www.scdecorum.com
Redirect Base scdecorum.com
Domain IPs 104.21.31.102, 172.67.176.52, 2606:4700:3030::6815:1f66, 2606:4700:3035::ac43:b034
Redirect IPs 104.21.31.102, 172.67.176.52, 2606:4700:3030::6815:1f66, 2606:4700:3035::ac43:b034
Response IP 172.67.176.52
Found Yes
Hash fcc069044d401513a72abfc1887a9e1ca5eb349d1e15e23e3596903351c78869
SimHash c607ce3298a1

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-json/
Disallow /cdn-cgi/
Disallow /cdn-cgi/bm/cv/
Disallow /cdn-cgi/challenge-platform/
Disallow /?s=
Disallow /*blackhole/
Disallow /?blackhole%2F

magpie-crawler

Rule Path
Disallow /

nuclei

Rule Path
Disallow /

wikido

Rule Path
Disallow /

riddler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

node/simplecrawler

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.scdecorum.com/sitemap.xml
sitemap https://www.scdecorum.com/sitemap.rss