csauthors.net
robots.txt

Robots Exclusion Standard data for csauthors.net

Resource Scan

Scan Details

Site Domain csauthors.net
Base Domain csauthors.net
Scan Status Ok
Last Scan4/7/2025, 3:04:32 PM
Next Scan 4/14/2025, 3:04:32 PM

Last Scan

Scanned4/7/2025, 3:04:32 PM
URL https://csauthors.net/robots.txt
Redirect https://www.csauthors.net/robots.txt
Redirect Domain www.csauthors.net
Redirect Base csauthors.net
Domain IPs 104.21.2.172, 172.67.129.124, 2606:4700:3030::ac43:817c, 2606:4700:3034::6815:2ac
Redirect IPs 104.21.2.172, 172.67.129.124, 2606:4700:3030::ac43:817c, 2606:4700:3034::6815:2ac
Response IP 104.21.2.172
Found Yes
Hash e115265168fda2712fd5968713d2af2ed1bcb08cbd337612002339aa87488a14
SimHash d81cc5428f11

Groups

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow */embed/

Other Records

Field Value
sitemap https://www.csauthors.net/sitemap/sitemap.xml