commondef.com
robots.txt

Robots Exclusion Standard data for commondef.com

Resource Scan

Scan Details

Site Domain commondef.com
Base Domain commondef.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/27/2025, 2:49:47 PM
Next Scan 6/3/2025, 2:49:47 PM

Last Successful Scan

Scanned5/19/2025, 1:08:11 PM
URL https://commondef.com/robots.txt
Redirect https://www.commondef.com/robots.txt
Redirect Domain www.commondef.com
Redirect Base commondef.com
Domain IPs 104.21.37.219, 172.67.213.156, 2606:4700:3032::ac43:d59c, 2606:4700:3034::6815:25db
Redirect IPs 104.21.37.219, 172.67.213.156, 2606:4700:3032::ac43:d59c, 2606:4700:3034::6815:25db
Response IP 172.67.213.156
Found Yes
Hash 83d67c7b1d9894b592646f7db5a1fc6e1a3d883382c91da41f0815f466486a10
SimHash 4100c802c3b2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ia_archiver

Rule Path
Disallow /