marginallyclever.com
robots.txt

Robots Exclusion Standard data for marginallyclever.com

Resource Scan

Scan Details

Site Domain marginallyclever.com
Base Domain marginallyclever.com
Scan Status Ok
Last Scan2025-02-18T17:18:09+00:00
Next Scan 2025-03-20T17:18:09+00:00

Last Scan

Scanned2025-02-18T17:18:09+00:00
URL https://marginallyclever.com/robots.txt
Redirect https://www.marginallyclever.com/robots.txt
Redirect Domain www.marginallyclever.com
Redirect Base marginallyclever.com
Domain IPs 104.21.87.113, 172.67.143.4, 2606:4700:3031::ac43:8f04, 2606:4700:3036::6815:5771
Redirect IPs 104.21.87.113, 172.67.143.4, 2606:4700:3031::ac43:8f04, 2606:4700:3036::6815:5771
Response IP 104.21.87.113
Found Yes
Hash f628d039e8f3f4887eb504c27497a7e71295745ea3601b738cbdd18593fbfbee
SimHash 2818d840c3d4

Groups

*

Rule Path
Disallow /*add-to-cart%3D*

Other Records

Field Value
crawl-delay 120