swee.ps
robots.txt

Robots Exclusion Standard data for swee.ps

Resource Scan

Scan Details

Site Domain swee.ps
Base Domain swee.ps
Scan Status Ok
Last Scan2025-10-19T10:01:13+00:00
Next Scan 2025-11-18T10:01:13+00:00

Last Scan

Scanned2025-10-19T10:01:13+00:00
URL https://swee.ps/robots.txt
Redirect https://www.swee.ps/robots.txt
Redirect Domain www.swee.ps
Redirect Base swee.ps
Domain IPs 104.21.45.60, 172.67.210.107, 2606:4700:3031::ac43:d26b, 2606:4700:3034::6815:2d3c
Redirect IPs 18.118.246.218, 3.133.71.28, 3.143.69.94
Response IP 3.133.71.28
Found Yes
Hash da671c97b492f50ff9bb9a7f998e8bf0b1355e3968d1fe03beabef7e8d1691b3
SimHash 4824dc00c3b0

Groups

*

Rule Path
Disallow /custom/

twitterbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10