shorturls.us
robots.txt

Robots Exclusion Standard data for shorturls.us

Resource Scan

Scan Details

Site Domain shorturls.us
Base Domain shorturls.us
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-14T14:21:33+00:00
Next Scan 2025-11-21T14:21:33+00:00

Last Successful Scan

Scanned2025-11-06T10:04:25+00:00
URL https://shorturls.us/robots.txt
Redirect https://www.shorturls.us/robots.txt
Redirect Domain www.shorturls.us
Redirect Base shorturls.us
Domain IPs 2a02:4780:16:7977:e202:abd7:c50c:cb59, 2a02:4780:38:d20c:6b2a:fae6:6229:36cf, 77.37.66.144, 93.127.196.151
Redirect IPs 2a02:4780:38:f7d5:6fb6:caf1:3220:b6b7, 2a02:4780:39:636f:d7b6:f1b5:4c10:2525, 91.108.100.159, 93.127.201.223
Response IP 77.37.48.29
Found Yes
Hash 8316c7673b47526fa13e250a88a9b2170292a370fb7fd82ff01a86f74ce2ed13
SimHash 69154044cd93

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.shorturls.us/sitemap.xml