urlshort.dev
robots.txt

Robots Exclusion Standard data for urlshort.dev

Resource Scan

Scan Details

Site Domain urlshort.dev
Base Domain urlshort.dev
Scan Status Ok
Last Scan2024-09-23T01:43:32+00:00
Next Scan 2024-09-30T01:43:32+00:00

Last Scan

Scanned2024-09-23T01:43:32+00:00
URL https://urlshort.dev/robots.txt
Redirect https://www.urlshort.dev/robots.txt
Redirect Domain www.urlshort.dev
Redirect Base urlshort.dev
Domain IPs 198.49.23.145
Redirect IPs 108.157.254.107, 108.157.254.118, 108.157.254.17, 108.157.254.34, 2600:9000:2753:6200:1:c9be:9100:93a1, 2600:9000:2753:6a00:1:c9be:9100:93a1, 2600:9000:2753:8000:1:c9be:9100:93a1, 2600:9000:2753:8a00:1:c9be:9100:93a1, 2600:9000:2753:9800:1:c9be:9100:93a1, 2600:9000:2753:9c00:1:c9be:9100:93a1, 2600:9000:2753:a400:1:c9be:9100:93a1, 2600:9000:2753:c000:1:c9be:9100:93a1
Response IP 108.157.254.107
Found Yes
Hash 851a6cc3d8d6631a3c16f9f0276cde264d80c04a2d3097eb309039f424894a7d
SimHash 49049d524731

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.urlshort.dev/sitemap.xml