allyouneedtoknowabout.us
robots.txt

Robots Exclusion Standard data for allyouneedtoknowabout.us

Resource Scan

Scan Details

Site Domain allyouneedtoknowabout.us
Base Domain allyouneedtoknowabout.us
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-02-18T02:24:17+00:00
Next Scan 2025-05-19T02:24:17+00:00

Last Successful Scan

Scanned2023-10-04T19:36:03+00:00
URL https://allyouneedtoknowabout.us/robots.txt
Domain IPs 104.21.1.165, 172.67.129.162, 2606:4700:3030::ac43:81a2, 2606:4700:3031::6815:1a5
Response IP 172.67.129.162
Found Yes
Hash c5eec01c6985ac294c32f68b55f28fe8dda3ce6bee96de5a4fdaa0f3de010e17
SimHash c01cd7736d93

Groups

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://allyouneedtoknowabout.us/sitemap.xml