lrk.com
robots.txt
Robots Exclusion Standard data for lrk.com
Resource Scan
Scan Details
Site Domain | lrk.com |
Base Domain | lrk.com |
Scan Status | Ok |
Last Scan | 2024-11-12T04:32:18+00:00 |
Next Scan | 2024-11-19T04:32:18+00:00 |
Last Scan
Scanned | 2024-11-12T04:32:18+00:00 |
URL | https://lrk.com/robots.txt |
Redirect | https://www.lrk.com/robots.txt |
Redirect Domain | www.lrk.com |
Redirect Base | lrk.com |
Domain IPs | 104.21.90.107, 172.67.199.221, 2606:4700:3030::6815:5a6b, 2606:4700:3036::ac43:c7dd |
Redirect IPs | 104.21.90.107, 172.67.199.221, 2606:4700:3030::6815:5a6b, 2606:4700:3036::ac43:c7dd |
Response IP | 172.67.199.221 |
Found | Yes |
Hash | 4e55a8a6e693a783f5070b729e66f147b2b40878b740ec2bd5ff38472e0b9543 |
SimHash | 702d48d7e155 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
googlebot-image
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
twitterbot
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
meta-externalagent
Rule | Path |
---|---|
Disallow | /SignIn.aspx |
Disallow | /ForgotPassword.aspx |
Disallow | /register.aspx |
Disallow | /registermember.aspx |
facebookexternalhit
Rule | Path |
---|---|
Disallow | /SignIn.aspx |
Disallow | /ForgotPassword.aspx |
Disallow | /register.aspx |
Disallow | /registermember.aspx |
*
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Disallow | /Sitefiles/ |
Disallow | /sitefiles/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |