madebyspeak.com
robots.txt
Robots Exclusion Standard data for madebyspeak.com
Resource Scan
Scan Details
Site Domain | madebyspeak.com |
Base Domain | madebyspeak.com |
Scan Status | Ok |
Last Scan | 2024-11-04T17:25:02+00:00 |
Next Scan | 2024-11-11T17:25:02+00:00 |
Last Scan
Scanned | 2024-11-04T17:25:02+00:00 |
URL | https://madebyspeak.com/robots.txt |
Redirect | https://www.madebyspeak.com/robots.txt |
Redirect Domain | www.madebyspeak.com |
Redirect Base | madebyspeak.com |
Domain IPs | 40.119.1.254 |
Redirect IPs | 40.119.1.254 |
Response IP | 40.119.1.254 |
Found | Yes |
Hash | 4e55a8a6e693a783f5070b729e66f147b2b40878b740ec2bd5ff38472e0b9543 |
SimHash | 702d48d7e155 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
googlebot-image
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
twitterbot
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
meta-externalagent
Rule | Path |
---|---|
Disallow | /SignIn.aspx |
Disallow | /ForgotPassword.aspx |
Disallow | /register.aspx |
Disallow | /registermember.aspx |
facebookexternalhit
Rule | Path |
---|---|
Disallow | /SignIn.aspx |
Disallow | /ForgotPassword.aspx |
Disallow | /register.aspx |
Disallow | /registermember.aspx |
*
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Disallow | /Sitefiles/ |
Disallow | /sitefiles/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |