globalforestgeneration.org
robots.txt
Robots Exclusion Standard data for globalforestgeneration.org
Resource Scan
Scan Details
Site Domain | globalforestgeneration.org |
Base Domain | globalforestgeneration.org |
Scan Status | Ok |
Last Scan | 2024-09-15T11:49:23+00:00 |
Next Scan | 2024-09-22T11:49:23+00:00 |
Last Scan
Scanned | 2024-09-15T11:49:23+00:00 |
URL | https://globalforestgeneration.org/robots.txt |
Redirect | https://www.globalforestgeneration.org/robots.txt |
Redirect Domain | www.globalforestgeneration.org |
Redirect Base | globalforestgeneration.org |
Domain IPs | 104.21.41.42, 172.67.159.250, 2606:4700:3033::ac43:9ffa, 2606:4700:3034::6815:292a |
Redirect IPs | 104.21.41.42, 172.67.159.250, 2606:4700:3033::ac43:9ffa, 2606:4700:3034::6815:292a |
Response IP | 104.21.41.42 |
Found | Yes |
Hash | 729f5be583c0ef7212a603a7cd2f1814a44fab3951158adebf9d9622bc3ac8e2 |
SimHash | 603448d7e155 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
googlebot-image
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
twitterbot
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
*
Rule | Path |
---|---|
Disallow | *.config$ |
Disallow | *.asmx$ |
Disallow | *.ascx$ |
Disallow | *.ashx$ |
Disallow | *.vb$ |
Disallow | *.cs$ |
Disallow | *.resx$ |
Disallow | *.master$ |
Disallow | *.dll$ |
Disallow | /profile/login.aspx |
Disallow | /Profile/login.aspx |
Disallow | /store_categoryproducts.aspx |
Disallow | /Store_CategoryProducts.aspx |
Disallow | /store_searchresults.aspx |
Disallow | /Store_SearchResults.aspx |
Disallow | /searchresults.aspx |
Disallow | /SearchResults.aspx |
Disallow | /app_services/ |
Disallow | /App_Services/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /bin/ |
Disallow | /Bin/ |
Disallow | /Sitefiles/ |
Disallow | /sitefiles/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |