gestionespec.com
robots.txt
Robots Exclusion Standard data for gestionespec.com
Resource Scan
Scan Details
Site Domain | gestionespec.com |
Base Domain | gestionespec.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-08-11T22:34:00+00:00 |
Next Scan | 2024-10-10T22:34:00+00:00 |
Last Successful Scan
Scanned | 2024-05-21T22:32:55+00:00 |
URL | https://gestionespec.com/robots.txt |
Domain IPs | 104.21.5.2, 172.67.132.174, 2606:4700:3033::ac43:84ae, 2606:4700:3036::6815:502 |
Response IP | 172.67.132.174 |
Found | Yes |
Hash | e10e22b114330f7dd2c16a71640c8fa8aad0d866d04f639bacd23b6e6e98f515 |
SimHash | 7a47747342a7 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
vegi bot (we follow your robots.txt settings before crawling, you can slow down the bot by change the crawl-delay parameter in the settings.if you have an enquiry, please email to: abuse-report@terrykyleseoagency.com)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (windows; u; msie 9.0; windows nt 9.0; en-us) appengine-google; (+http://code.google.com/appengine; appid: s~virustotalcloud)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; nimbostratus-bot/v1.3.2; http://cloudsystemnetworks.com)
Rule | Path |
---|---|
Disallow | / |
hubspot connect 2.0 (http://dev.hubspot.com/) - bizopscompanies-tq2-bizcodomainvalidationaudit
Rule | Path |
---|---|
Disallow | / |
hubspot connect 2.0 (http://dev.hubspot.com/) - bizopscompanies-tq2-bizcodomainvalidationaudit
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; yahoo! slurp china; http://misc.yahoo.com.cn/help.html)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0+(compatible;+becomebot/3.0;++http://www.become.com/site_owners.html)
Rule | Path |
---|---|
Disallow | / |
Warnings
- 28 invalid lines.
Comments