informars.com
robots.txt

Robots Exclusion Standard data for informars.com

Resource Scan

Scan Details

Site Domain informars.com
Base Domain informars.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-10-28T18:07:53+00:00
Next Scan 2025-11-04T18:07:53+00:00

Last Successful Scan

Scanned2025-09-25T17:25:39+00:00
URL https://www.informars.com/robots.txt
Domain IPs 18.144.135.196, 54.215.182.223
Response IP 54.215.182.223
Found Yes
Hash 559787a5d90a5918a583e0b98090d709ec621aef85b96eab4b32b809d1ec9b80
SimHash 59bccb7283e6

Groups

yahoo! slurp/3.0

Rule Path
Disallow /

yahoo! slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp

Rule Path
Disallow /

lexxebot/1.0+(lexxebot@lexxe.com)

Rule Path
Disallow /

lexxe

Rule Path
Disallow /

lexxebot/1.0+(lexxebot@lexxe.com)

Rule Path
Disallow /

lexxebot/1.0 (lexxebot@lexxe.com)

Rule Path
Disallow /

purebot/1.1

Rule Path
Disallow /

purebot/1.1; +http://www.puritysearch.net/)

Rule Path
Disallow /

hubspot crawler 1.0

Rule Path
Disallow /

hubspot crawler 1.0 http://www.hubspot.com/

Rule Path
Disallow /

*

Rule Path
Disallow /linkserver/
Disallow /linkserverapp/
Disallow /main/Forms/Order.aspx
Disallow /main/Forms/Question.aspx
Disallow /main/Forms/InfoRequest.aspx
Disallow /main/ErrorPage.aspx