ara.ad
robots.txt

Robots Exclusion Standard data for ara.ad

Resource Scan

Scan Details

Site Domain ara.ad
Base Domain ara.ad
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-21T00:48:08+00:00
Next Scan 2024-07-05T00:48:08+00:00

Last Successful Scan

Scanned2024-06-05T23:37:57+00:00
URL https://ara.ad/robots.txt
Redirect https://www.ara.ad/robots.txt
Redirect Domain www.ara.ad
Redirect Base ara.ad
Domain IPs 176.34.179.218
Redirect IPs 154.47.23.177, 212.102.42.89, 2a02:6ea0:d342::4, 2a02:6ea0:d638::4
Response IP 212.102.42.89
Found Yes
Hash 687419d6553ed9f76e6c30a4849b51849217058a835969afca613963ccc94975
SimHash 780d5108e063

Groups

*

Rule Path
Disallow /api/
Disallow /api/comment/user/featureds
Disallow /api/comment/user/subscribers
Disallow /api/comment/user/muted
Disallow /api/comment/user/voted
Disallow /bbtcaptcha/
Disallow /bbtcomment/create/
Disallow /bbtcomment/vote/
Disallow /bbtcomment/report/
Disallow /bbtcomment/entityComments/
Disallow /bbtcontent/poll/vote/
Disallow /bbtcontent/poll/getresults/
Disallow /webapi/