awarenessdays.com
robots.txt
Robots Exclusion Standard data for awarenessdays.com
Resource Scan
Scan Details
Site Domain | awarenessdays.com |
Base Domain | awarenessdays.com |
Scan Status | Ok |
Last Scan | 2025-04-05T06:21:12+00:00 |
Next Scan | 2025-04-12T06:21:12+00:00 |
Last Scan
Scanned | 2025-04-05T06:21:12+00:00 |
URL | https://awarenessdays.com/robots.txt |
Redirect | https://www.awarenessdays.com/robots.txt |
Redirect Domain | www.awarenessdays.com |
Redirect Base | awarenessdays.com |
Domain IPs | 35.214.59.82 |
Redirect IPs | 35.214.59.82 |
Response IP | 35.214.59.82 |
Found | Yes |
Hash | cc285728e1cdc67583829792507db3dcaac00c24c9df8e82a0bf8f7a7789c12f |
SimHash | e6069cf07a22 |
Groups
*
Rule | Path |
---|---|
Disallow | *viagra* |
Disallow | *zithromax* |
Disallow | *tamoxifen* |
Disallow | *clomid* |
Disallow | *azithromycin* |
Disallow | *amoxicillin* |
Disallow | /calendar/action~posterboard/ |
Disallow | /calendar/action~agenda/ |
Disallow | /calendar/action~oneday/ |
Disallow | /calendar/action~month/ |
Disallow | /calendar/action~week/ |
Disallow | /calendar/action~stream/ |
Disallow | /calendar/action~undefined/ |
Disallow | /calendar/action~http%3A/ |
Disallow | /calendar/action~default/ |
Disallow | /calendar/action~poster/ |
Disallow | /calendar/action~*/ |
Disallow | /*controller%3Dai1ec_exporter_controller* |
Disallow | /*/action~*/ |
Disallow | /subscribe/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |