comedera.com
robots.txt
Robots Exclusion Standard data for comedera.com
Resource Scan
Scan Details
Site Domain | comedera.com |
Base Domain | comedera.com |
Scan Status | Ok |
Last Scan | 2024-11-09T10:32:55+00:00 |
Next Scan | 2024-11-16T10:32:55+00:00 |
Last Scan
Scanned | 2024-11-09T10:32:55+00:00 |
URL | https://comedera.com/robots.txt |
Domain IPs | 104.26.12.115, 104.26.13.115, 172.67.70.108, 2606:4700:20::681a:c73, 2606:4700:20::681a:d73, 2606:4700:20::ac43:466c |
Response IP | 104.26.13.115 |
Found | Yes |
Hash | 8f73949209ef7eda83ed797175f622a999ad8567bcf25c77fc36ba3671c5e621 |
SimHash | 4965f9c44d91 |
Groups
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /search |
*
Rule | Path |
---|---|
Allow | /feed/$ |
Disallow | /feed/ |
Disallow | /comments/feed/ |
Disallow | /*/feed/$ |
Disallow | /*/feed/rss/$ |
Disallow | /*/feed/newsstand/$ |
Disallow | /*/*/feed/$ |
Disallow | /*/*/feed/rss/$ |
Disallow | /*/*/feed/newsstand/$ |
Disallow | /*/*/*/feed/$ |
Disallow | /*/*/*/feed/rss/$ |
Disallow | /*/*/*/feed/newsstand/$ |
*
Rule | Path |
---|---|
Disallow | /amp-helper-frame.html |
Disallow | /amp-permission-dialog.html |
*
Rule | Path |
---|---|
Disallow | /*customize_changeset_uuid* |
Disallow | /*customize_autosaved* |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://comedera.com/news-sitemap.xml |
sitemap | https://comedera.com/sitemap_index.xml |
Comments