total-apps.com
robots.txt
Robots Exclusion Standard data for total-apps.com
Resource Scan
Scan Details
| Site Domain | total-apps.com |
| Base Domain | total-apps.com |
| Scan Status | Ok |
| Last Scan | 2024-11-16T10:21:36+00:00 |
| Next Scan | 2024-12-16T10:21:36+00:00 |
Last Scan
| Scanned | 2024-11-16T10:21:36+00:00 |
| URL | https://total-apps.com/robots.txt |
| Domain IPs | 35.223.252.62 |
| Response IP | 35.223.252.62 |
| Found | Yes |
| Hash | 3466c5a19a4f0fc8acaf8275af819b2873ceea4a09f3e7a0e3dad01b0473b4c7 |
| SimHash | 5c701212c4ed |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /blog/*?img=* |
| Disallow | /archive/graphs.php |
| Disallow | /partner/ |
| Disallow | /blog/search/* |
| Disallow | /analytics/seomagic/ |
| Disallow | /my_reports/reports/* |
| Disallow | /archive/ |
| Disallow | /admin/ |
| Disallow | /users/ |
| Disallow | /clients/ |
| Disallow | /custom_report/ |
| Disallow | /limit_hits/ |
| Disallow | /payment/ |
| Disallow | /no_cookies/ |
| Disallow | /support/ |
| Disallow | /double_activation/ |
| Disallow | /projects/?* |
| Disallow | /?*%2F |
| Disallow | /activation_successful* |
| Disallow | /api.html?* |
| Disallow | /partners/ |
| Disallow | /partner/ |
| Disallow | */dvd-mode/ |
| Disallow | /unsubscribe/ |
| Disallow | /unsubscribe/* |
| Disallow | /demonstration/ |
| Disallow | /demonstration/* |
| Allow | /projects/ |
| Disallow | */custom-report/ |
| Disallow | */request-demo/ |
| Allow | */info/kdt/ |
| Disallow | */pleasereg/ |
| Disallow | */custom-report/ |
| Disallow | */custom-report |
| Allow | */sensor/* |
| Disallow | /swa/api/* |
| Disallow | /redirect?url=* |
| Disallow | /sso/ |
| Disallow | /_/report_blank/ |
| Disallow | /seo-ab-testing/* |
| Disallow | /seo-old/* |
| Disallow | /projects2/* |
| Allow | /blog/* |
| Disallow | /blog/search/* |
| Disallow | /blog/*utm_source%3D* |
| Disallow | /blog-manager/* |
| Allow | /user/* |
| Allow | /ebooks/* |
| Disallow | /ebooks/?language=* |
| Disallow | /features/index2/ |
| Disallow | /features/for-* |
| Disallow | /solutions/$ |
| Allow | /webinars/* |
| Disallow | /landing/ |
| Disallow | /lp/ |
| Allow | /lp/for-agencies/en/ |
| Allow | /lp/growth-quadrant/ |
| Allow | /seo/ |
| Allow | /content-marketing/ |
| Allow | /ppc/ |
| Allow | /competitive-research/ |
| Allow | /analytics/traffic/overview/ |
| Disallow | /listings-management/superpower-landing2/ |
| Allow | /academy/* |
| Disallow | /academy/*utm_source%3D* |
| Disallow | /academy/*/results |
| Allow | /website/* |
| Disallow | /website/search/* |
| Disallow | /*/?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.semrush.com/sitemap.xml |
| sitemap | https://pt.semrush.com/blog/sitemap/ |
| sitemap | https://es.semrush.com/blog/sitemap/ |
| sitemap | https://it.semrush.com/blog/sitemap/ |
| sitemap | https://fr.semrush.com/blog/sitemap/ |
| sitemap | https://de.semrush.com/blog/sitemap/ |
| sitemap | https://ja.semrush.com/blog/sitemap/ |
| sitemap | https://www.semrush.com/academy/sitemap.xml |
| sitemap | https://es.semrush.com/academy/sitemap.xml |
| sitemap | https://pt.semrush.com/academy/sitemap.xml |
| sitemap | https://it.semrush.com/academy/sitemap.xml |
| sitemap | https://fr.semrush.com/academy/sitemap.xml |
| sitemap | https://de.semrush.com/academy/sitemap.xml |
Warnings
- 2 invalid lines.
Comments