urlslab.com
robots.txt
Robots Exclusion Standard data for urlslab.com
Resource Scan
Scan Details
| Site Domain | urlslab.com |
| Base Domain | urlslab.com |
| Scan Status | Ok |
| Last Scan | 2024-10-29T16:04:50+00:00 |
| Next Scan | 2024-11-28T16:04:50+00:00 |
Last Scan
| Scanned | 2024-10-29T16:04:50+00:00 |
| URL | https://urlslab.com/robots.txt |
| Redirect | https://www.urlslab.com/robots.txt |
| Redirect Domain | www.urlslab.com |
| Redirect Base | urlslab.com |
| Domain IPs | 85.90.246.86, 85.90.247.10 |
| Redirect IPs | 18.155.68.128, 18.155.68.32, 18.155.68.36, 18.155.68.65, 2600:9000:23d2:1800:1:b3ce:7bc0:93a1, 2600:9000:23d2:3600:1:b3ce:7bc0:93a1, 2600:9000:23d2:5800:1:b3ce:7bc0:93a1, 2600:9000:23d2:9800:1:b3ce:7bc0:93a1, 2600:9000:23d2:ac00:1:b3ce:7bc0:93a1, 2600:9000:23d2:cc00:1:b3ce:7bc0:93a1, 2600:9000:23d2:e800:1:b3ce:7bc0:93a1, 2600:9000:23d2:f000:1:b3ce:7bc0:93a1 |
| Response IP | 18.155.68.65 |
| Found | Yes |
| Hash | ab7cf2cb2e7c8180ae79eabbf7fb5d2b07171a3953f7b28471a066c5901a9a5e |
| SimHash | 71001063ee11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?_gl* |
| Disallow | /*?_ga* |
| Disallow | /*?ms_awards* |
| Disallow | /*?post_type=* |
| Disallow | /*?a_aid* |
| Disallow | /*?utm_* |
| Disallow | /*?gclid* |
| Disallow | /*?page_id=* |
| Disallow | /*?s=* |
| Disallow | /*%26ref%3D* |
| Disallow | /*?attachment_id=* |
| Disallow | /*?no_cache=1* |
| Disallow | /*?ms_reviews_categories=* |
| Disallow | /*?tx_news* |
| Disallow | /wp/wp-admin/ |
| Disallow | /wp/readme.html |
| Disallow | /wp/license.txt |
| Allow | /wp/wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.urlslab.com/sitemap_index.xml |