tiktok.en.divxland.org
robots.txt
Robots Exclusion Standard data for tiktok.en.divxland.org
Resource Scan
Scan Details
| Site Domain | tiktok.en.divxland.org |
| Base Domain | divxland.org |
| Scan Status | Ok |
| Last Scan | 2025-10-15T00:51:22+00:00 |
| Next Scan | 2025-11-14T00:51:22+00:00 |
Last Scan
| Scanned | 2025-10-15T00:51:22+00:00 |
| URL | https://tiktok.en.divxland.org/robots.txt |
| Domain IPs | 104.26.10.119, 104.26.11.119, 172.67.69.160, 2606:4700:20::681a:a77, 2606:4700:20::681a:b77, 2606:4700:20::ac43:45a0 |
| Response IP | 104.26.10.119 |
| Found | Yes |
| Hash | 3a1c328e90fb9faa44297c13ae177e4a8484108d13ab726efe2f3952f14f190e |
| SimHash | 472ed882d2b0 |
Groups
yandex
No rules defined. All paths allowed.
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 10 | 10 second timeout |
bytespider
No rules defined. All paths allowed.
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 15 | 15 second timeout |
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin/ | block access to admin section |
| Allow | /wp-admin/admin-ajax.php | - |
| Disallow | /test | - |
| Disallow | /wp-content/themes/apps/download.php | - |
| Disallow | /files/apk/ | - |
| Allow | / | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.divxland.org/wp-sitemap.xml |
| sitemap | https://en.divxland.org/wp-sitemap.xml |
| sitemap | https://es.divxland.org/wp-sitemap.xml |
| sitemap | https://de.divxland.org/wp-sitemap.xml |
| sitemap | https://fr.divxland.org/wp-sitemap.xml |
| sitemap | https://br.divxland.org/wp-sitemap.xml |
| sitemap | https://it.divxland.org/wp-sitemap.xml |
| sitemap | https://tr.divxland.org/wp-sitemap.xml |
| sitemap | https://ru.divxland.org/wp-sitemap.xml |
| sitemap | https://id.divxland.org/wp-sitemap.xml |
Warnings
- 2 invalid lines.