freearabtv.tk
robots.txt
Robots Exclusion Standard data for freearabtv.tk
Resource Scan
Scan Details
Site Domain | freearabtv.tk |
Base Domain | freearabtv.tk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-09-01T21:02:34+00:00 |
Next Scan | 2024-11-30T21:02:34+00:00 |
Last Successful Scan
Scanned | 2024-02-05T20:58:31+00:00 |
URL | https://freearabtv.tk/robots.txt |
Domain IPs | 206.72.205.5 |
Response IP | 206.72.205.5 |
Found | Yes |
Hash | 0efe9acb72a20318fe3f8ec265924dc439e1d840c540031ed243e23a341f5bd9 |
SimHash | b839a4108793 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /video-related.php |
Disallow | /fpembed.php |
Disallow | /embed.php |
Disallow | /embed/ |
Disallow | /mobile/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.freearabtv.tk/sitemap-index.xml |