celebritynews.pk
robots.txt
Robots Exclusion Standard data for celebritynews.pk
Resource Scan
Scan Details
| Site Domain | celebritynews.pk |
| Base Domain | celebritynews.pk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-10-07T18:06:34+00:00 |
| Next Scan | 2024-12-06T18:06:34+00:00 |
Last Successful Scan
| Scanned | 2024-08-09T18:05:13+00:00 |
| URL | https://celebritynews.pk/robots.txt |
| Domain IPs | 104.21.32.136, 172.67.152.76, 2606:4700:3033::6815:2088, 2606:4700:3035::ac43:984c |
| Response IP | 104.21.32.136 |
| Found | Yes |
| Hash | de39307e8e36f26b749a917af6033b0ab2bbb1911cd0f798447703f2e8c46786 |
| SimHash | 4821ac49d9b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | */?s=* |
| Disallow | */s%3D* |
| Disallow | */page/* |
| Disallow | /category/celebrity-news/ |
| Disallow | /celebrity-news/ |
| Disallow | /feed/ |
| Disallow | /search/*/feed/rss2/ |
| Disallow | */1000* |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://celebritynews.pk/sitemap_index.xml |