dailypakistan.com.pk
robots.txt
Robots Exclusion Standard data for dailypakistan.com.pk
Resource Scan
Scan Details
Site Domain | dailypakistan.com.pk |
Base Domain | dailypakistan.com.pk |
Scan Status | Ok |
Last Scan | 2024-05-17T21:34:56+00:00 |
Next Scan | 2024-05-24T21:34:56+00:00 |
Last Scan
Scanned | 2024-05-17T21:34:56+00:00 |
URL | https://dailypakistan.com.pk/robots.txt |
Domain IPs | 65.109.77.254 |
Response IP | 65.109.77.254 |
Found | Yes |
Hash | 5a4fbd7a1a7dfb57757571ec579a29e3a9a3171358c06d1b1db18e3afd9b345d |
SimHash | f909d8b59c90 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin/ |
Disallow | /test-ad-code/ |
Disallow | /xajax/ |
Disallow | /ajax_post_update |
Disallow | /ajax_post_pagination |
Disallow | /ajax_author_type_pagination |
Disallow | /ajax_block_pagination |
Disallow | /ajax_poll_pagination |
Disallow | /poll_entry_submission |
Disallow | /parse_oembed_links |
Disallow | /oembed |
Disallow | /oembed_videos |
Other Records
Field | Value |
---|---|
sitemap | https://dailypakistan.com.pk/sitemap_news.xml |
sitemap | https://dailypakistan.com.pk/sitemap_news_google.xml |
sitemap | https://dailypakistan.com.pk/sitemap.xml |