nation.com.pk
robots.txt
Robots Exclusion Standard data for nation.com.pk
Resource Scan
Scan Details
Site Domain | nation.com.pk |
Base Domain | nation.com.pk |
Scan Status | Ok |
Last Scan | 2024-09-17T15:42:30+00:00 |
Next Scan | 2024-09-24T15:42:30+00:00 |
Last Scan
Scanned | 2024-09-17T15:42:30+00:00 |
URL | https://nation.com.pk/robots.txt |
Redirect | https://www.nation.com.pk/robots.txt |
Redirect Domain | www.nation.com.pk |
Redirect Base | nation.com.pk |
Domain IPs | 65.109.88.147 |
Redirect IPs | 65.109.88.147 |
Response IP | 65.109.88.147 |
Found | Yes |
Hash | 1785c06515db3cff9e015893f2b935a6acf36277b324922a82887c222266f426 |
SimHash | c905d8b28db0 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin/ |
Disallow | /test-ad-code/ |
Disallow | /xajax/ |
Disallow | /ajax_post_update |
Disallow | /ajax_post_pagination |
Disallow | /ajax_author_type_pagination |
Disallow | /ajax_block_pagination |
Disallow | /ajax_poll_pagination |
Disallow | /poll_entry_submission |
Disallow | /parse_oembed_links |
Disallow | /oembed |
Disallow | /oembed_videos |
Disallow | /tag |
Other Records
Field | Value |
---|---|
sitemap | https://www.nation.com.pk/sitemap_news.xml |
sitemap | https://www.nation.com.pk/sitemap_news_google.xml |