edition.pk
robots.txt

Robots Exclusion Standard data for edition.pk

Resource Scan

Scan Details

Site Domain edition.pk
Base Domain edition.pk
Scan Status Ok
Last Scan2024-11-18T07:12:21+00:00
Next Scan 2024-11-25T07:12:21+00:00

Last Scan

Scanned2024-11-18T07:12:21+00:00
URL https://edition.pk/robots.txt
Redirect http://www.edition.pk/robots.txt
Redirect Domain www.edition.pk
Redirect Base edition.pk
Domain IPs 104.21.60.145, 172.67.197.198, 2606:4700:3034::6815:3c91, 2606:4700:3037::ac43:c5c6
Redirect IPs 104.21.60.145, 172.67.197.198, 2606:4700:3034::6815:3c91, 2606:4700:3037::ac43:c5c6
Response IP 172.67.197.198
Found Yes
Hash 32c02853703ad09fef74cf1226c98a28f0be6d39528df9bfcc2b77f1c07061e2
SimHash 8916dccccaf0

Groups

*

Rule Path
Disallow */_print
Disallow */authors/*/1*
Disallow */authors/*/2*
Disallow */authors/*/3*
Disallow */authors/*/4*
Disallow */authors/*/5*
Disallow */authors/*/6*
Disallow */authors/*/7*
Disallow */authors/*/8*
Disallow */authors/*/9*
Disallow /newspaper/*/20*
Disallow /archive/*

Comments

  • test tool
  • https://www.google.com/webmasters/tools/ (Crawl > Blocked URLs)