techpost.pk
robots.txt

Robots Exclusion Standard data for techpost.pk

Resource Scan

Scan Details

Site Domain techpost.pk
Base Domain techpost.pk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-03T22:40:10+00:00
Next Scan 2025-10-01T22:40:10+00:00

Last Successful Scan

Scanned2021-11-22T08:16:02+00:00
URL http://techpost.pk/robots.txt
Redirect http://www.techpost.pk/robots.txt
Redirect Domain www.techpost.pk
Redirect Base techpost.pk
Found Yes
Hash 8ba930b863d633d081dd75d1d8cd0ba2b6bae6a59be50ba706e3d359dff2460e
SimHash 496458480993

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
sitemap http://www.techpost.pk/sitemap.xml
sitemap http://www.techpost.pk/sitemap.rss
sitemap http://www.techpost.pk/sitemap.xml