dictionaries.pk
robots.txt

Robots Exclusion Standard data for dictionaries.pk

Resource Scan

Scan Details

Site Domain dictionaries.pk
Base Domain dictionaries.pk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-11T14:55:24+00:00
Next Scan 2024-07-10T14:55:24+00:00

Last Successful Scan

Scanned2024-03-13T08:28:47+00:00
URL https://dictionaries.pk/robots.txt
Domain IPs 104.21.23.129, 172.67.211.72, 2606:4700:3030::6815:1781, 2606:4700:3031::ac43:d348
Response IP 172.67.211.72
Found Yes
Hash 4f2c26b60a8a57442feada87ae676b4ee3dd3b83ad8e2b9aba4e603ce00bfff7
SimHash 041c5cc2f749

Groups

*

Rule Path
Disallow
Allow /
Disallow /help/
Disallow /about/
Disallow /about/privacy-policy/
Disallow /about/terms/
Disallow /about/cookies/
Disallow /misc/
Disallow /misc/contact
Disallow /misc/style
Disallow /misc/quick-navigation-menu
Disallow /members/
Disallow /account/
Disallow /conversations/
Disallow /watched/forums
Disallow /watched/threads
Disallow /find-new/posts
Disallow /find-new/profile-posts
Disallow /online/
Disallow /latest-activity/
Disallow /login/
Disallow /register/
Disallow /lost-password/
Disallow /admin.php
Disallow /search/
Disallow /v1/
Disallow /extplorer/
Disallow /articles/authors/
Disallow /articles/authors/saad-sheikh.1/
Disallow /articles/authors/saad-sheikh.1/awaiting-publishing
Disallow /articles/authors/saad-sheikh.1/drafts
Disallow /whats-new/
Disallow /whats-new/posts/
Disallow /whats-new/profile-posts/
Disallow /whats-new/articles/
Disallow /whats-new/article-comments/
Disallow /whats-new/latest-activity
Disallow /whats-new/news-feed
Disallow /watched/articles
Disallow /watched/series
Disallow /watched/article-categories
Disallow /forums/help-us-improve.3/post-thread
Disallow /forums/ask-meaning-of-words.2/post-thread

Other Records

Field Value
sitemap https://dictionaries.pk/sitemap.php