mptak.in
robots.txt

Robots Exclusion Standard data for mptak.in

Resource Scan

Scan Details

Site Domain mptak.in
Base Domain mptak.in
Scan Status Ok
Last Scan2025-02-28T08:51:16+00:00
Next Scan 2025-03-07T08:51:16+00:00

Last Scan

Scanned2025-02-28T08:51:16+00:00
URL https://www.mptak.in/robots.txt
Domain IPs 125.56.219.59, 2600:1413:b000:13::b857:c192, 2600:1413:b000:13::b857:c196, 72.247.127.232
Response IP 23.209.46.95
Found Yes
Hash a0bae44ea96a3329dc1bc932ecb9c129c0c9e7f54aae6925f11643a735200883
SimHash 913dc9c5d000

Groups

*

Rule Path
Allow /

grapeshot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /vs/header_newstak
Disallow /vs/footer_newstak
Disallow /vs/leftsidebar_newstak
Disallow /visualstories/preview/*
Disallow */feed
Disallow */feed?*
Disallow /%5B%5Ea-zA-Z0-9%5D
Disallow /tag/*
Disallow /article/ampstories/*
Disallow /article/uncategorized/*
Disallow /wp-content/*
Disallow /wp-content/uploads/*
Disallow /wp-admin/*
Disallow /wp-includes/*
Disallow /article/*
Disallow /cms-admin/
Disallow /wp-content/plugins/*
Disallow /sortd-service/*
Disallow /node/*
Disallow /?p=*
Disallow /search/*
Disallow /*?p*
Disallow /ajax/*

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.newstak.in/rssfeeds/sitemap.xml
sitemap https://www.newstak.in/rssfeeds/news-sitemap.xml
sitemap https://www.newstak.in/rssfeeds/date-wise-stories-sitemap.xml
sitemap https://www.newstak.in/rssfeeds/date-wise-photos-sitemap.xml
sitemap https://www.newstak.in/rssfeeds/date-wise-videos-sitemap.xml
sitemap https://www.newstak.in/rssfeeds/haryana-assembly-election-constituency-result.xml
sitemap https://www.newstak.in/rssfeeds/maharashtra-assembly-election-constituency-result.xml
sitemap https://www.newstak.in/rssfeeds/jharkhand-assembly-election-constituency-result.xml
sitemap https://www.newstak.in/rssfeeds/delhi-assembly-election/constituency-result.xml
sitemap https://www.newstak.in/rssfeeds/delhi-assembly-election/candidates-sitemap-list.xml
sitemap https://www.newstak.in/visualstories/sitemap.xml
sitemap https://www.newstak.in/visualstories/webstories-sitemap.xml
sitemap https://www.newstak.in/visualstories/webstories-sitemap-v1.xml