getkolkatanews.wpcomstaging.com
robots.txt

Robots Exclusion Standard data for getkolkatanews.wpcomstaging.com

Resource Scan

Scan Details

Site Domain getkolkatanews.wpcomstaging.com
Base Domain wpcomstaging.com
Scan Status Ok
Last Scan2025-07-14T19:46:39+00:00
Next Scan 2025-08-13T19:46:39+00:00

Last Scan

Scanned2025-07-14T19:46:39+00:00
URL https://getkolkatanews.wpcomstaging.com/robots.txt
Redirect https://getkolkatanews.com/robots.txt
Redirect Domain getkolkatanews.com
Redirect Base getkolkatanews.com
Domain IPs 192.0.78.20
Redirect IPs 192.0.78.169, 192.0.78.193
Response IP 192.0.78.193
Found Yes
Hash 6532b5197713f2071574a3ea226e27f13fee6a5d0cf87f1ef03e3519b0d9575d
SimHash 593158a1ca9b

Groups

*

Rule Path
Allow /
Allow /wp-admin/admin-ajax.php

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

twitterbot

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /scripts/
Disallow /tmp/

Other Records

Field Value
sitemap https://getkolkatanews.com/sitemap.xml
sitemap https://getkolkatanews.com/news-sitemap.xml
sitemap https://getkolkatanews.com/sitemap.xml
sitemap https://getkolkatanews.com/news-sitemap.xml
sitemap https://getkolkatanews.com/post-sitemap.xml
sitemap https://getkolkatanews.com/page-sitemap.xml
sitemap https://getkolkatanews.com/web-story-sitemap.xml
sitemap https://getkolkatanews.com/category-sitemap.xml
sitemap https://getkolkatanews.com/sitemap_index.xml
sitemap https://getkolkatanews.com/sitemap_index.xml?m=1
sitemap https://getkolkatanews.com/sitemap_index.xml?amp=1
sitemap https://getkolkatanews.com/sitemap-1.xml
sitemap https://getkolkatanews.com/image-sitemap-1.xml
sitemap https://getkolkatanews.com/video-sitemap-1.xml
sitemap https://www.getkolkatanews.com/feeds/posts/default?alt=rss
sitemap https://www.getkolkatanews.com/feeds/posts/default