vidhaatha.com
robots.txt

Robots Exclusion Standard data for vidhaatha.com

Resource Scan

Scan Details

Site Domain vidhaatha.com
Base Domain vidhaatha.com
Scan Status Ok
Last Scan2024-10-29T06:47:52+00:00
Next Scan 2024-11-05T06:47:52+00:00

Last Scan

Scanned2024-10-29T06:47:52+00:00
URL https://vidhaatha.com/robots.txt
Domain IPs 13.33.30.112, 13.33.30.27, 13.33.30.52, 13.33.30.75
Response IP 13.33.30.27
Found Yes
Hash 1a6151fa7e1abe8fa2f469babd7a751719d1cf510a8095bdf6f1ce9855eaeb73
SimHash 486c5a458983

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Allow /
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /staging/*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /metsmall
Disallow */amp/*
Disallow */tags/*
Disallow */h-upload/*

googlebot

Rule Path
Allow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://vidhaatha.com/news-sitemap.xml
sitemap https://vidhaatha.com/gallery-sitemap.xml
sitemap https://vidhaatha.com/video-sitemap.xml
sitemap https://vidhaatha.com/page-sitemap.xml