madrastelegram.com
robots.txt

Robots Exclusion Standard data for madrastelegram.com

Resource Scan

Scan Details

Site Domain madrastelegram.com
Base Domain madrastelegram.com
Scan Status Ok
Last Scan2024-11-13T21:00:14+00:00
Next Scan 2024-11-20T21:00:14+00:00

Last Scan

Scanned2024-11-13T21:00:14+00:00
URL https://madrastelegram.com/robots.txt
Domain IPs 104.21.51.107, 172.67.179.12, 2606:4700:3034::6815:336b, 2606:4700:3036::ac43:b30c
Response IP 172.67.179.12
Found Yes
Hash 2b2ab58fd8d668a03dcb5fa2f7778b64eecc0f9023bca44c6277a5f1f9ef9921
SimHash 6d65124565d3

Groups

*
mediapartners-google
googlebot
bingbot
slurp
duckduckbot

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.madrastelegram.com/post-sitemap2.xml
sitemap https://www.madrastelegram.com/post-sitemap.xml
sitemap https://www.madrastelegram.com/page-sitemap.xml
sitemap https://www.madrastelegram.com/category-sitemap.xml
sitemap https://www.madrastelegram.com/author-sitemap.xml