mpop.heraldcorp.com
robots.txt

Robots Exclusion Standard data for mpop.heraldcorp.com

Resource Scan

Scan Details

Site Domain mpop.heraldcorp.com
Base Domain heraldcorp.com
Scan Status Ok
Last Scan2025-11-27T22:34:40+00:00
Next Scan 2025-12-27T22:34:40+00:00

Last Scan

Scanned2025-11-27T22:34:40+00:00
URL https://mpop.heraldcorp.com/robots.txt
Redirect https://www.heraldpop.com/robots.txt
Redirect Domain www.heraldpop.com
Redirect Base heraldpop.com
Domain IPs 223.130.159.95
Redirect IPs 223.130.151.140, 223.130.153.193
Response IP 223.130.151.140
Found Yes
Hash 7b8e9b7cc24278fdb9193436acb1b63edc86b9b7ca1d98b186ae2c6f3ad53cce
SimHash 605513720e95

Groups

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

bingpreview

Rule Path
Allow /

facebot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

popin_agent

Rule Path
Allow /

yeti

Rule Path
Allow /

google search console

Rule Path
Allow /

googlebot/2.1

Rule Path
Allow /

googlebot-smartphone

Rule Path
Allow /

gptbot

Rule Path
Disallow /

semrushbot
ahrefsbot
bytespidere
chatgpt

Rule Path
Disallow /

*

Rule Path
Disallow /_TP/
Disallow /_CP/
Disallow /_CT/
Disallow /search

Other Records

Field Value
sitemap https://www.heraldpop.com/sitemap/latest-articles
sitemap https://www.heraldpop.com/sitemap/sections
sitemap https://www.heraldpop.com/sitemap/articles/2024
sitemap https://www.heraldpop.com/sitemap/articles/2023
sitemap https://www.heraldpop.com/sitemap/articles/2022
sitemap https://www.heraldpop.com/sitemap/articles/2021
sitemap https://www.heraldpop.com/sitemap/articles/2020
sitemap https://www.heraldpop.com/sitemap/articles/2019
sitemap https://www.heraldpop.com/sitemap/articles/2018
sitemap https://www.heraldpop.com/sitemap/articles/2017
sitemap https://www.heraldpop.com/sitemap/articles/2016
sitemap https://www.heraldpop.com/sitemap/articles/2015