metrotvnews.com
robots.txt

Robots Exclusion Standard data for metrotvnews.com

Resource Scan

Scan Details

Site Domain metrotvnews.com
Base Domain metrotvnews.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-14T07:34:42+00:00
Next Scan 2024-11-28T07:34:42+00:00

Last Successful Scan

Scanned2024-10-30T07:33:44+00:00
URL https://metrotvnews.com/robots.txt
Domain IPs 103.93.130.234
Response IP 103.93.130.234
Found Yes
Hash 94d5b779ba17b8bc5de2ec781aae816d4a1f55f58c39b6566637deff139a9028
SimHash 69349b71ab73

Groups

*

Rule Path
Disallow /moadmin/
Allow /
Disallow /search
Disallow /*/utm?
Disallow /vmap
Disallow /hit/

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.metrotvnews.com/sitemap/sitemap_program.xml

Comments

  • Disallow: /embed/