medianama.com
robots.txt

Robots Exclusion Standard data for medianama.com

Resource Scan

Scan Details

Site Domain medianama.com
Base Domain medianama.com
Scan Status Ok
Last Scan2025-11-14T17:13:40+00:00
Next Scan 2025-12-14T17:13:40+00:00

Last Scan

Scanned2025-11-14T17:13:40+00:00
URL https://medianama.com/robots.txt
Domain IPs 104.21.77.141, 172.67.208.234, 2606:4700:3032::ac43:d0ea, 2606:4700:3036::6815:4d8d
Response IP 104.21.77.141
Found Yes
Hash 1475ffe69d5931bb63f8c77895461a5186033a08b1a88ccabfa70e95ca1b1489
SimHash 196c5821e111

Groups

*

Rule Path
Allow /
Disallow */page/*
Disallow */tag/*
Disallow */feed/*
Disallow *?mc_cid=*
Disallow *?utm_*
Disallow *?ak_*
Disallow *//*
Disallow *?ref=*
Disallow *?p=*
Disallow /*blackhole
Disallow /?blackhole

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /