cryptomedia.com
robots.txt

Robots Exclusion Standard data for cryptomedia.com

Resource Scan

Scan Details

Site Domain cryptomedia.com
Base Domain cryptomedia.com
Scan Status Ok
Last Scan2025-10-10T06:48:51+00:00
Next Scan 2025-11-09T06:48:51+00:00

Last Scan

Scanned2025-10-10T06:48:51+00:00
URL https://cryptomedia.com/robots.txt
Redirect https://www.cryptomedia.com/robots.txt
Redirect Domain www.cryptomedia.com
Redirect Base cryptomedia.com
Domain IPs 104.21.24.91, 172.67.218.27, 2606:4700:3032::6815:185b, 2606:4700:3034::ac43:da1b
Redirect IPs 104.21.24.91, 172.67.218.27, 2606:4700:3032::6815:185b, 2606:4700:3034::ac43:da1b
Response IP 172.67.218.27
Found Yes
Hash bc0f46fb24dbac28f73754b1d834b8f3234d26c5ea8afd77ae00430f8d79ba01
SimHash 48645c8257d2

Groups

*

Rule Path
Disallow /comments/feed
Disallow /feed/$
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /trackback/
Disallow /wp-admin/
Disallow /*.inc$
Disallow */trackback/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.cryptomedia.com/sitemap.xml

Warnings

  • `noindex` is not a known field.