Log In Sign Up

podyssey.fm
robots.txt

Robots Exclusion Standard data for podyssey.fm

Resource Scan

Scan Details

Site Domain podyssey.fm
Base Domain podyssey.fm
Scan Status Ok
Last Scan5/19/2025, 7:37:42 PM
Next Scan 5/26/2025, 7:37:42 PM

Last Scan

Scanned5/19/2025, 7:37:42 PM
URL https://podyssey.fm/robots.txt
Domain IPs 104.21.94.86, 172.67.221.146, 2606:4700:3031::ac43:dd92, 2606:4700:3034::6815:5e56
Response IP 104.21.94.86
Found Yes
Hash f15946f6d5e947c1997bc3f81de0bbd4418cd7d171f7dd92938fd1af4be71c45
SimHash 911d4dd36f90

Groups

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

mozilla/5.0 (compatible; seekport crawler; http://seekport.com/)

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

mbcrawler/1.0

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

bingbot

Rule Path
Disallow /podcast/*/episode*
Allow /

ahrefsbot

Rule Path
Disallow /podcast/*/episode*
Allow /

ahrefssiteaudit

Rule Path
Disallow /podcast/*/episode*
Allow /

linguee

Rule Path
Disallow /podcast/*/episode*
Allow /

semrushbot

Rule Path
Disallow /podcast/*/episode*
Allow /

semrushbot-sa

Rule Path
Disallow /podcast/*/episode*
Allow /

semrushbot-ba

Rule Path
Disallow /podcast/*/episode*
Allow /

dotbot

Rule Path
Disallow /podcast/*/episode*
Allow /
Back to top

Other Records

Field Value
sitemap https://podyssey.fm/sitemap.xml
Back to top

Comments

  • robots.txt
  • Disallow everything
  • Disallow specific things
Back to top