pod.events
robots.txt

Robots Exclusion Standard data for pod.events

Resource Scan

Scan Details

Site Domain pod.events
Base Domain pod.events
Scan Status Ok
Last Scan2024-11-02T06:24:05+00:00
Next Scan 2024-11-16T06:24:05+00:00

Last Scan

Scanned2024-11-02T06:24:05+00:00
URL https://pod.events/robots.txt
Redirect https://podnews.net/robots.txt
Redirect Domain podnews.net
Redirect Base podnews.net
Domain IPs 44.230.85.241, 52.33.207.7
Redirect IPs 108.156.133.111, 108.156.133.39, 108.156.133.69, 108.156.133.72, 2600:9000:2755:2000:1e:d028:1500:93a1, 2600:9000:2755:4600:1e:d028:1500:93a1, 2600:9000:2755:5a00:1e:d028:1500:93a1, 2600:9000:2755:5c00:1e:d028:1500:93a1, 2600:9000:2755:9e00:1e:d028:1500:93a1, 2600:9000:2755:b000:1e:d028:1500:93a1, 2600:9000:2755:d800:1e:d028:1500:93a1, 2600:9000:2755:ee00:1e:d028:1500:93a1
Response IP 108.156.133.72
Found Yes
Hash eca028344a138242d527e9c3dfc0b7089dc5eba15ab36a66a0748b6eb8292ecb
SimHash cc44cb736557

Groups

*

Rule Path
Disallow */listen/episode/
Disallow /imgbuild/*
Disallow /authorize_interact*
Disallow /api/fetchrss/*
Allow /

Other Records

Field Value
sitemap https://podnews.net/sitemap.xml
sitemap https://podnews.net/sitemap-podcasts.xml
sitemap https://podnews.net/sitemap-directory.xml
sitemap https://podnews.net/sitemap-events.xml

Comments

  • individual episode links
  • cache building
  • Stop with your random JavaScript crawling, Googlebot
  • rss proxies