podtema.com
robots.txt
Robots Exclusion Standard data for podtema.com
Resource Scan
Scan Details
Site Domain | podtema.com |
Base Domain | podtema.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-08-20T13:12:44+00:00 |
Next Scan | 2025-10-19T13:12:44+00:00 |
Last Successful Scan
Scanned | 2025-05-27T18:49:37+00:00 |
URL | https://podtema.com/robots.txt |
Redirect | https://rosnovsky.us/robots.txt |
Redirect Domain | rosnovsky.us |
Redirect Base | rosnovsky.us |
Domain IPs | 66.33.60.130, 66.33.60.193 |
Redirect IPs | 2406:da18:b3d:e201::65, 2406:da18:b3d:e202::65, 52.220.155.145, 52.74.232.59 |
Response IP | 52.220.155.145 |
Found | Yes |
Hash | 9fce011c962d1032d446975654d5ca630d897c547c344c3c635b3990b6d2fc74 |
SimHash | 74164901c5c4 |
Groups
ai2bot
ai2bot-dolma
amazonbot
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
googleother
googleother-image
googleother-video
icc-crawler
imagesiftbot
meta-externalagent
meta-externalfetcher
oai-searchbot
perplexitybot
petalbot
scrapy
timpibot
velenpublicwebcrawler
webzio-extended
youbot
anthropic-ai
cohere-ai
facebookexternalhit
iaskspider/2.0
img2dataset
omgili
omgilibot
Rule | Path |
---|---|
Disallow | / |