theterminallife.com
robots.txt

Robots Exclusion Standard data for theterminallife.com

Resource Scan

Scan Details

Site Domain theterminallife.com
Base Domain theterminallife.com
Scan Status Ok
Last Scan2025-12-12T11:37:53+00:00
Next Scan 2026-01-11T11:37:53+00:00

Last Scan

Scanned2025-12-12T11:37:53+00:00
URL https://theterminallife.com/robots.txt
Domain IPs 45.79.34.117
Response IP 45.79.34.117
Found Yes
Hash a55afe608f24ba260008c2e5d8658f00ae38d30245f2c8ea181709fb68f2563b
SimHash 76be4901c1c6

Groups

ai2bot
ai2bot-dolma
amazonbot
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
googleother
googleother-image
googleother-video
icc-crawler
isscyberriskcrawler
imagesiftbot
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
perplexitybot
petalbot
scrapy
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot
anthropic-ai
cohere-ai
facebookexternalhit
iaskspider/2.0
img2dataset
omgili
omgilibot

Rule Path
Disallow /