deed.news
robots.txt

Robots Exclusion Standard data for deed.news

Resource Scan

Scan Details

Site Domain deed.news
Base Domain deed.news
Scan Status Ok
Last Scan2025-03-09T02:18:09+00:00
Next Scan 2025-03-16T02:18:09+00:00

Last Scan

Scanned2025-03-09T02:18:09+00:00
URL https://deed.news/robots.txt
Domain IPs 104.21.27.120, 172.67.169.69, 2606:4700:3034::ac43:a945, 2606:4700:3037::6815:1b78
Response IP 104.21.27.120
Found Yes
Hash 9a2ed6efda613a3619fb04f637c57795a2533a3cd69cfea2d07ac34fb5f47d91
SimHash f35cd310bd80

Groups

ahrefsbot
ahrefssiteaudit
amazonbot
antbot
applebot
awariobot
barkrowler
blexbot
buck
claudebot
criteobot
dataforseobot
dotbot
ds-robot
facebookexternalhit
fidget-spinner-bot
gptbot
grapeshotcrawler
linkdexbot
magpie-crawler
mediatoolkitbot
mj12bot
my-tiny-bot
petalbot
proximic
qwantify
rainbot
seekportbot
semrushbot
semrushbot-ba
semrushbot-coub
semrushbot-ct
semrushbot-si
semrushbot-swa
siteauditbot
splitsignalbot
test-bot
thesis-research-bot
timpibot
tinytestbot
trendictionbot
yak
yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /