apnaartadda.com
robots.txt

Robots Exclusion Standard data for apnaartadda.com

Resource Scan

Scan Details

Site Domain apnaartadda.com
Base Domain apnaartadda.com
Scan Status Ok
Last Scan2024-09-11T22:49:04+00:00
Next Scan 2024-10-11T22:49:04+00:00

Last Scan

Scanned2024-09-11T22:49:04+00:00
URL https://apnaartadda.com/robots.txt
Domain IPs 104.21.64.182, 172.67.154.76, 2606:4700:3030::6815:40b6, 2606:4700:3031::ac43:9a4c
Response IP 104.21.64.182
Found Yes
Hash b025a2912eab8698e68949d5470fab3cf999da206524af515cdeae392edf4d89
SimHash 50167970c48a

Groups

ahrefsbot
blexbot
baiduspider
bytedance
bytespider
ccbot
chatgpt-user
claude-web
claudebot
dataforseobot
diffbot
domainstatsbot
gptbot
httrack
httrack 3.0
mj12bot
mail.ru_bot
offline explorer
perplexitybot
petalbot
seokicks
scrapy
screaming frog seo spider
semrushbot
sogou web spider
wellknownbot
xenu
yandexbot
youbot
zoominfobot
anthropic-ai
archive.org_bot
cohere-ai
dotbot
ia_archiver
rogerbot
barkrowler
brightedge crawler
cocolyzebot
hypestat
linkdexbot
online-webceo-bot
serpstatbot
sitecheckerbotcrawler
seolizer
seobilitybot
senutobot

Rule Path
Disallow /

Warnings

  • 1 invalid line.