papschecker.com
robots.txt

Robots Exclusion Standard data for papschecker.com

Resource Scan

Scan Details

Site Domain papschecker.com
Base Domain papschecker.com
Scan Status Ok
Last Scan2025-12-12T23:27:18+00:00
Next Scan 2026-01-11T23:27:18+00:00

Last Scan

Scanned2025-12-12T23:27:18+00:00
URL https://papschecker.com/robots.txt
Domain IPs 104.21.90.129, 172.67.200.165, 2606:4700:3033::ac43:c8a5, 2606:4700:3034::6815:5a81
Response IP 172.67.200.165
Found Yes
Hash 789335c04c6c5dc0b5de67f5fc361d363ffd2449bd4409f8e89c8a30332d8e13
SimHash 52166971c488

Groups

meta-externalagent
gptbot
claudebot
perplexitybot
yandexbot
semrushbot
petalbot
ccbot
amazonbot
baiduspider
bytedance
bytespider
tiktokspider
ahrefsbot
serankingbacklinksbot
blexbot
siteimprove
dataforseobot
diffbot
domainstatsbot
httrack
httrack 3.0
mj12bot
mail.ru_bot
offline explorer
seokicks
scrapy
screaming frog seo spider
sogou web spider
wellknownbot
xenu
youbot
zoominfobot
archive.org_bot
cohere-ai
dotbot
ia_archiver
rogerbot
barkrowler
brightedge crawler
cocolyzebot
hypestat
linkdexbot
online-webceo-bot
serpstatbot
sitecheckerbotcrawler
seolizer
seobilitybot
senutobot
chatgpt-user
claude-user
anthropic-ai
perplexity-user
mistralai-user
claude-web
chatgpt agent
omgili
timpibot
ai2bot

Rule Path
Disallow /

Warnings

  • 1 invalid line.