voting.pitmodule.de
robots.txt

Robots Exclusion Standard data for voting.pitmodule.de

Resource Scan

Scan Details

Site Domain voting.pitmodule.de
Base Domain pitmodule.de
Scan Status Ok
Last Scan2025-06-01T15:38:41+00:00
Next Scan 2025-07-01T15:38:41+00:00

Last Scan

Scanned2025-06-01T15:38:41+00:00
URL https://voting.pitmodule.de/robots.txt
Domain IPs 80.243.45.146
Response IP 80.243.45.146
Found Yes
Hash 8a836da097f37d982f0bac6fafc7b60ffcb27b0e2457d5878f5585ca5a152a93
SimHash 31562ac48cdb

Groups

ahrefsbot
baiduspider
barkrowler
blexbot
bytespider
ccbot
chatgpt
chatgpt-user
classmarkets
claudebot
coccocbot
corpora
criteobot
dataforseobot
dotbot
emailcollector
flamingo_searchengine
go-http-client
go-http-client/2.0
gptbot
grapeshotcrawler
gumgum
guzzlehttp
httrack
ias_crawler
imagesiftbot
integralads
kstandbot
lcc
leakix
mj12bot
mojeekbot
newslitbot
oai-searchbot
paloaltonetworks
penthesilea
perplexitybot
petalbot
proximic
qwantbot
rentola
repolookoutbot
restsharp
ru_bot
scrapy
sebot-wa
semrushbot
seokicks
serpstatbot
seznambot
sirdatabot
startmebot
surdotlybot
telegrambot
trendictionbot
ttd-content
uptimerobot
velenpublicwebcrawler
verity/1.1
webcopier
webreaper
yandexbot
zoombot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea
mj12bot
flamingo_searchengine
rentola
grapeshotcrawler
barkrowler
claudebot
blexbot
dataforseobot

Rule Path
Disallow /

zoomrank/3.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Comments

  • robots.txt by pitcom - voting.pitmodule.de
  • questions to support@pitcom.de | +493741 71971-0
  • Part for FraudCheck - START - not remove
  • Part for FraudCheck - END - not remove
  • Disallow special content
  • Blocked Bots
  • Delay for Bots