citispotter.com
robots.txt

Robots Exclusion Standard data for citispotter.com

Resource Scan

Scan Details

Site Domain citispotter.com
Base Domain citispotter.com
Scan Status Ok
Last Scan2024-10-05T18:13:08+00:00
Next Scan 2024-10-12T18:13:08+00:00

Last Scan

Scanned2024-10-05T18:13:08+00:00
URL https://citispotter.com/robots.txt
Domain IPs 94.136.170.26
Response IP 94.136.170.26
Found Yes
Hash 175387470bb6d1ac89b5b54b4001587420580f74d1d2907eb79bb5eb50c852b0
SimHash 4b2e406aeeb8

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

lcc

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Warnings

  • 2 invalid lines.