rebelianci.org
robots.txt

Robots Exclusion Standard data for rebelianci.org

Resource Scan

Scan Details

Site Domain rebelianci.org
Base Domain rebelianci.org
Scan Status Ok
Last Scan2024-09-22T05:13:20+00:00
Next Scan 2024-09-29T05:13:20+00:00

Last Scan

Scanned2024-09-22T05:13:20+00:00
URL https://rebelianci.org/robots.txt
Domain IPs 188.165.17.151
Response IP 188.165.17.151
Found Yes
Hash 8ffc5053634526780b3a713a6a58fd36b3d6b9a0c81e005cf21b9217226d4db4
SimHash 7a5dcc82f294

Groups

*

Rule Path
Disallow /admin.php
Disallow /admin/

bingbot

Rule Path
Disallow /admin.php
Disallow /admin/

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /admin.php
Disallow /admin/

Other Records

Field Value
crawl-delay 10

yandex
mj12bot
seokicks
semrushbot
ahrefsbot
petalbot
claudebot

Rule Path
Disallow /