1prostitutki.com
robots.txt

Robots Exclusion Standard data for 1prostitutki.com

Resource Scan

Scan Details

Site Domain 1prostitutki.com
Base Domain 1prostitutki.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-06T20:37:51+00:00
Next Scan 2024-06-05T20:37:51+00:00

Last Successful Scan

Scanned2024-01-15T20:36:00+00:00
URL https://1prostitutki.com/robots.txt
Domain IPs 104.21.93.225, 172.67.216.81, 2606:4700:3032::6815:5de1, 2606:4700:3036::ac43:d851
Response IP 172.67.216.81
Found Yes
Hash fa984666628666660846474420b3eedd3fb2d1d5707e30c0c55f2bba27c5a24d
SimHash 065d0be1c6e0

Groups

yandex

Rule Path
Disallow /*page*

*

Rule Path
Disallow /page

linkpadbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Comments

  • linkpad.ru
  • majestic.com
  • ahrefs.com
  • moz.com
  • semrush.com

Warnings

  • `host` is not a known field.