modernprison.com
robots.txt

Robots Exclusion Standard data for modernprison.com

Resource Scan

Scan Details

Site Domain modernprison.com
Base Domain modernprison.com
Scan Status Ok
Last Scan2025-12-11T00:50:43+00:00
Next Scan 2026-01-10T00:50:43+00:00

Last Scan

Scanned2025-12-11T00:50:43+00:00
URL https://modernprison.com/robots.txt
Domain IPs 104.21.26.209, 172.67.168.141, 2606:4700:3031::ac43:a88d, 2606:4700:3035::6815:1ad1
Response IP 172.67.168.141
Found Yes
Hash 0fac0677cca36a4aaeb7f06aecd6c979dc68386c8a27a755eefbd199e1472131
SimHash 627e8040b799

Groups

zyborg

Rule Path
Disallow /

npbot

Rule Path
Disallow /

scooter

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /adultx/
Disallow /shop.php

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path Comment
Disallow /cgi-bin/ Please keep out - Lass die Finder von
Disallow /pictos/ What do you want here??? - Was willst Du hier???
Disallow /scripts/ -
Disallow /privat/ Noch Fragen ;-)
Disallow /admin/ -
Disallow /wp-admin/ -
Disallow /adultx/ -
Disallow /webmaster/ -
Disallow /content/ -
Disallow /membersarea/ -
Disallow /shop.php -
Allow / -

Comments

  • dummes Skript, dass sogar mailtto-Links folgt
  • alle amderen robots