4boys.net
robots.txt

Robots Exclusion Standard data for 4boys.net

Resource Scan

Scan Details

Site Domain 4boys.net
Base Domain 4boys.net
Scan Status Ok
Last Scan2024-05-27T13:38:32+00:00
Next Scan 2024-06-26T13:38:32+00:00

Last Scan

Scanned2024-05-27T13:38:32+00:00
URL https://4boys.net/robots.txt
Domain IPs 104.21.235.133, 104.21.235.134, 2606:4700:3038::6815:eb85, 2606:4700:3038::6815:eb86
Response IP 104.21.235.134
Found Yes
Hash 50ec8abf7f9ec7d1c332bdc196e11bed3a49afefffc04ea7d9066ad8a156aea9
SimHash 63a4dd4a2916

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /*/*.css
Allow /*/*.js
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */disclaimer/*
Disallow *?attachment_id=
Disallow /privacy-policy

Comments

  • This robots.txt file was created by Better Robots.txt (Index & Rank Booster by Pagup) Plugin. https://www.better-robots.com/