gay-beur.com
robots.txt

Robots Exclusion Standard data for gay-beur.com

Resource Scan

Scan Details

Site Domain gay-beur.com
Base Domain gay-beur.com
Scan Status Ok
Last Scan2025-03-31T12:59:07+00:00
Next Scan 2025-04-30T12:59:07+00:00

Last Scan

Scanned2025-03-31T12:59:07+00:00
URL https://gay-beur.com/robots.txt
Redirect https://www.gay-beur.com/robots.txt
Redirect Domain www.gay-beur.com
Redirect Base gay-beur.com
Domain IPs 104.21.25.101, 172.67.133.254, 2606:4700:3030::6815:1965, 2606:4700:3035::ac43:85fe
Redirect IPs 104.21.25.101, 172.67.133.254, 2606:4700:3030::6815:1965, 2606:4700:3035::ac43:85fe
Response IP 172.67.133.254
Found Yes
Hash 7789a3ac0066d8f970cceb9e4540afaa0801d34dbfb645b1a3fd87f4002e6e16
SimHash c8255dc089a0

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /feed/$
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /blog/
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /*?*filter=*
Disallow /*?*noredirect=*
Disallow /*?*p=*
Disallow /*?*o=*
Disallow /*?*repeat=*
Disallow /search/
Disallow /server/