mintboys.com
robots.txt

Robots Exclusion Standard data for mintboys.com

Resource Scan

Scan Details

Site Domain mintboys.com
Base Domain mintboys.com
Scan Status Ok
Last Scan2025-11-16T09:08:59+00:00
Next Scan 2025-12-16T09:08:59+00:00

Last Scan

Scanned2025-11-16T09:08:59+00:00
URL https://mintboys.com/robots.txt
Redirect https://www.mintboys.com/robots.txt
Redirect Domain www.mintboys.com
Redirect Base mintboys.com
Domain IPs 104.21.22.222, 172.67.207.38, 2606:4700:3031::6815:16de, 2606:4700:3034::ac43:cf26
Redirect IPs 104.21.22.222, 172.67.207.38, 2606:4700:3031::6815:16de, 2606:4700:3034::ac43:cf26
Response IP 172.67.207.38
Found Yes
Hash 2ea317fcfdc11b56f194bfe777d70562f74eff50363e585f69522c3d9e732e75
SimHash 0dc07ae28471

Groups

ia_archiver

Rule Path
Allow /
Disallow /privacy
Disallow /guidelines
Disallow /terms
Disallow /photo-disclaimer
Disallow /faq
Disallow /login
Disallow /sidekiq
Disallow /logout
Disallow /dashboard
Disallow /report
Disallow /listing-report
Disallow /checkout
Disallow /images/
Disallow /out/
Disallow /svc/
Disallow /male-escorts/

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /join/edit/
Disallow /login/verify
Disallow /logout
Disallow /dashboard
Disallow /checkout
Disallow /pages/
Disallow /out/
Disallow /svc/