bestdaters.com
robots.txt

Robots Exclusion Standard data for bestdaters.com

Resource Scan

Scan Details

Site Domain bestdaters.com
Base Domain bestdaters.com
Scan Status Ok
Last Scan2025-10-02T02:22:20+00:00
Next Scan 2025-11-01T02:22:20+00:00

Last Scan

Scanned2025-10-02T02:22:20+00:00
URL https://bestdaters.com/robots.txt
Domain IPs 104.21.51.39, 172.67.220.179, 2606:4700:3030::6815:3327, 2606:4700:3035::ac43:dcb3
Response IP 104.21.51.39
Found Yes
Hash 76b2a0fafd66a38bd2ff9d0acc0ab02cc13e69d24bef5ea50048d4857c0c2a3c
SimHash 280dd8628512

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /goon/

Other Records

Field Value
sitemap https://bestdaters.com/sitemap.xml
sitemap https://bestdaters.com/sitemap-comparisons.xml