flirtwith.ai
robots.txt

Robots Exclusion Standard data for flirtwith.ai

Resource Scan

Scan Details

Site Domain flirtwith.ai
Base Domain flirtwith.ai
Scan Status Ok
Last Scan2025-10-15T20:35:07+00:00
Next Scan 2025-10-29T20:35:07+00:00

Last Scan

Scanned2025-10-15T20:35:07+00:00
URL https://flirtwith.ai/robots.txt
Redirect https://linkin.love/robots.txt
Redirect Domain linkin.love
Redirect Base linkin.love
Domain IPs 104.21.93.254, 172.67.217.99, 2606:4700:3033::6815:5dfe, 2606:4700:3037::ac43:d963
Redirect IPs 104.26.10.139, 104.26.11.139, 172.67.74.11, 2606:4700:20::681a:a8b, 2606:4700:20::681a:b8b, 2606:4700:20::ac43:4a0b
Response IP 104.26.10.139
Found Yes
Hash b965f5c0d72de259d51c38121b69ed6d8917abfddb748a073ab00f322a1f416a
SimHash ec10ca12c5b1

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://linkin.love/sitemap_index.xml

Comments

  • Block all crawlers from accessing pages that require authentication
  • Allow crawlers to access all other pages, especially public ones