luvfree.com
robots.txt

Robots Exclusion Standard data for luvfree.com

Resource Scan

Scan Details

Site Domain luvfree.com
Base Domain luvfree.com
Scan Status Ok
Last Scan2024-09-21T21:29:00+00:00
Next Scan 2024-09-28T21:29:00+00:00

Last Scan

Scanned2024-09-21T21:29:00+00:00
URL https://luvfree.com/robots.txt
Domain IPs 149.202.65.81
Response IP 149.202.65.81
Found Yes
Hash 6db13e513e770070054c49e7d960a112b45506d46b961baba30f6cf263952259
SimHash 0014d442e212

Groups

*

Rule Path
Disallow /top_photos/
Disallow /birthday/
Disallow /friendly/
Disallow /active/
Disallow /bloggers/
Disallow /tags/
Disallow /interests/
Disallow /new/
Disallow /online/
Disallow /photos/
Disallow /counter.php
Disallow /comment_edit.php
Disallow /comm.php
Disallow /encounters.php

mj12bot
blexbot
rogerbot
ia_archiver
semrushbot
ahrefsbot
gptbot
baiduspider
semrushbot-sa
petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.luvfree.com/sitemap.xml