freespanked.com
robots.txt

Robots Exclusion Standard data for freespanked.com

Resource Scan

Scan Details

Site Domain freespanked.com
Base Domain freespanked.com
Scan Status Ok
Last Scan2025-10-16T02:52:13+00:00
Next Scan 2025-11-15T02:52:13+00:00

Last Scan

Scanned2025-10-16T02:52:13+00:00
URL https://freespanked.com/robots.txt
Domain IPs 138.124.181.150
Response IP 138.124.181.150
Found Yes
Hash 570a249196ccd8f5ae621a908c24a77af131225b391fce14b481363ef407d846
SimHash 493de1a2ebc9

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /get_file/
Disallow /admin/
Disallow /q%3D
Disallow /ftt2/cron.php

googlebot

Rule Path
Disallow /ftt2/o.php

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

proximic

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

bubing

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.