Log In Sign Up

old.pickup-lines.org
robots.txt

Robots Exclusion Standard data for old.pickup-lines.org

Resource Scan

Scan Details

Site Domain old.pickup-lines.org
Base Domain pickup-lines.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2025-06-17T06:17:07+00:00
Next Scan 2025-06-24T06:17:07+00:00

Last Successful Scan

Scanned2025-05-17T04:48:04+00:00
URL https://old.pickup-lines.org/robots.txt
Domain IPs 192.96.218.37
Response IP 192.96.218.37
Found Yes
Hash 65155664df0963f83376515e2f9650f17caeb76384017dd2f805fb86cd80dda7
SimHash 491c63d07655

Groups

baiduspider
bingbot
duckduckbot
exabot
facebookexternalhit
feedfetcher-google
google-inspectiontool
google-site-verification
google-speakr
googlebot
googlebot-image
googlebot-news
googlebot-video
mediapartners-google
msnbot
qwantify
speedyspider
twitterbot
yandexantivirus/2.0
yandexbot/3.0
yandeximageresizer/2.0
yandeximages/3.0
yandexmedia/3.0
yandexpagechecker/1.0
yandexwebmaster/2.0
yandexzakladki/3.0

Rule Path
Disallow /cgi-bin/

ahrefsbot
ccbot/2.0
chatgpt-user
google-cloudvertexbot
google-extended
googleother
mj12bot
mojeekbot
petalbot
semrushbot
similarweb
yepbot
youbot
*

Rule Path
Disallow /
Back to top

Comments

  • robots.txt file for https://old-site.pickup-lines.org/
  • Allow the good bots in
  • Block the well-behaved unwanted bots
Back to top