Log In Sign Up

technospot.in
robots.txt

Robots Exclusion Standard data for technospot.in

Resource Scan

Scan Details

Site Domain technospot.in
Base Domain technospot.in
Scan Status Ok
Last Scan2025-05-12T11:03:02+00:00
Next Scan 2025-06-11T11:03:02+00:00

Last Scan

Scanned2025-05-12T11:03:02+00:00
URL https://technospot.in/robots.txt
Redirect https://www.technospot.in/robots.txt
Redirect Domain www.technospot.in
Redirect Base technospot.in
Domain IPs 104.21.25.244, 172.67.168.49, 2606:4700:3031::6815:19f4, 2606:4700:3036::ac43:a831
Redirect IPs 104.21.25.244, 172.67.168.49, 2606:4700:3031::6815:19f4, 2606:4700:3036::ac43:a831
Response IP 104.21.25.244
Found Yes
Hash 440657896d777ec1caf8f06fd6907e41f45f3f6cf7ba309b715babe0af24fa92
SimHash e94150111333

Groups

*

Rule Path
Allow /

anthropicbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /porpoiseant/*
Disallow /beardeddragon/*
Disallow /tardisrocinante/*
Disallow /ezais/*
Disallow /parsonsmaize/*
Disallow /edmontonalberta/*
Disallow /detroitchicag0/*
Disallow *?gcb=*
Disallow *?cb=*
Disallow *?cmbcb=*
Disallow *?bv=*
Back to top

Warnings

  • 2 invalid lines.
  • `https` is not a known field.
Back to top