Log In Sign Up

technospot.net
robots.txt

Robots Exclusion Standard data for technospot.net

Resource Scan

Scan Details

Site Domain technospot.net
Base Domain technospot.net
Scan Status Ok
Last Scan2024-09-27T14:41:27+00:00
Next Scan 2024-10-04T14:41:27+00:00

Last Scan

Scanned2024-09-27T14:41:27+00:00
URL https://technospot.net/robots.txt
Redirect https://www.technospot.net/robots.txt
Redirect Domain www.technospot.net
Redirect Base technospot.net
Domain IPs 104.21.35.32, 172.67.212.106, 2606:4700:3032::6815:2320, 2606:4700:3033::ac43:d46a
Redirect IPs 104.21.35.32, 172.67.212.106, 2606:4700:3032::6815:2320, 2606:4700:3033::ac43:d46a
Response IP 172.67.212.106
Found Yes
Hash a34b49a1dd3d17f7855e12f7e4e1d5cdd52026bb0eaba346cd596d4f465643bd
SimHash e9455811d133

Groups

*

Rule Path
Allow /

anthropicbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /porpoiseant/*
Disallow /beardeddragon/*
Disallow /tardisrocinante/*
Disallow /ezais/*
Disallow /parsonsmaize/*
Disallow /edmontonalberta/*
Disallow /detroitchicag0/*
Disallow *?gcb=*
Disallow *?cb=*
Disallow *?cmbcb=*
Disallow *?bv=*
Back to top

Other Records

Field Value
sitemap https://www.technospot.net/blogs/sitemap_index.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top