Log In Sign Up

technoreview.net
robots.txt

Robots Exclusion Standard data for technoreview.net

Resource Scan

Scan Details

Site Domain technoreview.net
Base Domain technoreview.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-10T13:58:19+00:00
Next Scan 2025-08-11T13:58:19+00:00

Last Successful Scan

Scanned2025-08-03T13:57:57+00:00
URL https://technoreview.net/robots.txt
Redirect https://www.technoreview.net/robots.txt
Redirect Domain www.technoreview.net
Redirect Base technoreview.net
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.80.1
Found Yes
Hash 50c28e23f5a4b43bb420744d125aa1a34594f9f0bb91f8c2a10cbe183abcb05c
SimHash 2850db935611

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

teoma

Rule Path
Allow /
Back to top