Log In Sign Up

webtekno.com
robots.txt

Robots Exclusion Standard data for webtekno.com

Resource Scan

Scan Details

Site Domain webtekno.com
Base Domain webtekno.com
Scan Status Ok
Last Scan2024-11-03T17:18:12+00:00
Next Scan 2024-11-10T17:18:12+00:00

Last Scan

Scanned2024-11-03T17:18:12+00:00
URL https://webtekno.com/robots.txt
Redirect https://www.webtekno.com/robots.txt
Redirect Domain www.webtekno.com
Redirect Base webtekno.com
Domain IPs 104.21.34.62, 172.67.199.16, 2606:4700:3031::ac43:c710, 2606:4700:3032::6815:223e
Redirect IPs 104.21.34.62, 172.67.199.16, 2606:4700:3031::ac43:c710, 2606:4700:3032::6815:223e
Response IP 172.67.199.16
Found Yes
Hash 767332e70031c523573876b009ea8f46393ea73c0e78408888021e0b38d6596c
SimHash 0b288c44cbb6

Groups

mediapartners-google
*

Rule Path
Disallow /siteneekle
Disallow /public/banners$
Disallow /get-content
Disallow /get-content
Disallow /ajax_previous
Disallow /etiket/*
Disallow /ara?q=*
Disallow *?_escaped_fragment_
Disallow *?google_editors_picks=true
Disallow *?show=1
Disallow /*/*.html
Back to top

Other Records

Field Value
sitemap https://www.webtekno.com/sitemap.xml
sitemap https://www.webtekno.com/newsmap.xml
Back to top