Log In Sign Up

codervex.com
robots.txt

Robots Exclusion Standard data for codervex.com

Resource Scan

Scan Details

Site Domain codervex.com
Base Domain codervex.com
Scan Status Ok
Last Scan2025-07-19T08:27:12+00:00
Next Scan 2025-08-18T08:27:12+00:00

Last Scan

Scanned2025-07-19T08:27:12+00:00
URL https://codervex.com/robots.txt
Redirect https://www.codervex.com/robots.txt
Redirect Domain www.codervex.com
Redirect Base codervex.com
Domain IPs 2a02:4780:15:a655:8a8:b7e3:ce3b:5b, 2a02:4780:38:e114:7013:225:c0d3:bfd5, 84.32.84.0, 84.32.84.111
Redirect IPs 179.61.189.120, 2a02:4780:84:89c9:7e36:df94:296c:9d0e, 2a02:4780:84:d1e1:51d5:243d:46d1:dc0f, 77.37.75.232
Response IP 93.127.201.173
Found Yes
Hash 6bb30f404ca83bda8a79fa08b7825f5669dab4edbf66c7be42210addbb242637
SimHash 88041230a9f1

Groups

semrushbot-si

Rule Path
Allow /

yahoo pipes 2.0

Rule Path
Disallow /

facebot

Rule Path
Disallow /archive/graphs.php

bingbot

Rule Path
Disallow /archive/graphs.php

bingpreview

Rule Path
Disallow /archive/graphs.php

twitterbot

Rule Path
Allow /blog/*
Allow /ranking-factors/*
Disallow /*.php
Disallow /copyrighted-images/*.jpg

*

Rule Path
Disallow /blog/*?img=*
Disallow /application/*
Disallow /system/*
Allow /blog/*
Disallow /blog/search/*
Disallow /blog/*utm_source%3D*
Disallow /blog-manager/*
Allow /user/*
Back to top

Other Records

Field Value
sitemap https://codervex.com/sitemap.xml
Back to top

Comments

  • Community rules
  • Sitemap files
Back to top

Warnings

  • 2 invalid lines.
Back to top