csloxinfo.com
robots.txt

Robots Exclusion Standard data for csloxinfo.com

Resource Scan

Scan Details

Site Domain csloxinfo.com
Base Domain csloxinfo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-14T05:46:41+00:00
Next Scan 2024-10-12T05:46:41+00:00

Last Successful Scan

Scanned2022-11-29T12:02:33+00:00
URL http://www.csloxinfo.com/robots.txt
Domain IPs 27.254.111.40
Response IP 27.254.111.40
Found Yes
Hash 87fc34aa0f79ca5d53f7439290cae68f7f911ee2df511c9e2d5cdc8b9d6698d4
SimHash 6f25dd1766c1

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /tmp/
Disallow /junk/
Disallow /directory/file.html
Disallow /wp-content/
Disallow /wp-content/plugins/
Disallow /wp-includes/
Disallow /wp-includes/js
Disallow /font-awesome.css?
Disallow /recommended/
Disallow /comments/feed/
Disallow /comments/feed
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /*/comment-page-*
Disallow /*?replytocom=*
Disallow /*/trackback
Disallow /trackback
Disallow */trackback
Disallow /feed
Disallow /*/feed
Disallow /?s=*
Disallow /*/?s=*%5C
Disallow /*?*
Disallow /*?
Disallow /*~*
Disallow /*~
Disallow /test/php/test.php?
Disallow /wp-content/plugins/LayerSlider/static/skins/
Disallow /65.php?*

badbot
googlebot

Product Comment
badbot replace 'BadBot' with the actual user-agent of the bot
Rule Path
Allow /
Disallow /private/
Disallow /lems
Disallow /*.gif$
Disallow /*.php$

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/
Disallow /*.gif$
Disallow /images/dogs.jpg

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.csloxinfo.com/sitemap.xml
sitemap https://www.csloxinfo.com/en/sitemap.xml

Warnings

  • 2 invalid lines.