Log In Sign Up

blog.filkhabr.com
robots.txt

Robots Exclusion Standard data for blog.filkhabr.com

Resource Scan

Scan Details

Site Domain blog.filkhabr.com
Base Domain filkhabr.com
Scan Status Ok
Last Scan2024-11-04T05:46:54+00:00
Next Scan 2024-12-04T05:46:54+00:00

Last Scan

Scanned2024-11-04T05:46:54+00:00
URL https://blog.filkhabr.com/robots.txt
Redirect https://www.filkhabr.com/robots.txt
Redirect Domain www.filkhabr.com
Redirect Base filkhabr.com
Domain IPs 104.21.67.158, 172.67.177.243, 2606:4700:3031::6815:439e, 2606:4700:3037::ac43:b1f3
Redirect IPs 104.21.67.158, 172.67.177.243, 2606:4700:3031::6815:439e, 2606:4700:3037::ac43:b1f3
Response IP 104.21.67.158
Found Yes
Hash eddc503ff40ad65e4a3cf9aca3972e08c4ce254ab7cd0e35483be440db909276
SimHash 41194b62f606

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /linkout/
Disallow /recommended/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /n/*
Disallow /to/*
Disallow /sr/*
Disallow /tag/*
Disallow /p/a*
Disallow /p/b*
Disallow /p/c*
Disallow /p/d*
Disallow /p/e*
Disallow /p/f*
Disallow /p/g*
Disallow /p/h*
Disallow /p/i*
Disallow /p/j*
Disallow /p/k*
Disallow /p/l*
Disallow /p/m*
Disallow /p/n*
Disallow /p/o*
Disallow /p/p*
Disallow /p/q*
Disallow /p/r*
Disallow /p/s*
Disallow /p/t*
Disallow /p/u*
Disallow /p/v*
Disallow /p/w*
Disallow /p/x*
Disallow /p/y*
Disallow /p/z*
Disallow /p/1*
Disallow /p/2*
Disallow /p/3*
Disallow /p/4*
Disallow /p/5*
Disallow /p/6*
Disallow /p/7*
Disallow /p/8*
Disallow /p/9*
Disallow /p/0*
Disallow /album/*
Disallow /download/*
Disallow /player.php
Disallow /find.php
Disallow /ydls.php

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /
Back to top