feizbook.ir
robots.txt

Robots Exclusion Standard data for feizbook.ir

Resource Scan

Scan Details

Site Domain feizbook.ir
Base Domain feizbook.ir
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2026-03-03T15:32:08+00:00
Next Scan 2026-03-10T15:32:08+00:00

Last Successful Scan

Scanned2026-01-31T00:14:55+00:00
URL https://feizbook.ir/robots.txt
Domain IPs 91.207.205.34
Response IP 91.207.205.34
Found Yes
Hash 688cc2671619e0f13f84180b10ea1d9b4728aff52535c112896fb59aefaf072d
SimHash 0800cfc0c5f5

Groups

mediapartners-google*

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

googlemediabot*

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

gulliver

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

slurp

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

fast

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

scooter

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

vscooter

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

ia_archiver

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

nutch

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

fast-webcrawler

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

teoma

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

lycos_spider_(t-rex)

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

bingbot

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

msnbot

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

msnptc

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

msnbot-media/1.0

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

architextspider

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

zyborg

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

surveybot

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

alexabot

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

baiduspider

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

yandex

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

jikespider

Rule Path
Disallow /cgi-bin/
Disallow /system/
Disallow /memcached/
Disallow /xcache/
Disallow /min/
Disallow /index.php
Disallow /www/

*

Rule Path
Disallow /

Comments

  • FeizBook ROBOTS.txt
  • http://feizbook.ir
  • Crawl-delay: 4
  • Disallow all other crawlers