Log In Sign Up

taalim-hack.blogspot.com
robots.txt

Robots Exclusion Standard data for taalim-hack.blogspot.com

Resource Scan

Scan Details

Site Domain taalim-hack.blogspot.com
Base Domain taalim-hack.blogspot.com
Scan Status Ok
Last Scan2025-11-18T20:06:30+00:00
Next Scan 2025-11-25T20:06:30+00:00

Last Scan

Scanned2025-11-18T20:06:30+00:00
URL https://taalim-hack.blogspot.com/robots.txt
Domain IPs 2404:6800:4003:c05::84, 74.125.200.132
Response IP 64.233.170.132
Found Yes
Hash d539a94b54632e76a548fde574902d03b5206f34eede4348bf86496d2513852c
SimHash e85083d26499

Groups

baiduspider

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /l.php
Disallow /p.php
Disallow /photo.php
Disallow /photo_comments.php
Disallow /photo_search.php
Disallow /photos.php
Disallow /sharer/

googlebot

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /l.php
Disallow /p.php
Disallow /photo.php
Disallow /photo_comments.php
Disallow /photo_search.php
Disallow /photos.php
Disallow /sharer/

msnbot

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /l.php
Disallow /p.php
Disallow /photo.php
Disallow /photo_comments.php
Disallow /photo_search.php
Disallow /photos.php
Disallow /sharer/

naverbot

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /l.php
Disallow /p.php
Disallow /photo.php
Disallow /photo_comments.php
Disallow /photo_search.php
Disallow /photos.php
Disallow /sharer/

seznambot

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /l.php
Disallow /p.php
Disallow /photo.php
Disallow /photo_comments.php
Disallow /photo_search.php
Disallow /photos.php
Disallow /sharer/

slurp

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /l.php
Disallow /p.php
Disallow /photo.php
Disallow /photo_comments.php
Disallow /photo_search.php
Disallow /photos.php
Disallow /sharer/

teoma

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /l.php
Disallow /p.php
Disallow /photo.php
Disallow /photo_comments.php
Disallow /photo_search.php
Disallow /photos.php
Disallow /sharer/

yandex

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /l.php
Disallow /p.php
Disallow /photo.php
Disallow /photo_comments.php
Disallow /photo_search.php
Disallow /photos.php
Disallow /sharer/

yeti

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /feeds/
Disallow /file_download.php
Disallow /l.php
Disallow /p.php
Disallow /photo.php
Disallow /photo_comments.php
Disallow /photo_search.php
Disallow /photos.php
Disallow /sharer/

ia_archiver

Rule Path
Allow /about/privacy
Allow /full_data_use_policy
Allow /legal/terms
Allow /policy.php
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • Notice: Crawling Facebook is prohibited unless you have express written
  • permission. See: http://www.facebook.com/apps/site_scraping_tos_terms.php
Back to top