spiderbeat.com
robots.txt
Robots Exclusion Standard data for spiderbeat.com
Resource Scan
Scan Details
| Site Domain | spiderbeat.com |
| Base Domain | spiderbeat.com |
| Scan Status | Ok |
| Last Scan | 2024-09-28T00:28:16+00:00 |
| Next Scan | 2024-10-05T00:28:16+00:00 |
Last Scan
| Scanned | 2024-09-28T00:28:16+00:00 |
| URL | https://spiderbeat.com/robots.txt |
| Redirect | https://www.spiderbeat.com/robots.txt |
| Redirect Domain | www.spiderbeat.com |
| Redirect Base | spiderbeat.com |
| Domain IPs | 157.230.240.101 |
| Redirect IPs | 157.230.240.101 |
| Response IP | 157.230.240.101 |
| Found | Yes |
| Hash | 7b24f781416e6ebcd54519263c9198faadd3fb023dc3e36f0a6a54b8fb65ec70 |
| SimHash | 4c05a8b842c2 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /wp-content/ |
| Allow | /wp-includes/js/ |
| Allow | /wp-includes/css/ |
| Disallow | /*?* |
| Disallow | /*? |
| Disallow | /wp-admin/ |
| Disallow | /info/ |
| Disallow | /author/admin/page/*/ |
| Disallow | /page/* |
| Disallow | /*/page/ |
| Disallow | /page/*/ |
| Disallow | /tentang-kami/ |
| Disallow | /*/*/page/*/ |
| Disallow | /wp-includes/ |
| Disallow | /*/feed/ |
| Disallow | /feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/feed/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /*/*/*/trackback/$ |
| Disallow | /feed/ |
| Disallow | /trackback/ |
| Disallow | /rss/ |
| Disallow | /*?s= |
| Disallow | /plugins/ |
| Disallow | /cgi-bin/ |
| Disallow | /?random%2F |
| Disallow | /author/ |
| Disallow | /tv/ |
| Disallow | /css/ |
| Disallow | /img/ |
| Disallow | /*/comment-page-* |
| Disallow | /*?comments=true$ |
| Disallow | /*?postcomment=true$ |
| Disallow | /mp3/page/*/*.html |
| Disallow | /mp3/*.html |
| Disallow | /mp3-search-and-download-alternative/ |
| Disallow | /terms-of-service/ |
| Disallow | /delete-comment.g?blogID= |
| Disallow | /2012/06/google-penguin-udate-algoritma-sistem.html |
| Disallow | /2012/06/program-ppc-terpercaya-indonesia.html |
| Disallow | /2012/08/tablet-android-40-ics-harga-murah.html |
| Disallow | /2012/06/perangkat-yang-kompatibel-dengan-ice.html |
| Disallow | /2013/01/tips-aman-belanja-di-internet.html |
| Disallow | /2012/06/aplikasi-android-terbaru.html |
| Disallow | /2012/08/tablet-dengan-os-windows-7-wearnes.html |
| Disallow | /2012/07/aplikasi-musik-android-terbaik.html |
| Disallow | /2012/06/aplikasi-terbaik-untuk-android.html |
| Disallow | /2012/02/air-terjun-tercantik-didunia.html |
| Disallow | /2012/07/game-untuk-android.html |
| Disallow | /2012/06/kode-warna-generator.html |
| Disallow | /2012/09/cara-cepat-upload-gambar-ke-facebook.html |
| Disallow | /2012/09/hp-android-tebaik-harga-2-jutaan.html |
| Disallow | /2012/10/kelebihan-samsung-galaxy-tab-101.html |
| Disallow | /2012/09/sony-xperia-j-hp-keren-harga-2-juta.html |
| Disallow | /2012/06/cara-update-versi-android.html |
| Disallow | /2012/08/spesifikasi-harga-nokia-asha-311.html |
| Disallow | /2012/08/aplikasi-facebook-android-terbaik.html |
| Disallow | /2012/08/hp-samsung-terbaik-2012.html |
| Disallow | /2009/03/seorang-hacker-remaja-membobol-kartu.html |
| Disallow | /2012/02/10-langkah-bagi-ayah-untuk-mengajarkan.html |
| Disallow | /2009/03/gratis-trik-ampuh-raih-dollar.html |
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /wp-content/ |
| Allow | /wp-includes/js/ |
| Allow | /wp-includes/css/ |
| Disallow | /*?* |
| Disallow | /*? |
| Disallow | /wp-admin/ |
| Disallow | /info/ |
| Disallow | /author/admin/page/*/ |
| Disallow | /page/* |
| Disallow | /*/page/ |
| Disallow | /page/*/ |
| Disallow | /*/*/page/*/ |
| Disallow | /wp-includes/ |
| Disallow | /*/feed/ |
| Disallow | /tentang-kami/ |
| Disallow | /feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/feed/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /*/*/*/trackback/$ |
| Disallow | /feed/ |
| Disallow | /trackback/ |
| Disallow | /rss/ |
| Disallow | /*?s= |
| Disallow | /plugins/ |
| Disallow | /cgi-bin/ |
| Disallow | /?random%2F |
| Disallow | /author/ |
| Disallow | /tv/ |
| Disallow | /css/ |
| Disallow | /img/ |
| Disallow | /*/comment-page-* |
| Disallow | /*?comments=true$ |
| Disallow | /*?postcomment=true$ |
| Disallow | /mp3/page/*/*.html |
| Disallow | /mp3/*.html |
| Disallow | /mp3-search-and-download-alternative/ |
| Disallow | /terms-of-service/ |
| Disallow | /delete-comment.g?blogID= |
| Disallow | /2012/06/google-penguin-udate-algoritma-sistem.html |
| Disallow | /2012/06/program-ppc-terpercaya-indonesia.html |
| Disallow | /2012/08/tablet-android-40-ics-harga-murah.html |
| Disallow | /2012/06/perangkat-yang-kompatibel-dengan-ice.html |
| Disallow | /2013/01/tips-aman-belanja-di-internet.html |
| Disallow | /2012/06/aplikasi-android-terbaru.html |
| Disallow | /2012/08/tablet-dengan-os-windows-7-wearnes.html |
| Disallow | /2012/07/aplikasi-musik-android-terbaik.html |
| Disallow | /2012/06/aplikasi-terbaik-untuk-android.html |
| Disallow | /2012/02/air-terjun-tercantik-didunia.html |
| Disallow | /2012/07/game-untuk-android.html |
| Disallow | /2012/06/kode-warna-generator.html |
| Disallow | /2012/09/cara-cepat-upload-gambar-ke-facebook.html |
| Disallow | /2012/09/hp-android-tebaik-harga-2-jutaan.html |
| Disallow | /2012/10/kelebihan-samsung-galaxy-tab-101.html |
| Disallow | /2012/09/sony-xperia-j-hp-keren-harga-2-juta.html |
| Disallow | /2012/06/cara-update-versi-android.html |
| Disallow | /2012/08/spesifikasi-harga-nokia-asha-311.html |
| Disallow | /2012/08/aplikasi-facebook-android-terbaik.html |
| Disallow | /2012/08/hp-samsung-terbaik-2012.html |
| Disallow | /2009/03/seorang-hacker-remaja-membobol-kartu.html |
| Disallow | /2012/02/10-langkah-bagi-ayah-untuk-mengajarkan.html |
| Disallow | /2009/03/gratis-trik-ampuh-raih-dollar.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.spiderbeat.com/sitemap_index.xml |
Comments