Log In Sign Up

penatimor.id
robots.txt

Robots Exclusion Standard data for penatimor.id

Resource Scan

Scan Details

Site Domain penatimor.id
Base Domain penatimor.id
Scan Status Ok
Last Scan2024-10-03T04:36:27+00:00
Next Scan 2024-10-10T04:36:27+00:00

Last Scan

Scanned2024-10-03T04:36:27+00:00
URL https://penatimor.id/robots.txt
Domain IPs 151.106.118.27
Response IP 151.106.118.27
Found Yes
Hash e313bac18783827f9626896a35b70af788170f66ee544a1283d687beee7849f9
SimHash ed2a4b3e03d6

Groups

googlebot

Rule Path
Allow *.js
Allow *.css
Allow /wp-admin/admin-ajax.php
Disallow /?s=
Disallow /search/
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /trackback/

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin
Disallow /wp-login.php
Disallow /trackback/
Disallow /wp-register.php
Disallow */comments$
Disallow /comments/feed
Disallow /wp-comments
Back to top

Other Records

Field Value
sitemap https://penatimor.id/sitemap.xml
sitemap https://penatimor.id/news-sitemap.xml
sitemap https://penatimor.id/sitemap_index.xml
sitemap https://penatimor.id/post-sitemap1.xml
sitemap https://penatimor.id/post-sitemap2.xml
sitemap https://penatimor.id/post-sitemap3.xml
sitemap https://penatimor.id/post-sitemap4.xml
sitemap https://penatimor.id/post-sitemap5.xml
sitemap https://penatimor.id/post-sitemap6.xml
sitemap https://penatimor.id/post-sitemap7.xml
sitemap https://penatimor.id/post-sitemap8.xml
sitemap https://penatimor.id/post-sitemap9.xml
sitemap https://penatimor.id/post-sitemap10.xml
sitemap https://penatimor.id/post-sitemap11.xml
sitemap https://penatimor.id/post-sitemap12.xml
sitemap https://penatimor.id/post-sitemap13.xml
sitemap https://penatimor.id/post-sitemap14.xml
sitemap https://penatimor.id/post-sitemap15.xml
sitemap https://penatimor.id/post-sitemap16.xml
sitemap https://penatimor.id/post-sitemap17.xml
sitemap https://penatimor.id/post-sitemap18.xml
sitemap https://penatimor.id/post-sitemap19.xml
sitemap https://penatimor.id/post-sitemap20.xml
sitemap https://penatimor.id/post-sitemap21.xml
sitemap https://penatimor.id/post-sitemap22.xml
sitemap https://penatimor.id/post-sitemap23.xml
sitemap https://penatimor.id/post-sitemap24.xml
sitemap https://penatimor.id/post-sitemap25.xml
sitemap https://penatimor.id/post-sitemap26.xml
sitemap https://penatimor.id/post-sitemap27.xml
sitemap https://penatimor.id/post-sitemap28.xml
sitemap https://penatimor.id/post-sitemap29.xml
sitemap https://penatimor.id/post-sitemap30.xml
sitemap https://penatimor.id/post-sitemap31.xml
sitemap https://penatimor.id/post-sitemap32.xml
sitemap https://penatimor.id/page-sitemap.xml
sitemap https://penatimor.id/image-sitemap-index-1.xml
sitemap https://penatimor.id/video-sitemap-1.xml
Back to top

Comments

  • Inih buat rendering biar yoyoy
  • tong di delete
  • meh hemat crawl budget
  • admin area ga di crawl
  • biar login dan register page ga di crawl
  • haha yang iseng trackback ga di crawl
  • Sitemap masukin ajah kalau iseng mah
Back to top