Log In Sign Up

antoni.web.id
robots.txt

Robots Exclusion Standard data for antoni.web.id

Resource Scan

Scan Details

Site Domain antoni.web.id
Base Domain antoni.web.id
Scan Status Ok
Last Scan2024-09-30T09:37:39+00:00
Next Scan 2024-10-07T09:37:39+00:00

Last Scan

Scanned2024-09-30T09:37:39+00:00
URL https://antoni.web.id/robots.txt
Redirect https://www.antoni.web.id/robots.txt
Redirect Domain www.antoni.web.id
Redirect Base antoni.web.id
Domain IPs 104.21.28.232, 172.67.147.198, 2606:4700:3030::ac43:93c6, 2606:4700:3032::6815:1ce8
Redirect IPs 104.21.28.232, 172.67.147.198, 2606:4700:3030::ac43:93c6, 2606:4700:3032::6815:1ce8
Response IP 172.67.147.198
Found Yes
Hash 5b9ea35d02911f3f467da9c2657b31bdb313ec281638d12b71a63d72bfb062dc
SimHash 0915d2f65531

Groups

*

Rule Path
Disallow /
Allow /blog/
Allow /cryptotabbrowser/

googlebot

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/

googlebot-news

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/

googlebot-image

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/

googlebot-video

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/

googlebot-mobile

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/

mediapartners-google

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/

adsbot-google

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/

bingbot

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/

slurp

Rule Path
Allow /

baiduspider

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/

duckduckbot

Rule Path
Allow /

yandex

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/

pinterestbot

Rule Path
Allow /
Allow /blog/
Allow /cryptotabbrowser/
Back to top

Other Records

Field Value
sitemap https://www.antoni.web.id/sitemap.xml
sitemap https://www.antoni.web.id/blog/sitemap.xml
sitemap https://www.antoni.web.id/blog/post-sitemap.xml
sitemap https://www.antoni.web.id/blog/page-sitemap.xml
sitemap https://www.antoni.web.id/blog/category-sitemap.xml
sitemap https://www.antoni.web.id/blog/post_tag-sitemap.xml
Back to top

Comments

  • This Instructs for Google
  • This Instructs for Google News
  • This Instructs for Google-Image
  • This Instructs for Google Video
  • This Instructs for Google Mobile
  • This Instructs for Mediapartners-Google
  • This Instructs for Adsbot-Google
  • This Instructs for Bing
  • This Instructs for Yahoo
  • This Instructs for Baidu
  • This Instructs for DuckDuckBot
  • This Instructs for Yandex
  • This Instructs for Yandex
Back to top