Log In Sign Up

web-development-kb-pt.site
robots.txt

Robots Exclusion Standard data for web-development-kb-pt.site

Resource Scan

Scan Details

Site Domain web-development-kb-pt.site
Base Domain web-development-kb-pt.site
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-06-06T06:26:20+00:00
Next Scan 2025-09-04T06:26:20+00:00

Last Successful Scan

Scanned2023-05-12T21:03:59+00:00
URL https://web-development-kb-pt.site/robots.txt
Domain IPs 104.21.38.145, 172.67.223.166, 2606:4700:3033::6815:2691, 2606:4700:3034::ac43:dfa6
Response IP 104.21.38.145
Found Yes
Hash 26fe83c24454eb17a8092760ac002c698ec0ca38c538f45ff75a804e7cbbdaac
SimHash 68448646d913

Groups

yandex

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

googlebot
mediapartners-google

Rule Path
Allow */amp/

*

Rule Path
Disallow */amp/
Back to top

Other Records

Field Value
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-957276962.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-957276952.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-957277010.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-957276976.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-957276996.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-957276942.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-957277030.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-957276986.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-957277020.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-l957277064.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-l957277054.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-l957277044.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-l957276842.xml
sitemap https://www.web-development-kb-pt.site/sitemaps/index-sitemap-pt-l957276832.xml
Back to top

Comments

  • Sitemaps
Back to top