dostor.org
robots.txt

Robots Exclusion Standard data for dostor.org

Resource Scan

Scan Details

Site Domain dostor.org
Base Domain dostor.org
Scan Status Ok
Last Scan2024-10-15T06:28:32+00:00
Next Scan 2024-10-22T06:28:32+00:00

Last Scan

Scanned2024-10-15T06:28:32+00:00
URL https://dostor.org/robots.txt
Domain IPs 104.26.12.10, 104.26.13.10, 172.67.70.82, 2606:4700:20::681a:c0a, 2606:4700:20::681a:d0a, 2606:4700:20::ac43:4652
Response IP 172.67.70.82
Found Yes
Hash a554e3d0c0ddc4ed03461c3176b0db4a5cc8ee854d6068e96f5e64a36c9d5730
SimHash 6f448e727613

Groups

*

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

bingbot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

apis-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.dostor.org/sitemaps.xml

Comments

  • SYNC 2021
  • HTTPS www.dostor.org