distance-and-remote-learning-europe.educationtechnologyinsights.com
robots.txt

Resource Scan

Scan Details

Site Domain distance-and-remote-learning-europe.educationtechnologyinsights.com
Base Domain educationtechnologyinsights.com
Scan Status Ok
Last Scan2025-11-26T23:15:09+00:00
Next Scan 2025-12-26T23:15:09+00:00

Last Scan

Scanned2025-11-26T23:15:09+00:00
URL https://distance-and-remote-learning-europe.educationtechnologyinsights.com/robots.txt
Domain IPs 54.70.25.82
Response IP 54.70.25.82
Found Yes
Hash 125e69d9340a4d910b37fb0c3a3052b68b3abc8d2e1b0bbb9222c41fc7e02183
SimHash 2931dc915793

Groups

*

Rule Path Comment
Disallow / Disallow all bots by default
Disallow /scripts/ -
Disallow /*.php$ -
Disallow /zlib/ -
Disallow /lib/ -
Disallow /utils/ -
Disallow /magazine/ -
Disallow /admin/ -

googlebot
googlebot-image
mediapartners-google
adsbot-google
googlebot-mobile
msnbot
slurp
msicrawler
baiduspider
bingbot
seositecheckupbot
screaming frog seo spider
yandexbot
linkedinbot
twitterbot
ahrefsbot

Rule Path
Allow /

ahrefssiteaudit

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.educationtechnologyinsights.com/educationtechnews_sitemap.xml
sitemap https://www.educationtechnologyinsights.com/educationtechnologyinsightsnewnews_sitemap.xml
sitemap https://www.educationtechnologyinsights.com/vendorviewpoint_sitemap.xml
sitemap https://www.educationtechnologyinsights.com/all_in_one_sitemap_main.xml
sitemap https://www.educationtechnologyinsights.com/educationtechcontributors_sitemap.xml
sitemap https://www.educationtechnologyinsights.com/rankingxml_sitemap_new.xml
sitemap https://www.educationtechnologyinsights.com/educationtechvendor_sitemap_new.xml

Comments

  • Allow major search engines
  • Allow specific tools
  • Allow AhrefsBot
  • Allow AhrefsSiteAudit