Log In Sign Up

fun-academy.fr
robots.txt

Robots Exclusion Standard data for fun-academy.fr

Resource Scan

Scan Details

Site Domain fun-academy.fr
Base Domain fun-academy.fr
Scan Status Ok
Last Scan2024-06-27T16:07:51+00:00
Next Scan 2024-07-04T16:07:51+00:00

Last Scan

Scanned2024-06-27T16:07:51+00:00
URL https://fun-academy.fr/robots.txt
Domain IPs 13.250.129.152, 2406:da18:9d0:143e:8e74:1b1a:98b9:2813, 2406:da18:9d0:143f:29e7:ae24:cfea:e9bb, 54.151.156.30
Response IP 13.250.129.152
Found Yes
Hash 956272c682eff5f0a6c029f21630765000720a497540a9eca4fa6b16c37f32e0
SimHash ec4ed670ebf0

Groups

googlebot

Rule Path
Disallow /partenaires
Disallow /partenaires/

cazoodlebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.fun-academy.fr/sitemap_index.xml
sitemap https://www.fun-academy.fr/news-sitemap.xml
Back to top

Comments

  • Block CazoodleBot as it does not present correct accept content headers
  • Block MJ12bot as it is just noise
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot
  • Block trendkite-akashic-crawler
Back to top