mapa-assurances.fr
robots.txt

Robots Exclusion Standard data for mapa-assurances.fr

Resource Scan

Scan Details

Site Domain mapa-assurances.fr
Base Domain mapa-assurances.fr
Scan Status Ok
Last Scan2025-04-03T12:06:47+00:00
Next Scan 2025-05-03T12:06:47+00:00

Last Scan

Scanned2025-04-03T12:06:47+00:00
URL https://mapa-assurances.fr/robots.txt
Redirect https://www.mapa-assurances.fr/robots.txt
Redirect Domain www.mapa-assurances.fr
Redirect Base mapa-assurances.fr
Domain IPs 104.21.51.203, 172.67.185.222, 2606:4700:3033::6815:33cb, 2606:4700:3036::ac43:b9de
Redirect IPs 104.21.51.203, 172.67.185.222, 2606:4700:3033::6815:33cb, 2606:4700:3036::ac43:b9de
Response IP 172.67.185.222
Found Yes
Hash a4bb77bf17d980d7e695506d8ecd722c880feea9b89fa2ecada4577e5202cc66
SimHash 0e4cf42087d3

Groups

*

Rule Path
Disallow /content/search*
Disallow /web/*
Disallow m.mapa-assurances.fr

Other Records

Field Value
crawl-delay 15

nerdybot

Rule Path
Disallow /

textbulkerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mapa-assurances.fr/sitemap.xml

Comments

  • nerdydata.com
  • Ticket 24031