sujetscorrigesbac.fr
robots.txt

Robots Exclusion Standard data for sujetscorrigesbac.fr

Resource Scan

Scan Details

Site Domain sujetscorrigesbac.fr
Base Domain sujetscorrigesbac.fr
Scan Status Ok
Last Scan2024-10-03T08:57:02+00:00
Next Scan 2024-10-10T08:57:02+00:00

Last Scan

Scanned2024-10-03T08:57:02+00:00
URL http://sujetscorrigesbac.fr/robots.txt
Redirect http://www.sujetscorrigesbac.fr/robots.txt
Redirect Domain www.sujetscorrigesbac.fr
Redirect Base sujetscorrigesbac.fr
Domain IPs 195.154.21.93
Redirect IPs 195.154.21.82
Response IP 195.154.21.82
Found Yes
Hash 87042969f507b74695e0567f3a06ed5f8e5916915a53307f8f030d18dbcd5525
SimHash ab4cd80266b0

Groups

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

httrack

Rule Path
Disallow /

blexbot
mj12bot
seekport crawler
*

Rule Path
Allow /
Disallow /storage/do_xml/id/

Other Records

Field Value
sitemap http://www.sujetscorrigesbac.fr/sitemap.xml