celinecreationsscrap.com
robots.txt

Robots Exclusion Standard data for celinecreationsscrap.com

Resource Scan

Scan Details

Site Domain celinecreationsscrap.com
Base Domain celinecreationsscrap.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-08T17:29:25+00:00
Next Scan 2024-12-07T17:29:25+00:00

Last Successful Scan

Scanned2023-02-10T20:12:02+00:00
URL http://celinecreationsscrap.com/robots.txt
Redirect http://scrapgribouil91.canalblog.com/robots.txt
Redirect Domain scrapgribouil91.canalblog.com
Redirect Base canalblog.com
Domain IPs 195.137.184.101
Redirect IPs 104.18.24.250, 104.18.25.250
Response IP 104.18.24.250
Found Yes
Hash 705d787b17493758bb2ae42b15456b592d8a900e742e57141e451530feec5ba7
SimHash 630d5571c695

Groups

*

Rule Path
Disallow /cf/fe/remote/ffads.cfm

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.2

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

*

Rule Path
Disallow /cf/fe/remote/ffads.cfm

Other Records

Field Value
sitemap http://scrapgribouil91.canalblog.com/rss.xml