benoit-g.com
robots.txt

Robots Exclusion Standard data for benoit-g.com

Resource Scan

Scan Details

Site Domain benoit-g.com
Base Domain benoit-g.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-22T18:38:29+00:00
Next Scan 2025-07-21T18:38:29+00:00

Last Successful Scan

Scanned2022-06-05T00:04:42+00:00
URL https://www.benoit-g.com/robots.txt
Response IP 104.18.135.62
Found Yes
Hash 1d5f26af1550bdc44e23b6b6160277005ffaa43f7b80e635516050fbf27d2fa9
SimHash 113cd620d0c2

Groups

nerdybot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bubing

Rule Path
Disallow /