mebelclubspb.ru
robots.txt
Robots Exclusion Standard data for mebelclubspb.ru
Resource Scan
Scan Details
Site Domain | mebelclubspb.ru |
Base Domain | mebelclubspb.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-08-26T09:06:04+00:00 |
Next Scan | 2024-11-24T09:06:04+00:00 |
Last Successful Scan
Scanned | 2023-08-03T08:41:08+00:00 |
URL | https://mebelclubspb.ru/robots.txt |
Domain IPs | 104.21.67.155, 172.67.177.240, 2606:4700:3031::ac43:b1f0, 2606:4700:3037::6815:439b |
Response IP | 104.21.67.155 |
Found | Yes |
Hash | affc8c113ca5c00c96ea87db3e5c982bd66b76d311f6aa705e780edfcc11ad68 |
SimHash | 9bf6d921e49b |
Groups
*
Rule | Path |
---|---|
Disallow | */trackback |
Disallow | */feed |
Disallow | */comments |
Disallow | *?s=* |
Disallow | */?format=* |
Disallow | */?iframe=* |
Disallow | /search/ |
Disallow | /xmlrpc.php |
Disallow | /tag/ |
Disallow | */?site=colorzone |
Disallow | /langs/ |
Disallow | /wp-json/ |
Disallow | /wp-content/uploads/ |
Disallow | /author/ |
Disallow | *.jpg |
Disallow | *.png |
Disallow | *.gif |
Disallow | *.tiff |
Disallow | *.bmp |
Disallow | *.jpeg |
Disallow | *.JPG |
Disallow | *.PNG |
Disallow | *.JPEG |
Disallow | /bez-rubriki/ |