allgaz.ru
robots.txt

Robots Exclusion Standard data for allgaz.ru

Resource Scan

Scan Details

Site Domain allgaz.ru
Base Domain allgaz.ru
Scan Status Ok
Last Scan2024-11-13T01:58:01+00:00
Next Scan 2024-11-20T01:58:01+00:00

Last Scan

Scanned2024-11-13T01:58:01+00:00
URL https://allgaz.ru/robots.txt
Domain IPs 80.78.255.91
Response IP 80.78.255.91
Found Yes
Hash 6a25899438b4ec331f47bb4280b9558c56f70fb4984c2c9303b01195a112841a
SimHash 523cd1029911

Groups

slurp

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

ahrefsbot/5.1

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

*

Rule Path
Disallow /foto/
Disallow /error/
Disallow /search/
Disallow /contacts.php
Disallow /counta.php
Disallow /countb.php
Disallow /countc.php
Disallow /showpa.php
Disallow /showpb.php
Disallow /showpc.php
Disallow /fogot.php