Log In Sign Up

neftgaztek.ru
robots.txt

Robots Exclusion Standard data for neftgaztek.ru

Resource Scan

Scan Details

Site Domain neftgaztek.ru
Base Domain neftgaztek.ru
Scan Status Ok
Last Scan2024-10-28T01:33:16+00:00
Next Scan 2024-11-27T01:33:16+00:00

Last Scan

Scanned2024-10-28T01:33:16+00:00
URL https://neftgaztek.ru/robots.txt
Domain IPs 104.21.82.165, 172.67.159.209, 2606:4700:3036::6815:52a5, 2606:4700:3037::ac43:9fd1
Response IP 172.67.159.209
Found Yes
Hash db66f3f5f7898e3d9089d585ff27cfd17b3ef94382af7e93a2a387a3a0e6d649
SimHash 0056015b0752

Groups

googlebot

Rule Path
Allow /*css
Allow /*js

*

Rule Path
Allow /*css
Allow /*js

ahrefs

Rule Path
Disallow /

semrush

Rule Path
Disallow /

serpstat

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

majestic

Rule Path
Disallow /

aboundex

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

blekkobo

Rule Path
Disallow /

blex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dsearch

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

giga

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

linkdex

Rule Path
Disallow /

lipperhey spider

Rule Path
Disallow /

majestic-12

Rule Path
Disallow /

majestic-seo

Rule Path
Disallow /

meanpath

Rule Path
Disallow /

mj12

Rule Path
Disallow /

ncbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

pagesinventory

Rule Path
Disallow /

roger

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

searchmetrics

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

spbot

Rule Path
Disallow /
Back to top