superoferti.bg
robots.txt

Robots Exclusion Standard data for superoferti.bg

Resource Scan

Scan Details

Site Domain superoferti.bg
Base Domain superoferti.bg
Scan Status Ok
Last Scan2024-06-27T22:55:00+00:00
Next Scan 2024-07-04T22:55:00+00:00

Last Scan

Scanned2024-06-27T22:55:00+00:00
URL https://superoferti.bg/robots.txt
Domain IPs 104.21.82.164, 172.67.159.93, 2606:4700:3031::ac43:9f5d, 2606:4700:3036::6815:52a4
Response IP 172.67.159.93
Found Yes
Hash 79d643daccbc1d99573b80e5fa11660e91088488c29aca05696d3fdea74bc6d0
SimHash 8815c8008f33

Groups

psbot
productfinderbot
teoma
e-societyrobot
msiecrawler

Rule Path
Disallow /

*

Rule Path
Disallow /go
Disallow /go/*
Disallow /go/*/*