Log In Sign Up

istoric-preturi.info
robots.txt

Robots Exclusion Standard data for istoric-preturi.info

Resource Scan

Scan Details

Site Domain istoric-preturi.info
Base Domain istoric-preturi.info
Scan Status Ok
Last Scan2024-06-13T04:41:22+00:00
Next Scan 2024-06-20T04:41:22+00:00

Last Scan

Scanned2024-06-13T04:41:22+00:00
URL https://istoric-preturi.info/robots.txt
Redirect https://www.istoric-preturi.info/robots.txt
Redirect Domain www.istoric-preturi.info
Redirect Base istoric-preturi.info
Domain IPs 104.21.16.152, 172.67.213.168
Redirect IPs 104.21.16.152, 172.67.213.168
Response IP 172.67.213.168
Found Yes
Hash e5dbc67e3cec837b0fbcb047f10c5747f1a74c5d2e6bf24916bf612a0897d8ff
SimHash d05641318990

Groups

*

Rule Path
Disallow /out/
Disallow /link/

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seekport

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

applebot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

comscore

Rule Path
Disallow /

rsiteauditor

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

integralads

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /
Back to top