ro-en.gsp.ro
robots.txt

Robots Exclusion Standard data for ro-en.gsp.ro

Resource Scan

Scan Details

Site Domain ro-en.gsp.ro
Base Domain gsp.ro
Scan Status Ok
Last Scan2024-05-14T20:56:43+00:00
Next Scan 2024-05-28T20:56:43+00:00

Last Scan

Scanned2024-05-14T20:56:43+00:00
URL https://ro-en.gsp.ro/robots.txt
Domain IPs 193.203.204.206
Response IP 193.203.204.206
Found Yes
Hash b4dca589cab42eda0eb6ab056266261343ccee446d98ce9f6d66e93485d76fbe
SimHash 6242d882c3e5

Groups

jyxobot*

Rule Path
Disallow /

jyxobot/1

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

qihoobot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow

googlebot-image

Rule Path
Disallow /

slurp
*

Rule Path
Disallow /doku.php?id=umor%3Astart
Disallow /doku.php?id=http%3Astart

Other Records

Field Value
crawl-delay 30