citatepedia.ro
robots.txt

Robots Exclusion Standard data for citatepedia.ro

Resource Scan

Scan Details

Site Domain citatepedia.ro
Base Domain citatepedia.ro
Scan Status Ok
Last Scan2024-05-25T16:03:40+00:00
Next Scan 2024-06-01T16:03:40+00:00

Last Scan

Scanned2024-05-25T16:03:40+00:00
URL https://citatepedia.ro/robots.txt
Redirect http://www.citatepedia.ro/robots.txt
Redirect Domain www.citatepedia.ro
Redirect Base citatepedia.ro
Domain IPs 193.203.204.202
Redirect IPs 193.203.204.202
Response IP 193.203.204.202
Found Yes
Hash 02026439aeccb621c1c1ccb99419e84e45fe5327a4f6d961f7ab892bf8e6151d
SimHash 624dd816e3f1

Groups

twiceler

Rule Path
Disallow /

qihoobot

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Disallow /editare.php*
Disallow /problema.php*
Disallow /produs.php*

*

Rule Path
Disallow /editare.php
Disallow /problema.php
Disallow /produs.php