pressalert.ro
robots.txt

Robots Exclusion Standard data for pressalert.ro

Resource Scan

Scan Details

Site Domain pressalert.ro
Base Domain pressalert.ro
Scan Status Ok
Last Scan2024-06-30T14:06:42+00:00
Next Scan 2024-07-07T14:06:42+00:00

Last Scan

Scanned2024-06-30T14:06:42+00:00
URL https://pressalert.ro/robots.txt
Domain IPs 188.241.118.254
Response IP 188.241.118.254
Found Yes
Hash 2408689b92c986de133655946346aa108ba22cadb95b0013df9496508b206c01
SimHash 52d8d19b67c3

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /classes
Disallow /config

mozilla/3.01 (hotwired-test/0.1)

Rule Path
Disallow /classes
Disallow /config

slurp

Rule Path
Disallow /classes
Disallow /config

scooter

Rule Path
Disallow /classes
Disallow /config

ultraseek

Rule Path
Disallow /classes
Disallow /config

smallbear

Rule Path
Disallow /classes
Disallow /config

googlebot

Rule Path
Disallow /classes
Disallow /config

Comments

  • robots, scram
  • robots.txt file for gwp.ro sites. Any objections or rule breaking, please report to master