firmwareses.com
robots.txt
Robots Exclusion Standard data for firmwareses.com
Resource Scan
Scan Details
Site Domain | firmwareses.com |
Base Domain | firmwareses.com |
Scan Status | Ok |
Last Scan | 6/11/2025, 3:00:45 AM |
Next Scan | 6/18/2025, 3:00:45 AM |
Last Scan
Scanned | 6/11/2025, 3:00:45 AM |
URL | https://firmwareses.com/robots.txt |
Domain IPs | 104.21.23.239, 172.67.214.43, 2606:4700:3031::ac43:d62b, 2606:4700:3037::6815:17ef |
Response IP | 104.21.23.239 |
Found | Yes |
Hash | 2ecadc9d78e49a0b35e79c9def839411933bf6bd8ec85ffedc629be248eca872 |
SimHash | a33e15d943f4 |
Groups
*
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /cache/ |
Disallow | /cli/ |
Disallow | /components/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /media/ |
Disallow | /modules/ |
Disallow | /plugins/ |
Disallow | /templates/ |
Disallow | /tmp/ |
Disallow | /search/ |
Disallow | *igrat* |
Disallow | /webtomat?* |
Disallow | /?lang=* |
Disallow | */Page-* |
Disallow | *?categorylayout* |
Disallow | */dirasc |
Disallow | */bycategory_name |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
googlebot
Rule | Path |
---|---|
Allow | /templates/*.css |
Allow | /templates/*.js |
Allow | /components/*.css |
Allow | /components/*.js |
Allow | /media/*.js |
Allow | /media/*.css |
Allow | /plugins/*.css |
Allow | /plugins/*.js |
Disallow | /administrator/ |
Disallow | /cache/ |
Disallow | /cli/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /tmp/ |
Disallow | /search/ |
Disallow | *igrat* |
Disallow | /webtomat?* |
Disallow | /?lang=* |
Disallow | */Page-* |
Disallow | *?categorylayout* |
Disallow | */dirasc |
Disallow | */bycategory_name |
Warnings
- `host` is not a known field.
Comments