transfluid.net
robots.txt
Robots Exclusion Standard data for transfluid.net
Resource Scan
Scan Details
| Site Domain | transfluid.net |
| Base Domain | transfluid.net |
| Scan Status | Ok |
| Last Scan | 2024-09-08T11:29:59+00:00 |
| Next Scan | 2024-10-08T11:29:59+00:00 |
Last Scan
| Scanned | 2024-09-08T11:29:59+00:00 |
| URL | https://transfluid.net/robots.txt |
| Redirect | https://www.transfluid.net/robots.txt |
| Redirect Domain | www.transfluid.net |
| Redirect Base | transfluid.net |
| Domain IPs | 3.123.158.137 |
| Redirect IPs | 108.157.254.108, 108.157.254.117, 108.157.254.118, 108.157.254.95, 2600:9000:2753:1c00:16:a7fb:f740:93a1, 2600:9000:2753:2000:16:a7fb:f740:93a1, 2600:9000:2753:2600:16:a7fb:f740:93a1, 2600:9000:2753:4600:16:a7fb:f740:93a1, 2600:9000:2753:5200:16:a7fb:f740:93a1, 2600:9000:2753:5800:16:a7fb:f740:93a1, 2600:9000:2753:5c00:16:a7fb:f740:93a1, 2600:9000:2753:600:16:a7fb:f740:93a1 |
| Response IP | 108.157.254.108 |
| Found | Yes |
| Hash | b188bd661c782cb6df711664da830430f61e25a509fa687947ad1ebcce90312b |
| SimHash | 0f414b044b42 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?id=* |
| Disallow | /*%26id%3D* |
| Disallow | /*?L=0* |
| Disallow | /*%26L%3D0* |
| Disallow | /*?tx_solr* |
| Disallow | /*%26tx_solr* |
| Disallow | /*/Private/* |
| Disallow | /*/Configuration/* |
| Disallow | /typo3temp/* |
| Allow | /typo3temp/*.css |
| Allow | /typo3temp/*.css.*.gzip |
| Allow | /typo3temp/*.js |
| Allow | /typo3temp/*.js.*.gzip |
| Allow | /typo3temp/*.jpg |
| Allow | /typo3temp/*.gif |
| Allow | /typo3temp/*.png |
| Disallow | *.sql |
| Disallow | *.sql.gz |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |