bdtheque.com
robots.txt
Robots Exclusion Standard data for bdtheque.com
Resource Scan
Scan Details
Site Domain | bdtheque.com |
Base Domain | bdtheque.com |
Scan Status | Ok |
Last Scan | 2024-05-07T14:29:25+00:00 |
Next Scan | 2024-06-06T14:29:25+00:00 |
Last Scan
Scanned | 2024-05-07T14:29:25+00:00 |
URL | https://bdtheque.com/robots.txt |
Redirect | https://www.bdtheque.com/robots.txt |
Redirect Domain | www.bdtheque.com |
Redirect Base | bdtheque.com |
Domain IPs | 213.186.33.17 |
Redirect IPs | 2001:41d0:1:1b00:213:186:33:17, 213.186.33.17 |
Response IP | 213.186.33.17 |
Found | Yes |
Hash | 1864d8629c0964e25c2f0462b01effcda02f82876a225b2f35997993f2297ebf |
SimHash | 01109f79dfb2 |
Groups
*
Rule | Path |
---|---|
Disallow | /series/modifieravis/* |
Disallow | /series/avis/* |
Disallow | /series2/* |
Disallow | /posteurs/* |
Disallow | /forums/modifiermessage/* |
Disallow | /forums/creermessage/* |
Disallow | /admin/* |
Disallow | /recherche/* |
Allow | /recherche/series/theme* |
Allow | /recherche/series/editeur* |
Allow | /recherche/series/auteurs* |
Allow | /recherche/series/collection* |
Disallow | /recherche/series/theme*%2C* |
Disallow | /recherche/series/editeur*%2C* |
Disallow | /recherche/series/auteurs*%2C* |
Disallow | /recherche/series/collection*%2C* |
Disallow | /recherche/series/theme*/* |
Disallow | /recherche/series/editeur*/* |
Disallow | /recherche/series/auteurs*/* |
Disallow | /recherche/series/collection*/* |
Disallow | /series/*/0$ |
Disallow | /series/*/1$ |
Disallow | /series/*/2$ |
Disallow | /series/*/3$ |
Disallow | /series/*/4$ |
Disallow | /series/*/5$ |
Disallow | /series/*/9$ |
Disallow | /series/*/*/*/*$ |