jeune-gay.fr
robots.txt
Robots Exclusion Standard data for jeune-gay.fr
Resource Scan
Scan Details
Site Domain | jeune-gay.fr |
Base Domain | jeune-gay.fr |
Scan Status | Ok |
Last Scan | 2024-11-14T01:58:23+00:00 |
Next Scan | 2024-12-14T01:58:23+00:00 |
Last Scan
Scanned | 2024-11-14T01:58:23+00:00 |
URL | https://jeune-gay.fr/robots.txt |
Redirect | https://www.jeune-gay.fr/robots.txt |
Redirect Domain | www.jeune-gay.fr |
Redirect Base | jeune-gay.fr |
Domain IPs | 104.21.33.205, 172.67.149.132, 2606:4700:3030::ac43:9584, 2606:4700:3037::6815:21cd |
Redirect IPs | 104.21.33.205, 172.67.149.132, 2606:4700:3030::ac43:9584, 2606:4700:3037::6815:21cd |
Response IP | 104.21.33.205 |
Found | Yes |
Hash | 313072466a1e57bec7ad1d2aec10c8a64dbcb78f2e794b1929288267bc79e451 |
SimHash | 4825dc8aad80 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /feed/ |
Disallow | /comments/feed/ |
Disallow | /*/feed/$ |
Disallow | /blog/ |
Disallow | /author/ |
Disallow | /*/feed/rss/$ |
Disallow | /*/trackback/$ |
Disallow | /*/*/feed/$ |
Disallow | /*/*/feed/rss/$ |
Disallow | /*/*/trackback/$ |
Disallow | /*/*/*/feed/$ |
Disallow | /*/*/*/feed/rss/$ |
Disallow | /*/*/*/trackback/$ |
Disallow | /*?filtre=* |
Disallow | /*?*p=* |
Disallow | /*?*o=* |
Disallow | /*?repeat=* |
Disallow | /search/ |
Disallow | /sld/ |