todaycycling.com
robots.txt
Robots Exclusion Standard data for todaycycling.com
Resource Scan
Scan Details
| Site Domain | todaycycling.com |
| Base Domain | todaycycling.com |
| Scan Status | Ok |
| Last Scan | 2024-06-03T18:50:46+00:00 |
| Next Scan | 2024-06-10T18:50:46+00:00 |
Last Scan
| Scanned | 2024-06-03T18:50:46+00:00 |
| URL | https://todaycycling.com/robots.txt |
| Domain IPs | 2001:41d0:301::26, 46.105.204.26 |
| Response IP | 46.105.204.26 |
| Found | Yes |
| Hash | d773a6f15e8ce48ac729a1bb3112951f2641d3898de9571a41359f92184c0c9f |
| SimHash | 5c809902e836 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /statistiques/api* |
| Disallow | /forum/captcha.php |
| Disallow | /forum/modcp.php |
| Disallow | /forum/moderation.php |
| Disallow | /forum/printthread.php |
| Disallow | /forum/task.php |
| Disallow | /forum/archive* |
| Disallow | /forum/online.php |
| Disallow | /forum/calendar.php |
| Disallow | /forum/reputation.php |
| Disallow | /forum/*nextoldest* |
| Disallow | /forum/*nextnewest* |
| Disallow | /forum/*datecut* |
| Disallow | /forum/*lastpost* |
| Disallow | /forum/*markread* |
| Disallow | /forum/ratethread.php |
| Disallow | /forum/report.php |
| Disallow | /forum/sendthread.php* |
| Disallow | /forum/usercp.php* |
| Disallow | /forum/usercp2.php* |
| Disallow | /forum/newreply.php* |
| Disallow | /forum/newthread.php* |
| Disallow | /forum/editpost.php |
| Disallow | /forum/private.php |
| Disallow | /forum/search.php |
| Disallow | /forum/memberlist.php |
| Disallow | /forum/showteam.php |
| Disallow | /forum/stats.php |
| Disallow | /forum/showratings.php |
| Disallow | /forum/syndication.php* |
| Disallow | /forum/misc.php |
| Disallow | /forum/*sortby* |
| Disallow | /forum/*action%3Demailuser* |
| Disallow | /forum/*action%3Dnextnewest* |
| Disallow | /forum/*action%3Dnextoldest* |
| Disallow | /forum/*year%3D* |
| Disallow | /forum/*action%3Dweekview* |
| Disallow | /forum/*action%3Dnextnewest* |
| Disallow | /forum/*action%3Dnextoldest* |
| Disallow | /forum/*sort%3D* |
| Disallow | /forum/*order%3D* |
| Disallow | /forum/*mode%3D* |
| Disallow | /forum/*datecut%3D* |
| Disallow | /forum/usuario-*?action=emailuser |
| Disallow | /forum/ratethread.php |
| Disallow | /forum/attachment.php |
| Disallow | /forum/usercp.php |
| Disallow | /forum/usercp2.php |
| Disallow | /forum/ratethread.php |
| Disallow | /forum/private.php |
| Disallow | /forum/User-*action%3Demailuser |
| Disallow | /forum/*.php* |
| Disallow | /forum/admin* |
| Disallow | /marketplace/wp-login.php |
| Disallow | /marketplace/wp-admin* |
| Disallow | /wp-login.php |
| Disallow | /*trackback |
| Disallow | /*/feed |
| Disallow | /*/comments |
| Disallow | /cgi-bin |
| Disallow | /*.php$ |
| Disallow | /*.inc$ |
| Disallow | /*.gz |
| Disallow | /*.cgi |
| Allow | /wp-admin/admin-ajax.php |