cotilleando.com
robots.txt

Robots Exclusion Standard data for cotilleando.com

Resource Scan

Scan Details

Site Domain cotilleando.com
Base Domain cotilleando.com
Scan Status Ok
Last Scan2024-05-22T19:21:40+00:00
Next Scan 2024-05-29T19:21:40+00:00

Last Scan

Scanned2024-05-22T19:21:40+00:00
URL https://cotilleando.com/robots.txt
Redirect https://www.cotilleando.com/robots.txt
Redirect Domain www.cotilleando.com
Redirect Base cotilleando.com
Domain IPs 104.26.0.66, 104.26.1.66, 172.67.73.212, 2606:4700:20::681a:142, 2606:4700:20::681a:42, 2606:4700:20::ac43:49d4
Redirect IPs 104.26.0.66, 104.26.1.66, 172.67.73.212, 2606:4700:20::681a:142, 2606:4700:20::681a:42, 2606:4700:20::ac43:49d4
Response IP 104.26.1.66
Found Yes
Hash c30b1cd7f15c3b09c087f6eca6e666ab166e1708646432834727485c8a66dd65
SimHash 2177cc7a6793

Groups

boardreader

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

boardtracker

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /cdn-cgi/
Disallow /_private/
Disallow /_vti_bin/
Disallow /_vti_cnf/
Disallow /_vti_log/
Disallow /_vti_pvt/
Disallow /_vti_txt/
Disallow /account/
Disallow /admin.php
Disallow /ajax/
Disallow /members/
Disallow /alerts/
Disallow /conversations/
Disallow /goto/link-confirmation
Disallow /help/
Disallow /internal_data/
Disallow /js/
Disallow /library/
Disallow /login/
Disallow /lost-password/
Disallow /misc/contact/
Disallow /members/
Disallow /online/
Disallow /recent-activity/
Disallow /register/
Disallow /posts/*
Disallow /search/
Allow /posts/*/show
Allow /

Other Records

Field Value
sitemap https://www.cotilleando.com/sitemap.php