cotilleando.com
robots.txt

Robots Exclusion Standard data for cotilleando.com

Resource Scan

Scan Details

Site Domain cotilleando.com
Base Domain cotilleando.com
Scan Status Ok
Last Scan2024-11-14T11:02:31+00:00
Next Scan 2024-11-21T11:02:31+00:00

Last Scan

Scanned2024-11-14T11:02:31+00:00
URL https://cotilleando.com/robots.txt
Redirect https://www.cotilleando.com/robots.txt
Redirect Domain www.cotilleando.com
Redirect Base cotilleando.com
Domain IPs 104.26.0.66, 104.26.1.66, 172.67.73.212, 2606:4700:20::681a:142, 2606:4700:20::681a:42, 2606:4700:20::ac43:49d4
Redirect IPs 104.26.0.66, 104.26.1.66, 172.67.73.212, 2606:4700:20::681a:142, 2606:4700:20::681a:42, 2606:4700:20::ac43:49d4
Response IP 104.26.1.66
Found Yes
Hash 57ac455f15879e9e304036e4bce375cfee7859d2a03476bf5d5dd3308d19f74b
SimHash 2137cc72e793

Groups

boardreader

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

boardtracker

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /goto/

*

Rule Path
Disallow /cgi-bin/
Disallow /cdn-cgi/
Disallow /_private/
Disallow /_vti_bin/
Disallow /_vti_cnf/
Disallow /_vti_log/
Disallow /_vti_pvt/
Disallow /_vti_txt/
Disallow /account/
Disallow /admin.php
Disallow /ajax/
Disallow /members/
Disallow /alerts/
Disallow /conversations/
Disallow /goto/link-confirmation
Disallow /goto/*
Disallow /help/
Disallow /internal_data/
Disallow /js/
Disallow /library/
Disallow /login/
Disallow /lost-password/
Disallow /misc/contact/
Disallow /members/
Disallow /online/
Disallow /recent-activity/
Disallow /register/
Disallow /posts/*
Disallow /search/
Disallow /threads/*/post-*
Allow /posts/*/show
Allow /

Other Records

Field Value
sitemap https://www.cotilleando.com/sitemap.php