18upchoti.com
robots.txt

Robots Exclusion Standard data for 18upchoti.com

Resource Scan

Scan Details

Site Domain 18upchoti.com
Base Domain 18upchoti.com
Scan Status Ok
Last Scan2024-11-14T00:14:21+00:00
Next Scan 2024-11-21T00:14:21+00:00

Last Scan

Scanned2024-11-14T00:14:21+00:00
URL https://18upchoti.com/robots.txt
Redirect https://www.18upchoti.com/robots.txt
Redirect Domain www.18upchoti.com
Redirect Base 18upchoti.com
Domain IPs 104.21.34.154, 172.67.205.231, 2606:4700:3031::ac43:cde7, 2606:4700:3036::6815:229a
Redirect IPs 104.21.34.154, 172.67.205.231, 2606:4700:3031::ac43:cde7, 2606:4700:3036::6815:229a
Response IP 172.67.205.231
Found Yes
Hash 5a28115fe264fa876cbc620fab9d0d5cc7dbb173527946e94a03628f84135285
SimHash 67db51602f01

Groups

aspiegelbot
dotbot
mauibot
proximi
proximic
blexbot
adsbot
seznambot

Rule Path
Disallow /
Disallow /online/
Disallow /account/
Disallow /goto/
Disallow /posts/
Disallow /members/*/
Disallow /members/
Disallow /goto/
Disallow /posts/
Disallow /conversations/
Disallow /lost-password/
Disallow /media/category/
Disallow /media/keyword/
Disallow /media/user/
Disallow /media/service/
Disallow /media/submit/
Disallow /members/*
Disallow /u/*
Disallow /media/
Disallow /media/albums/
Disallow /u/*/
Disallow /u/
Disallow /pages/*
Disallow /login/
Disallow /redirect?*
Disallow /help/
Disallow /admin.php
Disallow /misc/
Disallow /help/

amazonbot

Rule Path
Disallow /online/
Disallow /account/
Disallow /goto/
Disallow /posts/
Disallow /members/*/
Disallow /members/
Disallow /goto/
Disallow /posts/
Disallow /conversations/
Disallow /lost-password/
Disallow /media/category/
Disallow /media/keyword/
Disallow /media/user/
Disallow /media/service/
Disallow /media/submit/
Disallow /members/*
Disallow /u/*
Disallow /media/
Disallow /media/albums/
Disallow /u/*/
Disallow /u/
Disallow /pages/*
Disallow /login/
Disallow /redirect?*
Disallow /help/
Disallow /admin.php
Disallow /misc/
Disallow /help/

googlebot
bingbot
yandex
yandexbot
gptbot

Rule Path
Disallow /online/
Disallow /account/
Disallow /goto/
Disallow /posts/
Disallow /members/*/
Disallow /members/
Disallow /goto/
Disallow /posts/
Disallow /conversations/
Disallow /lost-password/
Disallow /media/category/
Disallow /media/keyword/
Disallow /media/user/
Disallow /media/service/
Disallow /media/submit/
Disallow /members/*
Disallow /u/*
Disallow /media/
Disallow /media/albums/
Disallow /u/*/
Disallow /u/
Disallow /pages/*
Disallow /login/
Disallow /redirect?*
Disallow /help/
Disallow /admin.php
Disallow /misc/
Disallow /help/
Allow /

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /online/
Disallow /account/
Disallow /goto/
Disallow /posts/
Disallow /members/*/
Disallow /members/
Disallow /goto/
Disallow /posts/
Disallow /conversations/
Disallow /lost-password/
Disallow /media/category/
Disallow /media/keyword/
Disallow /media/user/
Disallow /media/service/
Disallow /media/submit/
Disallow /members/*
Disallow /u/*
Disallow /media/
Disallow /media/albums/
Disallow /u/*/
Disallow /u/
Disallow /pages/*
Disallow /login/
Disallow /redirect?*
Disallow /help/
Disallow /admin.php
Disallow /misc/
Disallow /help/
Allow /

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.18upchoti.com/sitemap.xml