nikoncafe.com
robots.txt

Robots Exclusion Standard data for nikoncafe.com

Resource Scan

Scan Details

Site Domain nikoncafe.com
Base Domain nikoncafe.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-12T06:12:25+00:00
Next Scan 2025-01-10T06:12:25+00:00

Last Successful Scan

Scanned2023-09-19T05:01:41+00:00
URL https://nikoncafe.com/robots.txt
Redirect https://www.nikoncafe.com/robots.txt
Redirect Domain www.nikoncafe.com
Redirect Base nikoncafe.com
Domain IPs 104.16.248.51, 104.16.249.51
Redirect IPs 104.17.97.5, 104.17.98.5, 2606:4700::6811:6105, 2606:4700::6811:6205
Response IP 104.17.97.5
Found Yes
Hash b23f4372406983168f61d81a977b1290ea2f2e91dfe30395df1b267e32c3fb44
SimHash 0459ce60ea24

Groups

*

Rule Path
Disallow /find-new/
Disallow /account/
Disallow /goto/
Disallow /help/
Disallow /posts/
Disallow /register/
Disallow /login/
Disallow /conversations/
Disallow /tags/
Disallow /accounts/
Disallow /online/
Disallow /members/
Disallow /admin.php
Disallow /*best-posts$
Allow /

Other Records

Field Value
sitemap https://www.nikoncafe.com/sitemap.php