dilbert-viewer.herokuapp.com
robots.txt

Robots Exclusion Standard data for dilbert-viewer.herokuapp.com

Resource Scan

Scan Details

Site Domain dilbert-viewer.herokuapp.com
Base Domain dilbert-viewer.herokuapp.com
Scan Status Ok
Last Scan2025-06-24T02:20:55+00:00
Next Scan 2025-07-24T02:20:55+00:00

Last Scan

Scanned2025-06-24T02:20:55+00:00
URL https://dilbert-viewer.herokuapp.com/robots.txt
Domain IPs 174.129.128.48, 18.211.231.38, 54.205.8.205, 54.235.77.118
Response IP 18.211.231.38
Found Yes
Hash 55fbefb1d7f9f61e336f2a5584ab2c24490b5eee84f1d731d04b29878bd92260
SimHash b325ff48cf31

Groups

*

Rule Path
Disallow /random

Comments

  • SPDX-FileCopyrightText: 2022 Harish Rajagopal <harish.rajagopals@gmail.com>
  • SPDX-License-Identifier: CC0-1.0
  • Disallow crawling the randomly-generated page