bis.se
robots.txt

Robots Exclusion Standard data for bis.se

Resource Scan

Scan Details

Site Domain bis.se
Base Domain bis.se
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-10-02T20:08:11+00:00
Next Scan 2024-10-09T20:08:11+00:00

Last Successful Scan

Scanned2024-09-01T20:08:04+00:00
URL https://www.bis.se/robots.txt
Domain IPs 13.225.4.22, 13.225.4.37, 13.225.4.39, 13.225.4.82, 2600:9000:21b4:2800:1a:9c9a:4b40:93a1, 2600:9000:21b4:4000:1a:9c9a:4b40:93a1, 2600:9000:21b4:4e00:1a:9c9a:4b40:93a1, 2600:9000:21b4:5600:1a:9c9a:4b40:93a1, 2600:9000:21b4:9200:1a:9c9a:4b40:93a1, 2600:9000:21b4:c200:1a:9c9a:4b40:93a1, 2600:9000:21b4:ee00:1a:9c9a:4b40:93a1, 2600:9000:21b4:f200:1a:9c9a:4b40:93a1
Response IP 13.225.4.82
Found Yes
Hash bbb0c2d0fd18cf7e3b2147ea4d171e6eb6303a12b4a071b7e790acaba2d3e2f4
SimHash 4810ca02e732

Groups

*

Rule Path
Disallow /api/

*

Rule Path
Allow /

Comments

  • Block all crawlers
  • Allow all crawlers