bis.se
robots.txt

Robots Exclusion Standard data for bis.se

Resource Scan

Scan Details

Site Domain bis.se
Base Domain bis.se
Scan Status Ok
Last Scan2024-06-03T20:07:19+00:00
Next Scan 2024-07-03T20:07:19+00:00

Last Scan

Scanned2024-06-03T20:07:19+00:00
URL https://bis.se/robots.txt
Redirect https://www.bis.se/robots.txt
Redirect Domain www.bis.se
Redirect Base bis.se
Domain IPs 108.157.229.108, 108.157.229.16, 108.157.229.22, 108.157.229.33, 2600:9000:2574:5200:1a:9c9a:4b40:93a1, 2600:9000:2574:6a00:1a:9c9a:4b40:93a1, 2600:9000:2574:c400:1a:9c9a:4b40:93a1, 2600:9000:2574:e00:1a:9c9a:4b40:93a1, 2600:9000:2574:e400:1a:9c9a:4b40:93a1, 2600:9000:2574:f200:1a:9c9a:4b40:93a1, 2600:9000:2574:f400:1a:9c9a:4b40:93a1, 2600:9000:2574:fe00:1a:9c9a:4b40:93a1
Redirect IPs 108.157.254.38, 108.157.254.51, 108.157.254.63, 108.157.254.92, 2600:9000:2753:1200:1a:9c9a:4b40:93a1, 2600:9000:2753:1a00:1a:9c9a:4b40:93a1, 2600:9000:2753:3000:1a:9c9a:4b40:93a1, 2600:9000:2753:4400:1a:9c9a:4b40:93a1, 2600:9000:2753:4800:1a:9c9a:4b40:93a1, 2600:9000:2753:6a00:1a:9c9a:4b40:93a1, 2600:9000:2753:9200:1a:9c9a:4b40:93a1, 2600:9000:2753:e000:1a:9c9a:4b40:93a1
Response IP 108.157.254.51
Found Yes
Hash bbb0c2d0fd18cf7e3b2147ea4d171e6eb6303a12b4a071b7e790acaba2d3e2f4
SimHash 4810ca02e732

Groups

*

Rule Path
Disallow /api/

*

Rule Path
Allow /

Comments

  • Block all crawlers
  • Allow all crawlers