thecurrent.com
robots.txt

Robots Exclusion Standard data for thecurrent.com

Resource Scan

Scan Details

Site Domain thecurrent.com
Base Domain thecurrent.com
Scan Status Ok
Last Scan2024-09-21T04:07:24+00:00
Next Scan 2024-10-05T04:07:24+00:00

Last Scan

Scanned2024-09-21T04:07:24+00:00
URL https://thecurrent.com/robots.txt
Redirect https://www.thecurrent.com/robots.txt
Redirect Domain www.thecurrent.com
Redirect Base thecurrent.com
Domain IPs 108.156.133.18, 108.156.133.56, 108.156.133.87, 108.156.133.9, 2600:9000:2755:3c00:2:9a1a:ac0:93a1, 2600:9000:2755:6a00:2:9a1a:ac0:93a1, 2600:9000:2755:7000:2:9a1a:ac0:93a1, 2600:9000:2755:7e00:2:9a1a:ac0:93a1, 2600:9000:2755:b600:2:9a1a:ac0:93a1, 2600:9000:2755:ca00:2:9a1a:ac0:93a1, 2600:9000:2755:d600:2:9a1a:ac0:93a1, 2600:9000:2755:da00:2:9a1a:ac0:93a1
Redirect IPs 104.22.70.150, 104.22.71.150, 172.67.38.153, 2606:4700:10::6816:4696, 2606:4700:10::6816:4796, 2606:4700:10::ac43:2699
Response IP 172.67.38.153
Found Yes
Hash 0288dc7d427fa95f6420637090b2fb2baa6c9accedab83a9f565936cc693c091
SimHash 45448c64c733

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.thecurrent.com/sitemap.xml
sitemap https://www.thecurrent.com/server-sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.