sciencefocus.com
robots.txt

Robots Exclusion Standard data for sciencefocus.com

Resource Scan

Scan Details

Site Domain sciencefocus.com
Base Domain sciencefocus.com
Scan Status Ok
Last Scan2024-11-15T18:16:29+00:00
Next Scan 2024-11-22T18:16:29+00:00

Last Scan

Scanned2024-11-15T18:16:29+00:00
URL https://sciencefocus.com/robots.txt
Redirect https://www.sciencefocus.com/robots.txt
Redirect Domain www.sciencefocus.com
Redirect Base sciencefocus.com
Domain IPs 3.124.189.64
Redirect IPs 18.165.183.108, 18.165.183.118, 18.165.183.2, 18.165.183.39, 2600:9000:23d1:1600:d:4c13:4b40:93a1, 2600:9000:23d1:1e00:d:4c13:4b40:93a1, 2600:9000:23d1:2000:d:4c13:4b40:93a1, 2600:9000:23d1:2600:d:4c13:4b40:93a1, 2600:9000:23d1:4600:d:4c13:4b40:93a1, 2600:9000:23d1:6200:d:4c13:4b40:93a1, 2600:9000:23d1:7000:d:4c13:4b40:93a1, 2600:9000:23d1:800:d:4c13:4b40:93a1
Response IP 18.165.140.39
Found Yes
Hash 6dd3ef40439076cdd704ecbb64f8d4fb7588eac7a5d03b8a2cbb5dc502e9fb6c
SimHash 69019862c393

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.sciencefocus.com/sitemap/index.xml.gz
sitemap https://www.sciencefocus.com/sitemap/news.xml.gz