statlab.com
robots.txt

Robots Exclusion Standard data for statlab.com

Resource Scan

Scan Details

Site Domain statlab.com
Base Domain statlab.com
Scan Status Ok
Last Scan2024-05-23T05:19:23+00:00
Next Scan 2024-06-22T05:19:23+00:00

Last Scan

Scanned2024-05-23T05:19:23+00:00
URL https://statlab.com/robots.txt
Domain IPs 104.26.6.135, 104.26.7.135, 172.67.72.179, 2606:4700:20::681a:687, 2606:4700:20::681a:787, 2606:4700:20::ac43:48b3
Response IP 104.26.7.135
Found Yes
Hash b0c976d5f581d16454ce6ac39db171cbb8240cf3e6f400aa09629175b079b50c
SimHash 6949d7a77691

Groups

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

slurp

Rule Path
Allow /

semrushbot

Rule Path
Allow /

splitsignalbot

Rule Path
Allow /

siteauditbot

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.statlab.com/sitemap.xml