papers.bar
robots.txt

Robots Exclusion Standard data for papers.bar

Resource Scan

Scan Details

Site Domain papers.bar
Base Domain papers.bar
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2/13/2025, 8:56:32 AM
Next Scan 5/14/2025, 8:56:32 AM

Last Successful Scan

Scanned9/30/2023, 8:54:32 AM
URL https://papers.bar/robots.txt
Redirect https://bio.papers.bar/robots.txt
Redirect Domain bio.papers.bar
Redirect Base papers.bar
Domain IPs 104.21.38.112, 172.67.222.68, 2606:4700:3030::ac43:de44, 2606:4700:3034::6815:2670
Redirect IPs 104.21.38.112, 172.67.222.68, 2606:4700:3030::ac43:de44, 2606:4700:3034::6815:2670
Response IP 172.67.222.68
Found Yes
Hash eac97b830aa4fa42143129579b70a5a72b1c0c00777ddbf133a7bbebfa3dce7e
SimHash 4d105404cd92

Groups

*

Rule Path
Disallow /api/

Other Records

Field Value
sitemap https://papers.labml.ai/sitemap/sitemap.xml