• One of the big AI challenges is increasing the attention window of LLMs, as most base models can only handle inputs of up to 4,000 tokens (=around 3,000 words) – StreamingLLM is a framework that extends it to 4,000,000+ tokens for leading open-source models. - GitHub
• The Writers Guild of America has reached a deal with Hollywood studios regarding the use of AI – the rules they agreed upon (for example, writers can’t be forced to use AI) will likely serve as the first blueprint for how companies approach AI writing. - Axios
• Vector databases are likely coming to all enterprises, as they enable better experiences for end-users – AI has fueled vector database growth because they’re the only ones that can handle the demands of AI development. - John Hwang (opinion), Vercel (vector db explanation)
• Over 25% of scientists believe AI will become essential to their field by 2033 – hallucinations, creating risk of inaccuracies and misinformation, emerge as one of the biggest problems that scientists see with using AI in research. - Nature
• The first AI device from Humane will be unveiled on November 9 – it’s a wearable, standalone pin that’s supposed to be the first post-smartphone mobile device, and it’ll be interesting to see if it actually delivers any value. - Humane
• Several other AI wearables were announced this week, and the most promising one is the Whoop coach – built in partnership with OpenAI, it learns about you from detailed health data collected by the Whoop and provides personalized health and fitness coaching. - Whoop
• Amazon Bedrock is now in general availability – basically, if your company lives on AWS, then this is probably the right managed generative AI service for you because it will play nicely with other AWS services. - TechCrunch
• Incredible impact in just a few months – Meta says there have been 7,000+ Llama-based projects on Hugging Face and GitHub, Google Cloud and AWS have seen over 3,500 enterprise projects based on Llama 2, showcasing the power of open source AI development. - Meta
