TLDR AI 2024-04-29

Apple & OpenAI 🤝, Cohere Developer Toolkit ⚒️, Federal AI Safety Board 🦺

🚀
Headlines & Launches

Apple And OpenAI Are Reportedly In Talks For iOS 18 Integration (1 minute read)

Apple is currently exploring partnerships with various AI providers, including OpenAI and Google, to integrate generative AI technologies into the upcoming iOS 18.

Cohere Launches Developer Toolkit to Accelerate Build Gen AI Apps (3 minute read)

Cohere launched a new developer toolkit to make enterprise AI application building faster and simpler across any cloud provider so developers can deploy in production at scale. With the Cohere Toolkit, developers have the source code to accelerate their development and quickly set up an application within just a few days.

The little smart home platform that could (8 minute read)

Home Assistant has joined the Open Home Foundation, a non-profit aimed at countering Big Tech's influence by prioritizing privacy, choice, and sustainability in the smart home domain. The transition to a foundation-owned entity allows the platform to scale its consumer appeal while retaining its core open-source principles. Upcoming developments include direct-to-consumer sales on Amazon, certified partner expansions, local voice control hardware, AI integration with Nvidia, and user interface improvements for broader home approval.
🧠
Research & Innovation

Let's think dot by dot (23 minute read)

This paper shows that chain-of-thought (CoT) thinking can be obfuscated with ‘...' tokens. This requires training the model but shows that interpreting the CoT steps may not be possible and thinking can be hidden by the model.

Video-Language models with PLLaVA (4 minute read)

Researchers have introduced a new model called PLLaVA, which stands out by adapting image-language AI models for video tasks using a unique pooling strategy.

TrackGPT: Object Tracking with Instruction-Based Technique (15 minute read)

TrackGPT integrates Large Vision-Language Model capabilities to transform object tracking. It understands implicit instructions for tracking, streamlining the process and enhancing performance, as shown in its impressive results on the new InsTrack benchmark and other challenging datasets.
👨‍💻
Engineering & Resources

torchtitan (GitHub Repo)

Pretraining framework for Llama models from Meta written entirely in PyTorch.

Luminal deep learning framework (GitHub Repo)

A fast deep learning framework built with speed and simplicity in mind.

OpenLit (GitHub Repo)

OpenLIT is an OpenTelemetry-native GenAI and LLM Application Observability tool designed to make the integration process of observability into GenAI projects possible with just a single line of code.
🎁
Miscellaneous

Learn Unseen Things (GitHub Repo)

Researchers have developed a new method called AAPL that enhances the ability of AI models so that they can recognize unseen objects by using adversarial token embedding.

FrugalGPT (13 minute read)

FrugalGPT is a set of actions you can take to dramatically reduce LLM API costs. They include prompt compression, caching, and more.

Llamafile 2x speed update (11 minute read)

Llamafiles are self-contained executables that run models directly on any platform. It boasts a 2x speed up and substantial improvements to portability.
⚡️
Quick Links

AI Flashcards (Product)

Create personalized flashcards from any text or file using AI.

Jensen Huang And Sam Altman Invited To Federal AI Safety Board (2 minute read)

The U.S. Department of Homeland Security has formed the Artificial Intelligence Safety and Security Board, which features leaders from major tech companies and various sectors, to advise on AI issues including national security and infrastructure, with quarterly meetings starting in May.

Run AI town completely locally with Llama 3 (GitHub Repo)

AI town is a simulator of human interactions that can run entirely locally.
The most important AI, ML, and data science news in a free daily email.
Join 500,000 readers for