InfoWorld AI·
Three key advantages of SLMs Division of labor: Modern AI architecture uses routers to send routine tasks to 7B-parameter SLMs, reserving trillion-parameter LLMs only for complex reasoning. Economic efficiency: For high-volume, repetitive tasks, SLMs can reduce cloud inference costs by up to 90% while providing near-instant latency. Privacy at the edge: Because SLMs can run locally on-device or on-premises, they reduce the data leakage risks inherent in sending sensitive telemetry to the public cloud. Large language models (LLMs) are the workhorses of AI, supporting ever more sophisticated capabilities and workflows, and approaching near-human level performance. But sometimes more isn’t always better — it’s just more. Specialized data and limited capabilities are just fine for some workflows. This realization is driving the evolution of small language models (SLMs), rather than one-size-fits-all LLMs. SLMs — coming in the form of domain-specific models, statistical langua
Read full articleThe Chief AI Council is identifying pain points for agencies to understand and avoid around everything from AI and cybersecurity to IT procurement and privacy.
Teradata has launched its Autonomous Knowledge Platform, a new flagship offering that brings together data, analytics, AI development, agent orchestration, and governance across cloud, on-premises, and hybrid environments. The target customer is an enterprise that has moved beyond testing AI assistants and is now asking harder questions: which data agents can use, what actions they can take, how much they will cost to run, and who is accountable when something goes wrong. The company said the platform builds on its existing database engine and governance infrastructure, while adding new capabilities and more tightly integrating existing ones, including AI Studio, the Tera natural-language workspace, Tera Agents, Elastic Compute on Teradata Cloud, and the upcoming Teradata Factory for on-premises AI workloads. Teradata is entering a competitive market with this. Snowflake, Databricks, Microsoft, Oracle, and Salesforce are all trying to persuade customers that their platforms should beco
Learn how ChatGPT safeguards your privacy, reduces personal data in training, and gives you control over whether your conversations improve AI models.
Google says it respects user privacy in AI, but the reality is not so black and white.
Learn how to eranscribe audio locally using Faster‑Whisper and Python, with an emphasis on privacy‑first and CPU/GPU‑ready.
Apps that record visits are becoming popular, but they come with privacy and accuracy concerns.
The supplier of license plate readers and other public safety tech has come under fire for privacy, immigration, data sharing and other concerns. The new tool aims to ease some of the worries about Flock’s products.
The AI boom has hit across industries, and public sector organizations are facing pressure to accelerate adoption. At the same time, government institutions face distinct constraints around security, governance, and operations that set them apart from their business counterparts. For this reason, purpose-built small language models (SLMs) offer a promising path to operationalize AI in…
