Skip to main content

Envisioning is an emerging technology research institute and advisory.

LinkedInInstagramGitHub

2011 — 2026

research
  • Observatory
  • Newsletter
  • Methodology
  • Origins
  • Vocab
services
  • Signals Session
  • Bespoke Projects
  • Build Sessions
  • Use Cases
  • Readinessfree
  • Signals
  • Free scan↗free
impact
  • ANBIMAFuture of Brazilian Capital Markets
  • IEEECharting the Energy Transition
  • Horizon 2045Future of Human and Planetary Security
  • WKOTechnology Scanning for Austria
solutions
  • Innovation
  • Strategy
  • Consultants
  • Foresight
  • Associations
  • Governments
resources
  • Partners
  • Coding for Non-Coders
  • How We Work
  • Data Visualization
  • Multi-Model Method
  • FAQ
  • Security & Privacy
about
  • Manifesto
  • Community
  • Events
  • Support
  • Contact
ResearchServicesSignalsAbout
ResearchServicesSignalsAbout
  1. Home
  2. Research
  3. Prism
  4. Transformer-based LLMs

Transformer-based LLMs

Neural networks that generate human-like text, code, and summaries using attention mechanisms
Back to PrismView interactive version

Transformer-based LLMs use attention mechanisms, massive token corpora, and reinforcement learning from human feedback to generate context-aware text, code, and multimodal descriptions. Fine-tuning and retrieval augmentation tailor them to domains ranging from screenwriting to compliance documentation. Tooling layers add guardrails, prompt management, and integration hooks into CMS, productivity suites, or creative software.

Media companies embed LLMs inside writers’ rooms as brainstorming partners, summarization assistants, or localization engines. Customer-support avatars use them to stay on-brand, and interactive fiction platforms let fans converse with characters. Because they understand instructions, LLMs orchestrate other AI services—handing off to image models, scheduling engines, or analytics dashboards.

At TRL 9, attention shifts to governance: watermarking outputs, auditing bias, and tracking training data provenance. Regulatory regimes (EU AI Act, US executive orders) push for transparency and optionality. The market trends toward specialized, smaller models fine-tuned for latency-sensitive workflows, while open-source alternatives give studios more control. LLMs are now a permanent layer in the media stack, akin to databases or render farms, requiring ongoing stewardship rather than one-off deployment.

TRL
9/9Established
Impact
5/5
Investment
5/5
Category
Software

Related Organizations

Google DeepMind logo
Google DeepMind

United Kingdom · Research Lab

100%

Developers of the Gemini family of models, which are trained from the start to be multimodal across text, images, video, and audio.

Developer
OpenAI logo

OpenAI

United States · Company

100%

Creator of GPT-4o, a natively multimodal model capable of reasoning across audio, vision, and text in real-time.

Developer
Anthropic logo
Anthropic

United States · Company

95%

An AI safety and research company developing Constitutional AI to align models with human values.

Developer
Hugging Face logo
Hugging Face

United States · Company

95%

The global hub for open-source AI models and datasets. Founded by French entrepreneurs with a major office in Paris.

Deployer
Meta logo
Meta

United States · Company

95%

Developer of the Llama series of open-source LLMs.

Developer
Cohere logo
Cohere

Canada · Startup

90%

Enterprise AI platform focusing on secure and aligned language models.

Developer
EleutherAI logo
EleutherAI

United States · Nonprofit

90%

A non-profit AI research lab that maintains the LM Evaluation Harness, a standard benchmark suite for LLMs.

Researcher
Mistral AI

France · Startup

90%

Paris-based champion of open-weight models (Mistral 7B, Mixtral 8x7B) challenging US dominance.

Developer
01.AI

China · Startup

85%

Founded by Kai-Fu Lee, developing the Yi series of open-source models, including Yi-VL (Vision Language).

Developer
AI21 Labs

Israel · Startup

85%

Israeli company developing the Jurassic series of foundation models.

Developer
Aleph Alpha logo
Aleph Alpha

Germany · Startup

85%

German AI startup building sovereign large language models.

Developer
Technology Innovation Institute (TII) logo
Technology Innovation Institute (TII)

United Arab Emirates · Research Lab

85%

Abu Dhabi-based research center behind the Falcon series of open-source LLMs.

Developer
Naver Corp logo
Naver Corp

South Korea · Company

80%

South Korean tech giant developing HyperCLOVA, a massive Korean-centric LLM.

Developer

Supporting Evidence

Evidence data is not available for this technology yet.

Research this in Signals

Scan Transformer-based LLMs for yourself.

Signals turns a topic into a sourced research record you can inspect and rerun. Your first scan is free, and this one starts with Transformer-based LLMs already loaded, so edit it or scan as is.