What each market tends to ask

The United States has no general data residency requirement, but sector rules and customer contracts matter: healthcare data brings business associate agreements and security expectations, government work can bring specific authorization requirements, and state privacy laws shape handling. In the European Union, the GDPR does not mandate residency but restricts transfers outside the European Economic Area unless a mechanism such as an adequacy decision or standard contractual clauses applies, and sovereignty expectations, especially from public bodies, are rising. In Singapore, the PDPA expects organizations transferring personal data overseas to ensure it receives comparable protection, and regulated financial institutions apply outsourcing and technology risk expectations to suppliers.

In practice the sharpest requirements come from customer contracts, not statutes.

Ask each major customer what they actually require. Many accept processing in another region with proper safeguards; others will not.

Decide per data type

Break the question into parts. Prompts and outputs may contain personal or confidential data. Logs and traces may contain both. Embeddings and vector stores can leak information about their source. Encryption keys control access to everything else. Each can be placed differently, and often the keys and the logs matter more to customers than the model call itself.

Check that the model providers you use offer processing in the regions you need, and what retention they apply. Availability of specific models can differ by region.

Data typeTypical concernCommon design choice
Prompts and outputsPersonal or confidential contentProcess in customer's region where required
Logs and tracesPersistent copies of contentStore regionally with short retention
Embeddings and vector storesDerived data can reveal sourcesKeep in-region with the source data
Encryption keysControl and accessRegion-specific keys under customer or regional control

A region-aware architecture

Route requests by tenant or user to the correct regional stack. Keep per-region storage, logs, and keys, and a thin model adapter that can point to a regional endpoint. Make residency a configuration of the tenant, not a fork of the code. Keep infrastructure reproducible so adding a region is a repeatable task.

Document the flows so you can answer a customer's questionnaire accurately. Our guides on EU sovereign hosting and on cloud portability cover the European details.

Designing AI features for customers in several regions? Talk to us about a region-aware architecture.

Key takeaways

  • No market mandates residency in general, but contracts and sector rules often do; ask your major customers.
  • Decide per data type: prompts and outputs, logs, embeddings, and keys.
  • Route by tenant to regional stacks with regional storage, logs, and keys.
  • Make residency configuration, not code forks, and keep infrastructure reproducible.
This is general architecture guidance, not legal advice. Requirements vary by sector and contract; confirm with counsel and check current provider region and retention offerings.