Open Model Watch: find exposed self-hosted LLM endpoints before attackers run up your bill
Scans a company's IP ranges and cloud accounts for unauthenticated model servers and alerts on abnormal spend. Fintech security teams pay.
Competitive · Symantec finds agent hijacking open LLMs
Written for: Small startup team
Next step
Call the CISO of a European fintech that has moved models onto its own GPUs, such as one featured at GTC Berlin. Ask whether they have an inventory of every model server their teams have started and who checks it.
Why now
Banks and payment firms are moving onto open-weight models on their own infrastructure, and tools like capy-flash make it easy to start a 125B model on spare GPUs. Many of those servers expose an OpenAI-compatible API with no authentication. Hijacked endpoints now carry two costs: the compute bill, and the endpoint showing up as the source of attacks. Most existing scanners do not specifically check for open model endpoints yet.
What became possible
Symantec found an offensive agent that hijacks unprotected language-model endpoints and uses them to run attacks for up to 100,000 steps. The endpoint's owner pays for the compute and becomes the apparent source of the attacks.
Two ways in
- Endpoint census
Scans from outside and through cloud APIs for Ollama, vLLM, TGI and OpenAI-compatible ports. Checks authentication, which model is loaded and how much traffic it serves, and maps each endpoint to an owning team.
- Customer
- CISOs at mid-size fintechs and banks running open weights
- Model
- Per-environment monthly subscription
- Spend tripwire
A lightweight sidecar that alerts when token throughput, prompt patterns or tool calls on a self-hosted endpoint look like an autonomous attacker rather than internal users.
- Customer
- The same buyers, and managed security providers serving them
- Model
- Per-endpoint fee
Competition
The endpoint census idea is already taken in pieces. CNAPP and AI-SPM vendors (Wiz, Orca, Palo Alto, Noma) find model servers inside cloud accounts.
Full competition notes (9 competitors)
The endpoint census idea is already taken in pieces. CNAPP and AI-SPM vendors (Wiz, Orca, Palo Alto, Noma) find model servers inside cloud accounts. EASM and vulnerability scanners (Tenable, UpGuard, Indusface) and Shodan, Censys and LeakIX already flag unauthenticated Ollama from the outside. A mid-size fintech CISO who already pays for Wiz or Tenable will see a standalone census as a feature they mostly own. What none of the sources I found show is depth below "Ollama port open". That means vLLM, TGI, SGLang, LiteLLM proxies and generic OpenAI-compatible servers, checking which model is loaded and how much traffic it serves, and mapping each endpoint to the team that owns it. That could work as a wedge, but platforms can add it quickly. The spend tripwire looks much less contested. I found plenty of reporting on LLMjacking against self-hosted servers (GreyNoise, Kaspersky and CSA honeypot data, Sysdig's original research) and plenty of performance and cost observability (Langfuse, vLLM metrics, OpenLIT). I found no product that watches token throughput, prompt patterns and tool calls on a self-hosted endpoint to tell an autonomous attacker apart from internal users. A new entrant's best bet is to lead with that runtime detection. It could be sold as a lightweight sidecar or proxy, or through MSSPs, and feed alerts into the SIEMs banks already run, with the census as the free entry point rather than the main product. The risks are that Noma, Palo Alto (via Protect AI) or Sysdig add the same runtime signal, and that most fintechs run open weights at too small a scale for the spend loss to justify a separate purchase.
- Wiz AI-SPM
Agentless AI-BOM that finds AI services, technologies and SDKs across cloud accounts and flags shadow AI through the Wiz Security Graph. It already covers the cloud-API half of the endpoint census for customers who run Wiz.
- Orca Security AI-SPM
Agentless SideScanning that claims coverage of 50+ AI models and packages, managed and unmanaged, including shadow AI. Overlaps directly with discovering self-hosted model servers inside cloud accounts.
- Palo Alto Networks Cortex Cloud AI-SPM
Finds AI software packages running on cloud workloads and markets this as shadow AI workload discovery. It is bundled into a platform that large banks already buy.
- Tenable Nessus (Ollama Unauthenticated Access plugin)
A March 2026 plugin rates unauthenticated Ollama as critical (CVSS 10.0). Vulnerability scanners that banks already run now detect the most common exposure.
- UpGuard
External attack surface management vendor that scans for exposed Ollama on port 11434 and publishes guidance on fixing it. Overlaps with the outside-in scan.
- Indusface
Says its attack surface discovery finds exposed AI infrastructure, including publicly reachable Ollama servers.
- Noma Security
Funded AI security platform that inventories models, agents and MCP servers and enforces guardrails at runtime. It is the closest single-vendor overlap with both product ideas, though its pitch is guardrails rather than spend or abuse.
- Cisco Talos Shodan research tool
Research Python tool that uses Shodan to find unsecured Ollama endpoints. It shows the scanning technique is well known and easy to copy. It is not a commercial product.
- LeakIX
Internet-wide leak search engine that counts and indexes exposed Ollama instances (12,269 with zero authentication). Gives anyone a ready data source for outside-in checks.
Checked 2026-10-23
Risks
- Attack-surface vendors such as Tenable, Censys and Wiz can add this check quickly, so it may be a feature rather than a company
- Buyers may not believe they run exposed endpoints until an incident proves it
- Thin differentiation once the major scanners catch up
Strong tech readiness and buildability; open space is the weak point (4).
tech 9 · pull 6 · space 4 · fit 7 · build 9
Exposed
Companies that could benefit or be threatened. News and context, not investment advice.
Momentum of its main topic
Sources
- An AI agent in "Skynet mode" hijacks unprotected language models to launch self-sustaining cyberattacksThe Decoder
- Leading European Financial Services Organizations Embrace Open Models to Build Proprietary IntelligenceNVIDIA Blog
- capy-flash v0.7.1: Qwen3.8-Flash-Next (125B MoE) now runs in 64 GB of RAM (234 tok/s on two 16 GB cards), and Qwen3.8-27B 3-bit fits on a single 16 GB card (174 tok/s)r/LocalLLaMA
- Chinese hackers spied on thousands of companies after breaching IT giant ConnectWiseTechCrunch AI
Status history
- 2026-10-23 Flagged as buildable