Troubleshooting Helps Restore Telemetry and Avoid Penalties

Whether a resource is large or small, or issues are intermittent or catastrophic, Trimark’s Operations Center helps find and fix the root cause.

When a power generation resource loses its secure data communications link with California’s balancing authority, fines can mount quickly – up to $500 for each day the failure is unreported or unresolved. So, it’s essential to know immediately when a problem occurs, request an exemption, then quickly fix the issue.

Maintaining secure data exchange is critical for power generation resources participating in the open energy market. That’s why Trimark provides service agreements designed specifically to support the telemetry requirements of the California ISO (CAISO) Business Practices Manual (BPM).

When the Trimark Operations Center noticed that our customer, an oil recycling firm in Southern California, was experiencing intermittent communication failures, our team got straight to work.

A Bit of Background

The CAISO requires generation resources to install a Remote Intelligent Gateway (RIG) and join the Energy Communications Network (ECN). Together, the RIG and ECN allow CAISO to see plant status and send secure commands – critical information the ISO needs to manage grid stability.

Because Trimark supports over 1,300 generation resources, our Operations Center can monitor the communication status for each resource in near real time. If a disruption occurs, we alert the operator immediately, often before CAISO sends a notice of non-compliance. That buys valuable time required to find and correct the issue as well as request the temporary exemption required to avoid penalties.

The Challenge

While monitoring our customer’s equipment status, we noticed when their site communications started dropping its connection five times or more every day. As a result, they were not in compliance with the ISO’s telemetry requirements. First, we alerted the owner to the situation, then helped them avoid penalties by preparing an exemption request for time to find and fix the problem.

The next step in our troubleshooting process was to determine if the root cause was caused by equipment at the site or related to the network. AT&T’s assessment showed that their circuit was stable and had not experienced an interruption for several months. AT&T suggested that we confirm that the router had a reliable power supply. With assistance from an on-site resource, we checked that theory by bypassing the uninterruptable power supply (UPS) and providing power directly to AT&T’s router. However, the problem persisted. While we had eliminated two major variables – the circuit and power – we had yet to identify the real culprit. So, we dug deeper.

All’s Well that Ends Well

The next step was to analyze event data captured by the RIG (provided and configured by others). After reviewing the RIG logs (which capture data about events like this), we eventually found that the malfunction was caused by an aging AT&T router. Like most technology, old equipment may show early warning signs of pending failure, such as frequent unprompted restarts.

With solid analytical information in hand, Trimark Operations Center team members coordinated with AT&T to replace the ECN router at the site and successfully closed the non-compliance ticket with the CAISO – thereby avoiding fines and providing the data CAISO requires to manage the grid.

About Trimark

Trimark Associates, Inc. (Trimark), the industry leader in intelligent energy control, complex metering and ISO compliance delivers industry-leading solutions to enable real-time operational control, informed management, and revenue recognition in the open energy market. Trimark’s turnkey products, engineering, and customer support services help control, measure, and manage all aspects of power production that utility-scale power producers require to maintain peak business performance.

Learn more about Trimark Operations Center and services.

Trimark News

Trimark to Exhibit at ESNA ’24

Oct 18, 2023

Trimark will exhibit at Intersolar North America / Energy Storage North America (ESNA) January 17 to 19, 2024 in the…

Learn More
Trimark Finalizes Controls for Phase 1A of World’s Largest PV+BESS Project

Trimark Awarded SCADA for World’s Largest PV+BESS Project

Feb 17, 2021

The Edwards & Sanborn project redefines the utility-scale PV+Storage landscape. Folsom, CA, February 17, 2021 – Trimark Associates, Inc. is…

Learn More

ALERT — SQMD Plan Affirmations Due to CAISO October 31

Aug 29, 2023

Experts say, “Don’t wait to ask for help” Folsom, CA, August 29, 2023 – If your resource participated in the…

Learn More

Trimark Now Supports SEL RTAC and NovaTech Orion RIGs in CAISO Market

Feb 01, 2024

Trimark now supports third-party Remote Intelligent Gateways (RIGs) including the SEL RTAC and NovaTech Orion through the Trimark Operations Center….

Learn More
Names Rajinita Haumschilt

Trimark Names Rajinita Haumschilt as Financial Controller

Apr 28, 2023

Controller to Lead Trimark Accounting Team and Processes Folsom, CA, April 28, 2023 – Trimark Associates, Inc. (Trimark), the industry…

Learn More

Trimark On-Premise Controller Meets NERC-CIP Requirements

Aug 01, 2022

Trimark’s System Supports Centralized Control and Cyber Security Best Practices Trimark Associates, Inc., the industry leader in intelligent renewable energy…

Learn More


Example Projects

Take a minute to see how Trimark has helped resource owners, EPCs, and ISOs change the electric grid.
View All Projects


Jun 26, 2023

Project Type: 70 MW Solar AC Coupled Location: Logan County, Illinois Client/EPC: APEX Clean Energy Products/Services: Trimark SCADA including Vantage,…

Learn More
Nicolis and Tropico

Nicolis and Tropico

Dec 05, 2018

Project Type: PV rated at 20 MW and 14 MW Location: Tulare County, California Client: Blue Oak Energy Products/Services: SCADA…

Learn More
Antelope Expansion 2 Project

Antelope Expansion 2

Jan 05, 2018

Antelope Expansion 2 Project Project Type: PV rated at 105 MW Location: Lancaster, CA in LA County EPC: D.H. Blattner…

Learn More

Taos Mesa Energy Center

Jun 26, 2023

Project Type: 15MW Point-of-Delivery (POD) PV/BESS Hybrid Resource composed of 15MW PV, 7MW/14MWh BESS Location: Taos, NM Client/EPC: Torch Clean…

Learn More

Ready. Set.

Letʼs go!

Need a SCADA system that optimizes revenue?
Need help meeting interconnection requirements?
Want to stay in the market and avoid fines?

Weʼve got you!

Get Started Today