Skip to main content
Solved

UNS

  • December 17, 2023
  • 7 replies
  • 250 views

​​​​​​​Can Unified namespace architecture be implemented in Cognite Data Fusion

Best answer by ALEKSANDRS LIVINCOVS

Hi , 
 UNS can be implemented if CDF is paired with MQTT broker or an Event Streaming Platform ( Kafka, Azure Event Hub, or similar).  High-level blueprint : 

  1.  Install and configure MQTT broker or Event Streaming Platform. 
  2.  Connect SCADA system to MQTT broker. 
  3.  Create the data model representing UNS objects in CDF DM Industrial Knowledge graph.
  4.  Connect CDF to MQTT broker using CDF MQTT hosted connector. 
  5.  Subscribe to relevant MQTT topics (relevant to UNS tree) 
  6.  Define streaming transformation in CDF between SCADA message and object in the Industrial Knowledge graph.  

There might be variations of the blueprint based on UNS complexity and message volume. 

Aleksandrs 

View original
Did this topic help you find an answer to your question?

7 replies

Hi , 
 UNS can be implemented if CDF is paired with MQTT broker or an Event Streaming Platform ( Kafka, Azure Event Hub, or similar).  High-level blueprint : 

  1.  Install and configure MQTT broker or Event Streaming Platform. 
  2.  Connect SCADA system to MQTT broker. 
  3.  Create the data model representing UNS objects in CDF DM Industrial Knowledge graph.
  4.  Connect CDF to MQTT broker using CDF MQTT hosted connector. 
  5.  Subscribe to relevant MQTT topics (relevant to UNS tree) 
  6.  Define streaming transformation in CDF between SCADA message and object in the Industrial Knowledge graph.  

There might be variations of the blueprint based on UNS complexity and message volume. 

Aleksandrs 


  • Author
  • Active
  • 1 reply
  • February 3, 2024

Please send me the network diagram and step by step details on how to do this setup.


  • Active
  • 4 replies
  • February 28, 2025

Does This mean that CDF cannot ingest real-time data directly as it needs am MQTT broker or an event streaming platform to do that?


Forum|alt.badge.img

In my experience, “real time” when it comes to OT data has a few different definitions and timelines associated with it (depending on vendor and customer perspectives), so what does “real time” mean in this case ​@Walid Matta?

Other than the obvious latencies of data being shipped to a cloud service, and across networks - see the cloud provider’s network latency SLOs - coming into play for “real” realtime capture, services like the CDF Time Series API operate with a 95% avg window of 500ms for return trip on a read or a write request (from “our edge” - the API surface - to the data store, and back).

That said, if there are regulatory requirements in play for the data flow, we may not be able to provide the level of “realtimeness” required. 

The CDF hosted extractors have a low-overhead data mapping/simple transformation engine included, and for the on-premises data extractors from Cognite, the overhead introduced will depend on a number of local conditions beyond our - Cognite’s - control, so...

I believe “it depends” is the best answer here, sorry.


Correct me if I am wrong: UNS can be implemented if CDF is paired with MQTT broker or an Event Streaming Platform ( Kafka, Azure Event Hub, or similar).  High-level blueprint : Install and configure MQTT broker or Event Streaming PlatformUNS can be implemented if CDF is paired with MQTT broker or an Event Streaming Platform ( Kafka, Azure Event Hub, or similar).  High-level blueprint : Install and configure MQTT broker or Event Streaming Platform. Connect SCADA system to MQTT broker. Create the data model representing UNS objects in CDF DM Industrial Knowledge graph. Connect CDF to MQTT broker using CDF MQTT hosted connector. Subscribe to relevant MQTT topics (relevant to UNS tree) Define streaming transformation in CDF between SCADA message and object in the Industrial Knowledge graph


No, my question is why do we need an MQTT broker or Kafka. Is it because CDF is unable to ingest rea time data directly 


Forum|alt.badge.img

CDF is not a broker, which is why you’d need a broker.
 

We have a hosted subscriber capability for MQTT in our hosted extractors, so we _can_ receive «realtime» data, if the source (broker) provides it.


Reply


Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie Settings