CDF and Aspentech Mtell Integration

Forum|Forum|2 years ago
July 31, 2024
6 replies
175 views

Are there any extractors or connectors to seamlessly integrate Cognite CDF and Aspentech Mtell?

If not, have you discussed approaches for that integration, and whether one of them should involve using Aspentech DataSource Interfaces to connect via Aspentech ODBC Datasource, Kafka Datasource, or MQTT Datasource?

Please also share any other approaches you may have discussed for seamlessly integrating CDF and Aspentech Mtell.

Best answer by Thomas Sjolshagen

However, a Kafka connector from CDF could still be a great option if it's provided as a managed service.

It’s hosted in CDF, yes. You’ll obviously need to configure where to connect and topics, etc. But, it’s a far cry from having to configure your own Kafka cluster! ;-)

The current plan is to release both the Kafka and MQTT extractors to General Availability (GA) in the Q3CY24 release (medio September).

Dilini Fernando

Expert ⭐️⭐️⭐️⭐️

Hi @Andre Alves,

We have forwarded your request to our engineering team, and they will respond to you in this thread. Please be aware that there might be a delay in their response due to the summer vacation period. We appreciate your patience during this time. Thank you, and feel free to reach out if you have any other inquiries.

T

Thomas Sjolshagen

Lead Product Manager

Hi @Andre Alves ,

Have you taken a look at the DB extractor we have available today as an option to connect to the ODBC interface?

Alternatively, there’s the Beta edition, but soon to be General Availability, hosted extractor for MQTT and the Kafka hosted extractor.

I see you ask for “seamless integration”, which could mean a lot of different things. In your case, what problems are you trying to address? Is it more than reading data from the AspenTech DataSource interface?

Andre AlvesAuthor

MVP ⭐️⭐️⭐️⭐️⭐️

Hi @Thomas Sjølshagen

Thank you very much for your reply.

In this use case, the goal is to read data from Aspentech and ingest it into CDF. By "seamless," I mean that I don't want to have a team dedicated to managing a Kafka cluster or building a custom connector. However, a Kafka connector from CDF could still be a great option if it's provided as a managed service.

The biggest challenges with a Kafka connector involve ensuring compatibility, handling different data formats, and maintaining data integrity across systems. Additionally, robust error handling mechanisms are essential to address data inconsistencies, network issues, or system failures. Since this is the beta version, we can give it a try, but is there a possible date for it to be available as a release candidate?

The DB extractor could also work; we'll check if we can have direct access to the database or if it's an Aspentech proprietary data source.

Thank you very much.

André Alves

T

Thomas SjolshagenAnswer

Lead Product Manager

However, a Kafka connector from CDF could still be a great option if it's provided as a managed service.

It’s hosted in CDF, yes. You’ll obviously need to configure where to connect and topics, etc. But, it’s a far cry from having to configure your own Kafka cluster! ;-)

The current plan is to release both the Kafka and MQTT extractors to General Availability (GA) in the Q3CY24 release (medio September).