Hi @Andre Alves,
We have forwarded your request to our engineering team, and they will respond to you in this thread. Please be aware that there might be a delay in their response due to the summer vacation period. We appreciate your patience during this time. Thank you, and feel free to reach out if you have any other inquiries.
Hi @Andre Alves ,
Have you taken a look at the DB extractor we have available today as an option to connect to the ODBC interface?
Alternatively, there’s the Beta edition, but soon to be General Availability, hosted extractor for MQTT and the Kafka hosted extractor.
I see you ask for “seamless integration”, which could mean a lot of different things. In your case, what problems are you trying to address? Is it more than reading data from the AspenTech DataSource interface?
Hi @Thomas Sjølshagen
Thank you very much for your reply.
In this use case, the goal is to read data from Aspentech and ingest it into CDF. By "seamless," I mean that I don't want to have a team dedicated to managing a Kafka cluster or building a custom connector. However, a Kafka connector from CDF could still be a great option if it's provided as a managed service.
The biggest challenges with a Kafka connector involve ensuring compatibility, handling different data formats, and maintaining data integrity across systems. Additionally, robust error handling mechanisms are essential to address data inconsistencies, network issues, or system failures. Since this is the beta version, we can give it a try, but is there a possible date for it to be available as a release candidate?
The DB extractor could also work; we'll check if we can have direct access to the database or if it's an Aspentech proprietary data source.
Thank you very much.
However, a Kafka connector from CDF could still be a great option if it's provided as a managed service.
It’s hosted in CDF, yes. You’ll obviously need to configure where to connect and topics, etc. But, it’s a far cry from having to configure your own Kafka cluster! ;-)
The current plan is to release both the Kafka and MQTT extractors to General Availability (GA) in the Q3CY24 release (medio September).