Impact 2024: The Industrial Data and AI Conference for and by Users | Nominate Speakers Now for a Ch...
While testing versions of the cognite-sdk python >= 7.37.0, we noticed a performance issue in the "retrieve_dataframe" method of the time series API for all versions 7.37.x ( x >= 0 and x <= 3). Example: For the same data window, we tested with version 7.0.0 and the latest versions. The processing time for version 7.0.0 in this method was less than 5 seconds, while for newer versions the processing time was 3 minutes.
We would like to have a contains filter option on columns. This would be useful to search on string type columns and see if it contains some substring, to filter the data properly.
I’m working on a prototype for a flexible data model to store time series data in a way that is easy to catalogue, query and filter. Using Pygen both to populate and use the model seems convenient.At its current iteration, I’ve only applied direct relations and (undocumented?) @reverseDirectRelations in the GraphQL schema. I expected to be able do something similar to client.windmill(windfarm="Hornsea 1").blades(limit=-1).sensor_positions(limit=-1).query()as found in the Pygen documentation, but it does not work (my client.windmill analouge has no methods corresponding to its relations). Do I have to use edges instead of relations to query easily and declaratively with Pygen?
Great work on the tool, it will let us remove a few pounds of CICD scripts.Listing some feedback here (as advised by Jan Inge).Will you supply patterns or guidance for structuring the custom modules. Do you have any thoughts on which level a project should group their artifacts into a module.Is there a plan for added support for the development lifecycle, e.g. downloading a full solution as configuration (from existing project), download buttons on other resources than transformation (e.g. datasets).It would perhaps be better to let the RAW config support multiple tables (one per DB), one file per table seems a bit bloated. A “Download CLI” on the DB level would also be great.Is it possible to have the auth verify command also check transformation credentials?Not directly related to the tool, but it seems to be a mismatch between tranformation credentials configuration in the UI and via the tool. We cannot configure the advanced scenario in the UI, and we cannot verify the auth via the
This post is pursuant to “Postman does not work properly after authorization”.I have begun the module:Followed the steps in the instructions.Environment variables: Authorization was updated: Then, to test, I went: Cognite API collection > "Assets" folder > "List assets" > SendThis gives Error - different to that in post “Postman does not work properly after authorization” - Next, I try to list the timeseries data: timeseries > list time series > Send. Whereas in post “Postman does not work properly after authorization”, I got back data, now I get Q1. Please could someone help me get around this?Thank you for your support. Regards,Doug
Hi,Is it feasible to incorporate a new feature into the SAP extractor that facilitates reporting? For instance, scheduling the SAP extractor on a daily basis to append data to the raw database, even if the primary key remains the same for subsequent days, and ensuring that it does not overwrite existing data.Presently, we've implemented a workaround by including a date field in the key and utilizing our own extractor to accomplish this. Can this functionality be achieved using the Cognite SAP extractor?Also same for DB extractor Support ticket raised is https://cognite.zendesk.com/hc/en-us/requests/10724?page=1. Thanks,Shubha
Hi! I’m trying to create a Power BI Dataflow using CDF timeseries data. The same data is retrieved absolutely fine when using Power BI Desktop and Power Query inside the Power BI Desktop app, but when I try to use exactly the same query as a Dataflow instead, there is a warning about: “The query “Timeseries” contains columns with complex types that cannot be loaded. Some data is retrieved, but it’s incomplete with big parts of it missing. Looks like the CDF connector is not able to retrieve the data correctly when a Dataflow is used instead of a normal Power BI Desktop dataset. Is there a way to make Dataflow also compatible with the CDF connector?
Hello Team I have a .pid file, generated from the https://hexagon.com/products/intergraph-smart-p-id software. Is there a way in CDF to read the files directly - meaning I’d like to see the vector, layers and properties natively and not rely on generating a PDF and doing an OCR.If I must write a connector myself, how do I go about it? Is there an industry standard format for .pid file, is so perhaps there is business case to commercialize such a connector?Appreciate your hints!RegardsAlex
Hello Everyone! Exciting news! We're hosting Impact 2024, Cognite’s first User Conference, and we want YOUR use cases to shine. You can read more about Impact 2024 here. Why Share?Your stories inspire. Share how your projects have driven real business impact, from boosting revenue to streamlining processes.How to Get Involved:Write up your use case and what it would look like to host a 55-minute workshop on the topic, and paste your idea in this thread! If your workshop is chosen, you will receive a free ticket to Impact 2024.Mark Your Calendars:Submissions Open: April 25, 2024Submission Deadline: June 1, 2024Winners Announced: August 1, 2024Event Date: October 14-15, 2024 Let's make a difference together! Questions? Reach out to myself or david.white@cognite.com. Can't wait to see your submissions!Geir
Enhance the SAP extractor to incorporate a configuration option enabling the division of large date range inputs into smaller segments. This functionality aims to prevent SAP requests from failing due to size constraints.
I see cognite SAP extractor doesn’t accept multiple keys for sap_key parameter.I have a requirement to ingest many tables , where i need to give multiple keys in the SAP_key parameter.Would be great if this feature will be added in the next version of SAP extractor.
Hello All,I’m Maneesh, 25+ years in AI/ ML R&D. I’m excited to join the community. My current interests are in creating multimodal AI agents for industrial use cases.https://scholar.google.com/citations?user=hdQhiFgAAAAJ&hl=en&oi=aohttps://www.linkedin.com/in/maneesh-singh-3523ab9/ You may reach out to me here or using the above links.Regards.
How does Cognite handle data encryption at rest? Is there any documentation available regarding this requirement? Additionally, concerning data encryption in transit, are there alternative approaches to TLS or MTLS?
In multiple cases, the validation of a Checklist is not needed and thoses checklists will remain pending, depending on the Team Captain avaliability. And this could also require time from the Team Captain to approve all the pending Checklists.The suggestion is to create an option on the Template creation screen so the user can define if it’s necessary to have an approval or not for the checklists generated from that Template and a possibility to define the group of users that will be able to approve it.As complement, new status for Checklists could also be created to indicate that a Checklist was finished but needs to be approved and a status to signalize the approved.
While doing the CDF Fundamentals, I’ve found out that if you don’t select a Data Set ID while uploading your PDF file, you later won’t be able to link it to your Asset, as your Data Set won’t be found. Also I didn’t find a way to edit this later. I had to upload a new file and select my Data Set ID. Is this expected? What was confusing to me is the fact that the Data Set ID is marked as optional. If this is not the case, this should be flagged as mandatory in order to upload any file.
Busy with training module:Data Engineer Basics - Transform and Contextualize > CDF Transformations > Assets transformationI have the following SQL: The Preview works: But, doing Run, leads to an error.So, of course the NULL in the 1st row above ought to be “ “ for the root asset.Q1. How do I test for NULL and set NULL value to “ ” in the Spark SQL query?Thank you!Regards,Doug
Resent search items history cannot see in search option at Data explorer screen in CDF.
Hello,I am trying to follow along the Entity matching notebook in the data Engineering learning module. I am having trouble generating COGNITE SECRET to run the notebook - kindly let me know if I may have missed a lesson. thanks,Lavanya
Global companies might face the challenge of having global data used by different countries, regions and languages, in ERP and other source systems. Such data exist in form of shared ‘catalogs’, ‘master data’ or ‘configurations’. This data is often setup and maintained in source systems, with different languages to support users in multiple regions. This data then became attributes or metadata in Cognite objects.Example given - Current situation:This 'catalog' data (metadata) is extracted from source system in one single language - English - only, since CDF can't store it in multiple languages.Then these metadata - field names and field values - are displayed in CDF with the only one language available - English -.*Notice Metadata fields names and metadata field values don't change, despite user changing CDF language settings. Proposed solution (request):Have a way to store metadata fields names and metadata field values, coming in different langu
Hey everyone! I’m excited to jump into this community. I look forward to finding and giving help with everything related to Cognite! It’s a cool product that I’m excited to learn more about.I’ve been a data engineer in the oil & gas industry for a few years now and look forward to building my expertise with Cognite.
Are Cognite Charts calculations published back to CDF?
Hi Team,I am getting an error message while running the cogex init in command promp.Is there anything I am missing here, can you guide me on that? Thanks and Regards,Navyasri Indupalli
Hi, I am on Data Engineer Learn training. When I try to make my first API request for the publicdata project, I get a 404 Not Found error: The GET url I was asked to use is{{baseurl}}/api/v1/projects/{{project}}/assets I also replaced {{project}} with ‘publicdata’ with same result. Kindly let me know.
Hi Cognite team, We have been provided the cognite sandbox env, with a credit code. But we are unsure of how to access it.Can you please support on this.
We're thrilled to share that CDF user interface is available in 10 new languages (Deutsch 🇩🇪, Español 🇪🇸, Français 🇫🇷, Italiano 🇮🇹, Nederlands🇳🇱, Português🇵🇹, Svenska 🇸🇪, 한국어 🇰🇷, 中文🇨🇳, 日本語 🇯🇵) to make your experience even more accessible and user-friendly.We've expanded our language support to bring the power of our platform to a global audience. You can now select your preferred language from the upper right corner of your profile by clicking on <Manage account>:Click the avatar on the top rightWhen on the /profile/ page click on the <Language> left button pick your preferred language from the list:Button reads <Langue> as user has chosen Français language from beforeAfter one selects the language, the page will reload and present the user with the interface in the chosen language. Your Opinion Matters 🗣️We're committed to ensuring that our multilingual interface exceeds your expectations & we want to hear from you! To do that, we need to
Already have an account? Login
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.
Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.
Sorry, our virus scanner detected that this file isn't safe to download.