Developer Community

Hi All,I have a large production records data set which i am utilizing to create reports using GraphQL queries.I want to perform DESC sort to fetch the latest records for which i am using default ‘StartTime’ property(This property is derived from Schedulable Container). But system is generating this warning : "The sort is not backed by a cursorable index, which means query time sorting is necessary, which in turn means a lot more data must be read. Consider whether a cursorable index is a good fit."What’s the best way to approach this so that i can fetch large data sets with improved performance?Should i make a custom DateTime field as cursorable ? What are the impact of this ?

 Hi everyone! 👋 Join us tomorrow to see the results of our "Hack for Impact" challenge. We are hosting Tridiagonal.ai (presented by ​@Dinesh Makked ) and SLB (presented by ​@Aditya Kotiyal) to present the winning concepts they developed for "Smart Operations" and "Cognite Vision."This is a fantastic opportunity for the community to: Celebrate the creativity and hard work of your fellow community members. See the specific approach these teams took to build their solutions. Hear the story behind the project directly from the creators. Hope to see you there! 🗓

Description / Problem StatementWe are using the Cognite 3D File Extractor to migrate 3D model files from an on-premises Windows VM to Cognite Data Fusion (CDF).The majority of 3D files are ingested successfully with multiple sizes mostly > 10 GB. However, four specific files consistently fail ingestion, even after multiple retries.Key observations:All failing files are close to 5 GB in size Example sizes (as shown in Windows Explorer): 4.99 GB 4.94 GB 4.91 GB When checked via terminal/command line, these same files report a larger actual size (~5.3 GB) It appears that based on the Windows VM file size, the 3D extractor determines it should use a single-part upload. However, when it attempts to upload the actual file, the process fails because the size exceeds 5 GB  

Hi community,I’m learning to use the /models/instances/query endpoint (with Open Industrial Data, public project) and experiencing some confusion about how cursors and pagination work.{    "with": {        "cities": {            "nodes": {                "filter": {                    "and": [                        {                            "exists": {                                "property": [                                    "Geography",                                    "City",                                    "name"                                ]                            }                        }                    ]                }            }        },        "continents": {            "nodes": {                "filter": {                    "and": [                        {

We’ve setup an MQTT Hosted Extractor that is recieving a SparkPlug B payload which some times contains a couple of null values, this values cannot be removed from the SparkPlug B payload. We believe that whenever the message contains null values the transformation for the datapoints fails.No more information is provided on the Transform Error, only the “Failed to transform data: Missing required field value”, could the null values just be ignored so the other values be inserted in the time series? We’re getting several empty time series that were created via the hosted extractor.

Is there an alert or notification that can be configured when the MQTT hosted extractor is down? Been having issues with  Request to CDF failed with error Error in middleware: Failed to authenticate request  This error is resolved by creating a new sink, however we don’t get a notification of any kind when the extractor is down. 

I’m working with the PI AF Extractor and facing an issue with Table Lookup attributes.The Table Lookup attribute itself is being extracted correctly into the attributes table, but the value column always comes as “no data”, even though the attribute resolves normally inside PI System Explorer.I would like to know whether there is any supported way to extract the evaluated Table Lookup value using the PI AF Extractor, or if the extractor does not currently resolve Table Lookup references during extraction.Has anyone faced this issue or found a recommended approach to retrieve these values through the extractor?

 We are thrilled to announce the next evolution of your user experience. We’ve unified our ecosystem to help you master your industrial data without the friction.What’s new? One Identity: We’ve merged Cognite Academy and the Community. One login for everything. Unified Search: Find How-to guides, discussions, and courses in a single search. Guided Careers: New role-based learning paths, starting with the Data Engineer path! 👇 Read the full announcement here:  

I’m using the CogniteSDK. I have seen the following behavior several times: assets = client.assets.list()the variable assets can contain deleted assets if they have been recetly deleted. If I find the external_ids of these assets, the client.assets.retrieve_multiple(external_ids=deleted_xids) correcly do not return the assets. The assets cannot be found in fusion either. I suspect that client.assets.list() is using cached values. This also applies with arguments, f.ex LabelFilter. I have seen the issue many times, but now it really got painfull, so therefore I’m writing here. It returns assets that were deleted several days ago.  What to do? 

Hello, Although “unitless” is an alias of the dimensionless:unitless unit, try_get_unit(“unitless”) returns null.ref: https://github.com/cognitedata/units-catalog/blob/main/versions/v1/units.json#L1699 Could you please have a look? Thanks!

What capabilities are required to run a transformation using client credentials? I have a client_id and client_secret that when I add to the transformation and hit ‘Test credentials’ it says ‘Credentials verified’. However when I run with client credentials I get an error: Transformation job could not be created. Error code: 403 API error: Invalid source/destination credentials: Token did not provide access to project kuraray-america. Request ID: eb5136ee-594d-971f-b27a-7be0d1a60b15these credentials are a part of a group that that has read and write capabilities to:transformations sessions datamodelinstances (that is what this particular trasformation is creating)Additionally I am part of the same groups as this client_id, and I am able to run the transformation using ‘run as current user’ successfully

Hi everyone,I have a question: Can we use data from Data Models in Canvas?Is there any way to visualize that data available in Data models into Canvas?In our case, we are using Cognite Charts with time series data coming directly from machines (e.g., good parts, bad parts). However, the time series does not include product or batch information, which we do have in our Data Model.Is there any possibility to link both sets of information together for analysis?My initial thought is: if I can bring the required data from Data Models into Canvas and then create charts there, it would make the analysis much easier.But I’m

Hi, I have defined a Data Model with a Source View having a DirectRelation to a Target View as a simplified version below, which Pygen created an SDK successfully.  But when I added a ReverseDirectRelationApply to the Target View, Pygen returned the captioned error.  Please help.source_container = ContainerApply(       space =”myspace”,       external_id=”sourceContainer”,       properties={            “sourceName”: ContainerProperty(type=Text, name=”sourceName”),            “target”: ContainerProperty(type=DirectRelation(is_list=False, container=ContainerId(space=”myspace”, external_id=”targetcontainer”) } target_container = ContainerApply(       space =”myspace”,       external_id=”targetContainer”,       properties={            “targetName”: ContainerProperty(type=Text, name=”targetName”)} source_view = ViewApply(     space = “myspace”,     external_id = “souceView”,

With the Java-SDK, I don’t see an option to supply the client-name during initialization of the client.  https://statics.teams.cdn.office.net/evergreen-assets/safelinks/2/atp-safelinks.htmlIs there anyway we can do that? We need the client-name for logging purpose. 

Hi,We are looking into contextualizing our data models with 3D info, based on the relevant concepts/types from the Cognite Core Model. However, we ran into a limitation that as far as we can see severely limits the usability of the functionality as is.The CogniteCADNode has a direct relation to a Cognite3DObject, that can be made up of multiple CogniteCADNodes, reflecting that an asset may correspond to multiple nodes in the 3D model. That makes sense. However since the link from CogniteCADNode to Cognite3DObject is a single direct relation, the current model does not allow a CogniteCADNode to be part of more than one Cognite3DObject, which typically is meant to correspond to an asset. That is unfortunately in direct contrast to reality. One CAD node belonging to many different assets/objects is not an edge case, rather, it is the norm, at least for Aker Solutions.Have we correctly understood the current functionality? If so, are there

Hi Everyone,Previously, I was able to bring my Cognite chart into Canvas, and it displayed correctly without showing the calculation area at the bottom. However, starting today, I can still add the chart to Canvas, but nothing appears—it’s completely blank. We tested this across multiple profiles, and the issue occurs for all of them. Is anyone else experiencing this problem? Could the Cognite team help us resolve it?Thanks in advance!

Hi Everyone,Is there a way to create an alert directly on a calculated series in Cognite Charts?From what I’ve found, to create an alert for a calculation, I first need to schedule the calculation and then run the alert on that scheduled result. However, scheduling doesn’t seem to work well in my case.For example, if I receive machine data every hour, I also need to schedule the calculation every hour. Sometime scheduling stops by itself. It would be much easier if we could create alerts directly on the calculation without scheduling.Secondly, I’m not finding clear documentation or videos on how to schedule calculations properly and what best practices to follow. If anyone has experience with this or can share guidance, please let me know.Thanks!   

Hello, When I’m connecting to the virtual machine Ubuntu, I’m facing a pop-up “connection failed”. It seems that my internet connection is not set up, do you have any idea to do so ? I’m not able to do rest of the training without connection. Thanks 

Hello, We are facing an issue using private SSL certificate with Cognite REST extractor, we are receiving this error: While executing request to <URL>: HTTP response error: 400 Bad Request. Body: <html> <head><title>400 No required SSL certificate was sent</title></head> <body> <center><h1>400 Bad Request</h1></center> <center>No required SSL certificate was sent</center> It seems that the extractor does not send the certificate, could you please help? Thanks! 

 I am facing issue of jupyter notebook getting crashed frequently. Sharing the image for reference.

Hi Everyone!I need to manage streamlit applications (read / update files) using the Cognite SDK or with the API.I was able to publish streamlit applications using the cognite toolkit, but I also need to read them.Tried searching the api-docs and cognite-sdk docs with no luck. Thank you!

In the process of initializing a new CDF tenant for one of our customers I am getting the following error when adding Assets Read/Write capabilities: 1 invalid capabilitie(s) are present: {"assetsAcl":{"actions":["READ","WRITE"],"scope":{"all":{}}}} (invalid capability - write access to the legacy Assets API is restricted) | code: 400 | Are core assets now restricted?

Hi Team, we have data in format like list of externalIds and space as key and value.  Like list of Json object in data model. something like [{externalId:well,space:slb},{externalId:well1,space:slb2}]So can we keep a field in model like violatedEntities: [JsonObject]Is it possible to parse all the externalIds and store it like this?Thank you.

Hello,  Is it planned to support RAW querying via CDF Grafana Datasource ?  Thanks ! 

Hello, I have two questions:When using cdf_nodes in transformation, does query optimizer take advantage of the container indexes? What we notice is it is not the case.  How can we run broadcast joins in transformation. Hints does seem to be working: https://spark.apache.org/docs/latest/sql-ref-syntax-qry-select-hints.htmlThank you!