Topics started by Kristian Nymoen

26 Topics

K
Seasoned
Kristian NymoenSeasoned

Use synthetic queries in data modelsGathering Interest

In a solution data model, it would be useful to be able to synthetically calculate a value, or time series values based on attributes / time series of an instance. For instance, return the maximum value across several temperature measurements on a generator. Would it be possible to implement the opportunity to allow a data model field to contain synthetic time series, charts / INDSL functions, or even custom python functions?  

1
A
Seasoned Practitioner
16 days ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Grafana data srource. Event start time format

Hi. For some reason my events retreived via the CDF data source for Grafana come with time stamps in epoch format:In the examples given in the documentation, events are returned with a human-readable time format. Any idea what I am doing wrong here?

2
Everton Colling
Practitioner
17 days ago
K
Seasoned
Kristian NymoenSeasoned
posted in Academy Discussions

Minor errors in the Transformation Python SDK course on Cognite Academy

Hi. I’m running through the Python SDK Transformations course. I’ve encountered a few points on the tests in the course, and suggest that it gets updated to avoid confusion for future learners. ***The sources.csv file provided contains 33 rows, which matches poorly with the following options in “Check your knowledge”. The same question with different resonse options was repeated in the test at the end of the course. (and the correct answer was not among the entries in “check your knowledge”) ***There is a typo in this question, in “check your knowledge“. “Metadata” would be a correct answer, but the answer option says “Matadata” - so technically there are currently only two correct answers in the list. ***In the final test, we are asked to name the columns in our observations table. This question comes after we have deleted the table we created. Is that intended?   

1
Nimesh Madandas
Practitioner
29 days ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Grafana data source. Feature request / alternate solotions?

Hi.It would be useful to access metadata from time series in Grafana. Some of our time series contain simple integers 0, 1, 2..,  and the meaning of each value is a string described in a metadata field set on the time series. Could this functionality be added to the CDF Grafana data source? Or is there a way to access this information in Grafana through another Grafana plugin? I see that there is a CDF PostgreSQL gateway, but its documentation says that it’s only for writing data to CDF, so assume this cannot be used for fetching timeseries metadata through the Grafana PostgreSQL data source?  

7
K
Seasoned
2 months ago
K
Seasoned
Kristian NymoenSeasoned

Auto-populate a canvas with related resourcesPlanned for development

I’ve been looking for a good way to visualise assets that are connected with relationships in CDF. A birds-eye graph-like visualisation of how our data is organized. And I think Canvas could work as a good platform for it. Say, for example, that I add a powerplant to my canvas, I would have loved to be able to by the click of a button add all related assets (perhaps only assets of a certain type) to the canvas, and have a connection drawn between them, and even a text-label indicating the type of relationship. Then, if I later add another asset to the canvas, I could get labeled connectors between this new asset, and the assets that already existed in the canvas. This could even be implemented with some sort of auto-organization of the canvas, where assets (or other resources) that are more closely connected gravitate towards each other.

1
A
Seasoned Practitioner
2 months ago
K
Seasoned
Kristian NymoenSeasoned

Display time series data points in tableGathering Interest

Hi!When verifying the data in our time series, ensuring that CDF data matches up with source systems, it would be useful for our product owners to be able to quickly visualise the raw time series values in a table format: Raw data points with timestamp and value, and the ability to scroll through the data points.Any chance to get such functionality implemented in the UI?

3
Lars Moastuen
Seasoned Practitioner
2 months ago
K
Seasoned
Kristian NymoenSeasoned

Feature request: Manual editing of data pointsClosed

It would be useful to our SMEs/Data owners/Data stewards to be able to manually update/write datapoints in a time series via the Fusion UI.For instance:Manually type in time stamps and values Manually draw a trajectory over a gap in time series data, with a fixed sampling interval Manually adjust the parameters for a gap-filling / interpolation function (e.g. fitting a polynomial/spline to both sides of a data gap), with a GUI preview. We have certain data for which it is difficult to define global “gap-filling” rules, especially for long gaps, but where a human eye can easily spot and correct data.

2
Sofie Svartdal Berge
Seasoned Practitioner
2 months ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Assets with GeoLocation and large polygons

Hi.We’re looking at how to work with larger geographic areas - inflow catchments for our hydropower reservoirs. The smallest one being a polygon with 3119 coordinates. Trying to create these catchments as assets with geolocation fails, due to the size limit on the GeoLocation field. Error message: “Maximum size of GeoLocation field is 10240.”I assume this means that the preferred approach is to use GeoSpatial, rather than assets with a geolocation field? If so, is the assetIds property the preferred way to connect GeoSpatial objects to assets?  And is there a simple way to retrieve the shape of an asset using the Python SDK? (something equivalent to using asset.geolocation?) Also; Any plans for showing geolocation ar geospatial information in the Fusion UI? 

3
V
Practitioner
2 months ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Updating geolocation on assets using Python SDK

Hi.Is it possible to update the geolocatoin of assets using the Python SDK?It seems I’m able to update the asset with a geolocation that renders the SDK unable to interact further with the asset. Example below: ## Create a new asset with geolocationdsid = <data set id>from cognite.client.data_classes import GeoLocation, Asset, Geometrygeometry1 = Geometry( type="Point", coordinates=[9.6573149,59.142253] )asset = Asset( name="geotest", data_set_id=dsid, geo_location=GeoLocation( type="Feature", geometry=geometry1 ))res = client.assets.create(asset)## List all assets matching the name .. it works wellclient.assets.list(name="geotest") ## Update the geolocation, returns KeyError: 'type'geometry2 = Geometry( type="Point", coordinates=[8.6573149,57.142253] )res.geo_location = geometry2res2 = client.assets.update([res])## Now try to list the assets again. It fails, returning KeyError: 'type'client.assets.list(name="geotest") 

2
K
Seasoned
2 months ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Limited returns from Grafana regex queries

Hi. In our CDF project, we have 19 time series whose external IDs ends with .EUR. Examples:NordPool.Price.Regulationmarket.RegulationDownPrices.NO1.EUR NordPool.Price.Actual.Dayahead.SE4.EUR NordPool.Price.Actual.Dayahead.NO2.EURUsing the CDF Grafana connector, I would expect that I could extract all of these using a “Time series custom query” like this: ts{externalId=~".*EUR"}However, the query only returns a single time series. The same problem occurs for trying to apply a regex filter on name or on a metadata value. E.g. ts{metadata={timeSeriesCategory=~'.*Lifetime'}} returns only 6 of our 116 “Remaining Lifetime” time series.Does anyone else have this problem? Is it a bug in the Grafana CDF connector?

1
Everton Colling
Practitioner
2 months ago
K
Seasoned
Kristian NymoenSeasoned
posted in Developer and User Community

Monitoring CDF operations

Hi! We’re aiming to monitor all of our CDF operations in the solution we have for monitoring other systems and data flows (Splunk). This would involve monitoring of extractors/extraction pipelines, cognite functions, and general platform availability. I wonder if any other Cognite customers have done this, and if you would be willing to share your experience / architecture for extracting logs from cognite functions etc. into Splunk or a similar service? Cheers,Kristian 

1
Anita Hæhre
Seasoned Practitioner
4 months ago
K
Seasoned
Kristian NymoenSeasoned

Feature request: Manual update fields in Fusion UIGathering Interest

Hi. We would like our SMEs/Data stewards/Data owners to be able to update fields on CDF Resources directly in the Fusion UI. Say, assets and time series missing description, or with missing/erroneous metadata etc.

2
Sofie Svartdal Berge
Seasoned Practitioner
4 months ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

3D models, scoping to data sets

Hi. What is the recommended method for access control of 3D models? 3D capabilities can be scoped to data sets, but how can I assign a model to a particular data set, so that it is only accessible by a limited user group? Is it possible via the Python SDK or GUI?

2
Andre Alves
Seasoned
5 months ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Access control. Sharing data.

Hi. When setting up CDF we were recommended to use CDF data sets scoped to data sources to control access to data. However, we have use cases where we would like to share a selection of data from a source with external parties. What would be the recommended setup for this? Would we need build an API layer on top of CDF,  to copy data from a source dataset to multiple other datasets for sharing? Or could the security categories feature be used for this?The person in charge of sharing data in our case will often be a data owner / SME without much coding experience. Is there a way our data owners could move/copy a subset of data from a source dataset to a sharing dataset, or somehow label individual time series or assets in a manner making them accessible to specificaccess groups?

4
N
Practitioner
5 months ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Documentation on Unit catalog and unit conversions

Hi. I’ve found a few references to “unit catalog”, “target unit”, and “target unit system” in the python sdk documentation. However, I wasn’t able to find a more complete description of this functionality. I assume it is there to assist with unit conversion, simliarly to what you can do in Charts? Can this also be used with custom units, that are not in the Charts standard units?Is documentation/explanation of this feature available somewhere?

1
Everton Colling
Practitioner
5 months ago
K
Seasoned
Kristian NymoenSeasoned

Grafana data source: time series endpoint for global variablesGathering Interest

Hi, I’d like to be able to use the timeseries/list endpoint for global variables using the Grafana data source (not just assets). Any plans for developing this?

3
B
Practitioner
7 months ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Grafana: Getting the {{name}} property from string time series.

Hi. I’m using the Cognite Data Source for Grafana. For numerical time series I can retrieve properties like {{name}}, {{description}}, etc. But for some reason I cannot for string time series. The only difference between the two panels below is the External Id of the time series it points to: one is a string time series, the other numerical. Both time series have a name specified in CDF. 

1
I
Practitioner
8 months ago
K
Seasoned
Kristian NymoenSeasoned
asked in How-To Guides

Filtering assets by geolocation using pythonSDK [Community Contributedl]

How can I filter assets by their geolocation using the python SDK?from cognite.client.data_classes import GeoLocationFilter, GeometryFiltermygeofilter = GeoLocationFilter( relation="within", shape=GeometryFilter( type="Polygon", coordinates=[[[7, 61], [13, 61], [10, 55], [7, 61]]] ))client.assets.list(geo_location=mygeofilter)This approach works for files, but for assets I get:CogniteAPIError: Unexpected value 'within' | code: 400 | X-Request-ID: fd1c5a73-a3d3-9ec1-bd97-039b4b1e0051

2
Dilini Fernando
Seasoned Practitioner
9 months ago
K
Seasoned
Kristian NymoenSeasoned

Geolocation for timeseriesClosed

Our hydro reservoirs have water level measurements at different locations. These measurements are linked to the reservoir asset, which can have a geolocation assigned, but we would also like to assign a geolocation to each specific time series. A workaround could of course be to set up a “measurement station” asset for each time series, but I think a geolocation directly on the timeseries would be a more elegant solution. 

4
Anita Hæhre
Seasoned Practitioner
10 months ago
K
Seasoned
Kristian NymoenSeasoned
asked in Monitoring and Alerting [Early Adopter]

Alerts not being triggered in charts

Hi. I’m trying to understand why no alert has been triggered for the following monitoring job.Am I right to understand that this monitoring job should trigger an alert when the time series is above the specified threshold? (I am a bit confused by the text “alert when the threshold is”. Is this perhaps not monitoring the time series itself, but a threshold specified on the threshold tab?) 

4
Arun Arunachalam
Seasoned Practitioner
10 months ago
K
Seasoned
Kristian NymoenSeasoned

Do not force units to be lowercase in the filtering viewPlanned for development

I’m looking at the list of filtering possibilities on time series, and notice that the unit V for volts is listed as v. For volts, we’ll manage, but this could be more critical for megawatts (MW) versus milliwatts (mW). I think the casing for units should not be altered in the filter list: 

1
Anita Hæhre
Seasoned Practitioner
11 months ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

source attribute on different resource types

I find it useful to be able to filter CDF resources by their source system.How come Assets, Files and Events have a “source” attribute, while time series and events do not? I assume then, that in order to properly filter by source for any resource type, it might be best to rather add “source” as a metadata key for any resource type, rather than use the attribute field which is not available for all resource types?Btw., for the Relationships resource type, “source” has a different meaning than it has for Assets - I suppose this could cause some confusion?

1
T
Practitioner
1 year ago
K
Seasoned
Kristian NymoenSeasoned

Monitor usage of data sets and resourcesGathering Interest

As data manager I’d like to be able to monitor the usage of different data sets and even individual resources in CDF.  This would provide valuable information on the importance of the different resources in CDF, and be useful in planning further development of our data products.One solution would be to include a counter on read operations per data set / resource. 

2
Dilini Fernando
Seasoned Practitioner
1 year ago
K
Seasoned
Kristian NymoenSeasoned

Local time zone timestampsGathering Interest

Hi.Are there any plans for enabling on-the-fly adjustment of timestamps to local time? Some of our users of would prefer being able to consume the timeseries in local time rather than UTC. It would be nice to be able to leverage synthetic timeseries to get the timestamps in local time, and/or to be able to set the time zone for visualizations in Charts.

6
K
Seasoned Practitioner
1 year ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Problem with colon exporting charts data as CSV on windows

Hi.Would it be possible to change the name format of the CSV file downloaded from cognite charts? The colon in “New chart 2023-02-22 15:43:59 (timeseries).csv” makes it difficult to unzip the file on Windows.

2
K
Seasoned Practitioner
1 year ago

Badge winners

  • Cognite Data Engineer Basics - Transform and Contextualize
    dburley70has earned the badge Cognite Data Engineer Basics - Transform and Contextualize
  • Cognite Data Scientist Basics
    dburley70has earned the badge Cognite Data Scientist Basics
  • Cognite Data Fusion Fundamentals
    KyotoJabbehas earned the badge Cognite Data Fusion Fundamentals
  • Cognite Data Fusion Bootcamp
    Carolina Fuentes Pulidohas earned the badge Cognite Data Fusion Bootcamp
  • Cognite Data Engineer Basics - Integrate
    nurfarhahas earned the badge Cognite Data Engineer Basics - Integrate
Show all badges
Terms & ConditionsCookie Settings