Impact 2024: The Industrial Data and AI Conference for and by Users | Nominate Speakers Now for a Ch...
While testing versions of the cognite-sdk python >= 7.37.0, we noticed a performance issue in the "retrieve_dataframe" method of the time series API for all versions 7.37.x ( x >= 0 and x <= 3). Example: For the same data window, we tested with version 7.0.0 and the latest versions. The processing time for version 7.0.0 in this method was less than 5 seconds, while for newer versions the processing time was 3 minutes.
I’m working on a prototype for a flexible data model to store time series data in a way that is easy to catalogue, query and filter. Using Pygen both to populate and use the model seems convenient.At its current iteration, I’ve only applied direct relations and (undocumented?) @reverseDirectRelations in the GraphQL schema. I expected to be able do something similar to client.windmill(windfarm="Hornsea 1").blades(limit=-1).sensor_positions(limit=-1).query()as found in the Pygen documentation, but it does not work (my client.windmill analouge has no methods corresponding to its relations). Do I have to use edges instead of relations to query easily and declaratively with Pygen?
This post is pursuant to “Postman does not work properly after authorization”.I have begun the module:Followed the steps in the instructions.Environment variables: Authorization was updated: Then, to test, I went: Cognite API collection > "Assets" folder > "List assets" > SendThis gives Error - different to that in post “Postman does not work properly after authorization” - Next, I try to list the timeseries data: timeseries > list time series > Send. Whereas in post “Postman does not work properly after authorization”, I got back data, now I get Q1. Please could someone help me get around this?Thank you for your support. Regards,Doug
Hi! I’m trying to create a Power BI Dataflow using CDF timeseries data. The same data is retrieved absolutely fine when using Power BI Desktop and Power Query inside the Power BI Desktop app, but when I try to use exactly the same query as a Dataflow instead, there is a warning about: “The query “Timeseries” contains columns with complex types that cannot be loaded. Some data is retrieved, but it’s incomplete with big parts of it missing. Looks like the CDF connector is not able to retrieve the data correctly when a Dataflow is used instead of a normal Power BI Desktop dataset. Is there a way to make Dataflow also compatible with the CDF connector?
How does Cognite handle data encryption at rest? Is there any documentation available regarding this requirement? Additionally, concerning data encryption in transit, are there alternative approaches to TLS or MTLS?
Hello,I am trying to follow along the Entity matching notebook in the data Engineering learning module. I am having trouble generating COGNITE SECRET to run the notebook - kindly let me know if I may have missed a lesson. thanks,Lavanya
Hi Team,I am getting an error message while running the cogex init in command promp.Is there anything I am missing here, can you guide me on that? Thanks and Regards,Navyasri Indupalli
Hi Cognite team, We have been provided the cognite sandbox env, with a credit code. But we are unsure of how to access it.Can you please support on this.
Hello, I am trying to perform a calculation on Charts but it does not work. It is a multiplication of 4 time series, all of them with a resample to granularity to 1m. One of them has real values and 3 of them are 0/1 steps. When I zoom out, I can see the calculation and it shows a pick of values, that is not accurate as it shows average data. Although when I zoon in to see the data, the trend disappears, the error says “One of the time series has less than two values”. As I resampled the data to 1 minute, I was expecting to see one values per minute, but it does not seems to happen. Is there other way to calculate the data correctly? Zoom in:
Hello,I am trying to follow along the first chapter in Data Engineer Basics - Integrate. I am trying to follow the first workbook : Authentication. When I try to install poetry, I get an error below.Can anyone let me know how I may troubleshoot? I am on mac, python 12 and pipx (instead of pip) at ~/Library/Application Support/pypoetry/venv/lib/python3.12/site-packages/poetry/installation/chef.py:164 in _prepare 160│ 161│ error = ChefBuildError("\n\n".join(message_parts)) 162│ 163│ if error is not None: → 164│ raise error from None 165│ 166│ return path 167│ 168│ def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:Note: This error originates from the build backend, and is likely not a problem with poetry but with pyzmq (25.0.2) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "pyzmq (==25.0.2)"'.Th
Hi, Unable to connect CDF data source to Grafana.Please suggest asap on this.Thanks
There is similar question posted in other community. Please refer that.
Im trying to create a new function in python, when I run this function from local it works fine but when I run it from cdf service it does not work. I got this error message: CogniteAPIError: <!doctype html><html lang=en><title>500 Internal Server Error</title><h1>Internal Server Error</h1><p>The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.</p> | code: 500 | X-Request-ID: 04b27193-d865-98d5-8a2a-11b94126e8eb
What access capabilities do I need to run transformations as “Current User”. I have a user who don’t see “Run as current user” as in screen shot. Next screen shot is mine, and I can see it probably because I am added as admin
I am creating a transformation where I am joining data from two different views/containers, where table B has a node reference to table A. I have tried to find documentation for this, but I have not found any so far. Through friends and trial and error I have found two options, and neither seems to be performing well. Example:Type A { Name: String}Type B{ Name: String A_ref: A}What I have found as possible solutions are to go through cdf_data_models and picking the externalId from the node-reference:from cdf_data models(<spc>, <mod>,<ver>, “A”) as A join cdf_… as B on A.external_id = B.A_ref.externalIdSame as above, but join on a as a nodereference: on B.A_ref = node_reference(<spc>, A) Neither of these options seems to be documented anywhere, and I can’t find any other ways documented. The performance when reading when using these joins seems slow, even though I have set up a few indexes which should cover the different joins. This is also slower then
What are the permissible size of file can upload in CDF ? Which type of P&ID files are directly read in CDF ? Which type of 3D Model files are directly read in CDF ? Is any converter tool is available in CDF for conversion of file in to require file format for P&ID and 3D model in cognite data fusion ?
Is there a way to query metadata of TimeSeries from a particular dataset in CDF Transformations?Something like this, but this query isn’t workingselect cast(`externalId` as STRING) as externalId, cast(`dataSetId` as STRING) as eidfrom `_cdf`.`timeseries`where dataSetId == <data_set_id>;
Hello everyone. We have some checklists where the operators measure the length of something, usually in feet and inches, like 1’10”. We have been facing some trouble creating tasks with this type of data on the templates, we could only add decimal numbers. How have you been handling this type of data?Thank you.
Hi Team,I am doing the Notebook 2 in Data Engineer Basics - Integrate course and getting this error, am I missing something here?
When installing pygen in a CDF notebook you may be met with ValueError: Requested 'typing-extensions>=4.10.0; python_version < "3.13"', but typing-extensions==4.7.1 is already installedThis is currently a known bug, which we are working on solving. For now, the workaround is to manually uninstall `typing-extensions` using micropip. The code to do so is documented in the installation of pygen along with other known issues and solutions.
Hello!I tried to setup a simple cogex extractor, but get an error that is not letting me proceed following the course. Please help.SyntaxWarning: invalid escape sequence '\e' """csv_extractor_2/__main__.py:13: error: Argument "run_handle" to "Extractor" hasincompatible type"Callable[[CogniteClient, AbstractStateStore, Config, Event], None]"; expected"Callable[[CogniteClient, AbstractStateStore, Config, CancellationToken], None] | None" [arg-type] run_handle=run_extractor, ^~~~~~~~~~~~~Found 1 error in 1 file (checked 4 source files)
Doing the ‘hands-on’ for Data Engineer Basics - “Learn to Use the Cognite Python SDK “ Course."I am down to adding events to CDF from events.csv.I noted that the dataframe df has some entries :NaN” wherever the csv has a blank.Then,However, creating events in CDF fails:the error is: Next, I replace all the csv blank entries with text “blank”, and read into a dataframe. Now the latter does not have any “NaN” values. This throws the same exception when creating events in CDF.If someone can kindly assist, I would be very grateful.Thank you,Doug
Hi, I’m doing the Learn to Use the Cognite Python SDK module in the Data Scientist basics seems incorrect.For example, I’m in the notebook `2_List_Search_Retrieve.ipynb` and the data presented appears to be very random, and not industrial data. When I run a query like:`c.assets.list(metadata={'ELC_STATUS_ID': '1211'},limit=5)` this comes back empty because there is no industrial data in any of the the datasets. In fact, almost all of the datsets in the c.data_sets.list() command are Deprecated and archived.It looks to me like potentially the datasets are tests that people have made. I would really like to be able to see some more realistic data in the dataset used for exploring the tool. Please let me know how I can do that, if anyone knows!
Hi, I’m doing the data science modules, I’m on Notebook 2 (List/Search/Retrieve) and I note that when I use the LabelFilter on the assets, I find a number of assets with a label called ‘COLD’. However, when I do c.labels.list (limit=None), I get only 4 labels and none of them match the ‘COLD’ label. Are labels for assets different from labels that are found using c.labels.list?
Notify an instructor and ask them to give required consent to the application in the AAD (requires admin privileges): Share the link of your Grafana instance (https://<NAME OF DOMAIN>.grafana.net/) with the instructor The instructor will navigate to the link and click the box next to "Consent on behalf of your organization" and "Accept" Once the required permissions are granted sign in to https://<NAME OF DOMAIN>.grafana.net/ in a new session (e.g. incognito mode) and choose Sign in with MicrosoftPlease assign me required privileges.https://parthsinha.grafana.net/
Already have an account? Login
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.
Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.
Sorry, our virus scanner detected that this file isn't safe to download.
Check the
documentation
Ask the
Community
Take a look
at
Academy
Cognite
Status
Page
Contact
Cognite Support
