Hi @mheinze57 and thanks for these comments.As of right now, due to significant amounts of feedback and observations, we are in the aftermath of shifting our perspectives for how we recommend approaching the construction of objects and their relationships in data modeling. First of all, there are some changes already in the UI to align what you see in the “Model your data” user interface with how the documentation describes building a graph in DM (meaning, you can review container and view designs in the UI, and we’re using that language). There are more coming... We’re iterating on the data modeling UI throughout the first half of the year to re-simplify the creation and maintenance of/consumption of data from interconnected data models, and the resulting graph(s).As you have observed, the short-term of our shift has been to take a bit of a step backwards, and fully exposing the components of the data models in the DM UI. We wanted to encourage “getting to know the innards” of data mo
AFIK, I believe another alternative might be to use a header request for the resulting downloadUrl after fetching it from the Files API.
Hi again @Stuart Donaldson. Having reviewed the request and considered the schedule for adding a hard delete option to the service, we realize it will be a while before we can add it from our backlog (6+ months right now). As a result, I’m going to park this idea but will revisit it over the next 2 quarters and reassess when we can include it in our roadmap for delivery.
If you’re comfortable with Python, you _can_ also submit a fix directly, as a pull request, in the GitHub repository.
Hi @almir.mavliutov and apologies for the late reply. I didn’t realize we hadn’t posted a follow up to you!I’ve cross-posted your content as an issue (bug) in the public Cognite Python SDK repository.
Hi @Stuart Donaldson, and thanks for the product idea. As mentioned in the support ticket on the topic, this is something we’re aware of as a request but do not currently have the capacity to deliver. We will evaluate your this insight/need in the context of developer improvements we’re considering in an upcoming release.
Unfortunately, for 2024, we lack the capacity to extend the CDF/DM OData interface in support of incremental data delivery, plus building and shepherding a new PowerBI connector through the MS certification process.So it is parked for now, as the team has a number of other initiatives we’re working on.
For the Time Series resource, the following HowTo document by Everton may help address most of the aspects of the PowerBI ask in this product idea:
Have you tried to use the https://pypi.org/project/cognite-pygen/ package for your data model(s)? See the Exploration CDF Notebook page for installation instructions. Alternatively, query instances w/the standard Python CDF SDK: https://cognite-sdk-python.readthedocs-hosted.com/en/latest/data_modeling.html#cognite.client._api.data_modeling.instances.InstancesAPI.query / https://cognite-sdk-python.readthedocs-hosted.com/en/latest/data_modeling.html#cognite.client._api.data_modeling.instances.InstancesAPI.search Can also use the execute GraphQL query capabilities in the standard Cognite Python SDK (available in the more recent versions of the SDK): https://cognite-sdk-python.readthedocs-hosted.com/en/latest/data_modeling.html#execute-graphql-query
Hi @Dietmar Winkler, sorry about the tardy reply, and thanks for the question!What are you searching for in this/these case(s), and where in CDF are you searching? Are you working against the API, with GraphQL, in Data Explorer in the CDF "Fusion" user interface, in one of our applications)? And when you're searching for a name, is that the name of a file/document, or something else?
No change in the status, unfortunately @thomafred. We’ve had to prioritize other capabilities. Uncertain whether or not we’ll be able to expose geolocation and geometry types this ½ year, but it’s on the list (but “under the line” so far).
Hi, and thanks for the questions.We have just implemented a Units service which can be used to set the unit-of-measure for a time series or a property in a Data Modeling (DM) container. We have the supported unit systems and their units listed in the units service. Conversion is coming “real soon now(tm)” - i.e. it’s development is in progress and working its way towards release (in the official Cognite Data Fusion (CDF) roadmap for the Time Series and Data Modeling unit capabilities). I’m unfortunately not aware of when Charts will support this functionality (for Time Series), but I have tagged @Arun Arunachalam as someone who hopefully may have insights/information to share? Documentation is being developed, but the links above represent some of the early bits of information. How to set the unit system and type for a DM container property, or for the Time Series, by specifying the unit’s externalId is covered by the above links, as is the current list of supported unit systems and u
Due to limitations in the team capacity, implementing/resolving this product idea has unfortunately been deferred until 2H, 2024. Will place the idea in “Parked” for now, with the goal to re-open and reassess priority at the beginning of Q3, 2024.
@ibrahim.alsyed - I’m a little uncertain as to what you mean by “group the data using the "Foreign key" for another object type”? Is this an SQL “group by” like functionality you’re asking for here?
@Jatin Sablok - Can you repost the images you linked in the original post. Seems like they’ve gone “missing”...
@andrelcalves - If the question is whether it would be possible to use a Push/Streaming/PubNub dataset right now, I believe the answer to be “no” as we do not expose the equivalent of a “streaming data flow” from CDF (and something would need to provide OData with the changing data information). If you’re asking whether a Push/Streaming/PubNub dataset could be a possible feature enhancement for our OData interface(s), that’s an interesting idea and something we may choose to do at some point. But it is unfortunately not something we can get started on until at the earliest the summer of 2024.
Planned for development→Parked
We have added this product idea to our long term roadmap. Due to our current set of product priorities, this specific idea has a current target for early access availability towards the end of 2H2024.
Hi, and thanks again for this product idea.We’re already tracking this request in the “Cognite CDF: PowerBi Live and Real Time Connector (CRITICAL)” product idea, so I will ask @Anita Hæhre or @Carin Meems to please merge the information in this product idea with it.
Will close as "Won't Do".We have a solution for users of Data Modeling (as a property that could be indexed), and are actively working on follow-up plans integrating DM and the other CDF resources.
Hi, and thanks for reaching out!Other applications of OIDC e.g. the Cognite SDK, allow for client credentials to be used for this kind of use case. I am therefore wondering why this is not the case with the Cognite Power BI connector? After registering an app in your IdP and obtaining a token by supplying the clientId and clientSecret as part of an OIDC authentication process - could use Python, Power Shell (dunno if this helps?), even a *nix shell script (if you're feeling brave enough to play with curl and pipes!). AFAICT, you can then configure your OData feed for CDF to use an Authorization: Bearer <token> header as the authentication mechanism, instead of the standard login with username/password and any MFA. By no means authoritative on my part, but hopefully useful?
Hi!The short answer wrt using Spark SQL for the transformations is that we use Spark as a technology component in the Transformations Service/API.As for the database or DB structure used in CDF, the answer depends on the service. We don’t use a single DB or DB schema, and in some cases we don’t even use a “default” DB schema at all (the “schema” - but it isn’t actually a schema - depends on the data).Since we expect our users (developers) to - for those we have available - interact with the resources through the API surface, I'm unclear as to what you’re wanting to achieve by having the requested information?
Hi,Looking at your question, I’m not sure where you’re trying to query against (what API/service) in CDF?
@Carin Meems Can this be converted to a Product Idea?
Beyond unit conversion support, being able to mutate a property value as it is being read from the data store, either by standard or custom functions in a view, is not currently on our roadmap.Are you more or less looking for the equivalent of a calculated/generated column from the RDBMS world, or something more flexible?What underlying problem would this functionality address?
Already have an account? Login
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.
Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.
Sorry, our virus scanner detected that this file isn't safe to download.