Skip to main content

Cognite Neat [Early Adopter]

  • 10 Topics
  • 37 Replies
Andre Alves
MVP
Andre AlvesMVP
NEAT - Loading Core Data Model – Docs vs. Current Practice

Hi there, I know there’s a lot happening in NEAT right now, and we're doing our best to keep up with the changes and learn from all the improvements. That said, I have a question regarding the documentation. The docs refer to core_data_model, which doesn’t seem to exist. Should we be using the example to load the core data model instead? For example, the documentation shows: neat.read.cdf.core_data_model( ["CogniteAsset", "CogniteEquipment", "CogniteTimeSeries", "CogniteActivity", "CogniteDescribable"]) But in our case, we’re currently using: #extend the core data model through examplesneat.read.examples.core_data_model()neat.subset.data_model(["CogniteAsset", "CogniteEquipment", "CogniteTimeSeries", "CogniteActivity"])

213
Andre Alves
MVP
Olav Alstad
Committed
Olav AlstadCommitted
Pygen shorter attribute names

We have a RDF-model based on CIM that we have imported to CDF Data Model via Neat. We are experimenting with Pygen. We are happy about both NEAT and Pygen and looking forward to explore further. The names of the attributes of the dataclasses becomemes long with pygen and the CIM-naming convension. Example 1: Model: cim:IdentifiedObject.name pygen: identified_object_name proposed pygen short: name Example 2: Model: nek:NEKACLineSegment.wireSegmentKind pygen: nekac_line_segment_wire_segment_kind proposed pygen short: wire_segment_kind Generic: Model. namespace:ClassName.attrName pygen: class_name_attr_name proposed pygen short: attr_name Is it possible to add an option in pygen to genreate short attributes? The rule would be to only the string followed by the . (dot ) I’m also interested in discussing other solutions with you. One options is ofc to change the names in the model, but then we are not conforming to CIM… Thanks! Regards, Olav

293
Olav Alstad
Committed
Andre Alves
MVP
Andre AlvesMVP
NEAT Support for Mapping Asset Types to Equipment in CDF Core Data Model (cdf_cmd)

Hi Neat Team, I know you are very busy, as I’ve been following all the commits and changes in the repo, and I really appreciate all the work you’re doing. We are probably going to be working on migrating from an asset-centric data model to a new domain data model that extends cdf_cdm, and one challenge we anticipate is that the existing model does not have an explicit equipment concept—only assets. Could you confirm if there are already plans within NEAT to address this, or if we can create a custom mapper using metadata.assetType to classify certain assets as equipment during transformation? Our proposed approach involves: Using metadata.assetType to filter and classify specific assets as equipment (e.g., pumps, motors, valves). Mapping asset metadata into the equipment structure in the new model. Retaining parent-child relationships where relevant. I understand this might not be a priority right now, but since this will likely be one of the tasks we’ll have to tackle soon, I wanted t

566
Andre Alves
MVP
Andre Alves
MVP
Andre AlvesMVP
Neat - Validating Statements in Neat (data-modeling-lifecycle )

While reviewing the data-modeling-lifecycle documentation available on GitHub for Neat, one of the first steps mentioned is validating the sheet using Neat (a React app demonstrated in a YouTube video). However, I could not find any reference to the Neat UI for validating statements in the spreadsheet. Does this mean that this step can be skipped?

222
Andre Alves
MVP
S
Committed
sebastianheibo.aksoCommitted
Cursorable indexes in NEAT excel sheet

Hi I am creating a data model using Neat in excel and am wondering whether if it is possible to create cursorable indexes through the rules sheet. If so, how? Thank you! Sebastian

222
S
Committed
H
Active
Henry LafleurActive
Problems Running Cognite NEAT

I’m having some problems running Cognite Neat. I have been able to run Cognite Neat from the latest code in the following environments: In a container app service in Azure In a container on my local computer From the source in a WSL Ubuntu instance (after jumping through many hoops) Can run CDF Client and NEAT methods in a local Jupyter Notebook In any of these environments, these are the issues I’m encountering after playing with it for almost a week: I can download spreadsheets from a Cognite Data Model and look at them (front-end or Python). I found spreadsheets in the documentation do not validate or upload. I had to get spreadsheets from the unit tests folder to get something to work. Any spreadsheet I download from a CDF data model cannot be re-uploaded. (AttributeError: 'DataModelLoaderAPI' object has no attribute 'datamodels') I am getting random Python errors when using the NEAT front end or using Python in a Jupyter Notebook (I can expand on these if needed), but these are sa

646
Nikola Vasiljevic
Practitioner
Anders Albert
Seasoned Practitioner
Anders AlbertSeasoned Practitioner
ANNOUNCEMENT: Welcome to Neat

We are pleased to announce that neat is now available for external feedback through Cognite-Hub. The goal is to gather feedback to improve the useability and robustness of neat.

594
Nikola Vasiljevic
Practitioner
K
MVP
Kristian NymoenMVP
Converting to DMS

Hi. When converting my solution model from Information-Architect to DMS for excel_file in DEVELOPMENT_DIRECTORY.rglob("*.xlsx"): data_model, issues = importers.ExcelImporter(excel_file).to_rules(errors="continue") exporter = exporters.ExcelExporter(styling="maximal", output_role=RoleTypes.dms) dms_file = excel_file.parent / f"{excel_file.stem}_dms.xlsx" exporter.export_to_file(data_model, dms_file) I get these warnings: C:\path\.venv\Lib\site-packages\cognite\neat\rules\models\dms\_exporter.py:110: HasDataFilterOnViewWithReferencesWarning: (ViewId(space='sp_sandbox_models', external_id='Company', version='1'), [ViewId(space='sp_kra_enterprise_model', external_id='Company', version=None)]) views, node_types = self._create_views_with_node_types(view_properties_by_id) C:\path\.venv\Lib\site-packages\cognite\neat\rules\models\dms\_exporter.py:110: HasDataFilterOnViewWithReferencesWarning: (ViewId(space='sp_sandbox_models', external_id='PriceArea', version='1'), [ViewId(space='sp_kra_enterp

393
Isha Thapliyal
Seasoned Practitioner
G
Active
GligorActive
Cannot see data in CDF after successfully run workflow in NEAT

Hello, I used the yaml file in NEAT to load the workflows. I used the xls rules file and rdf.xml file as entry files. I successfully run the first 3 workflows - meaning that graph data as nodes was uploaded to CDF. Issue: In CDF when checking the data of the new data model, errors are popping out saying that “property cannot be read”. what could be the problem? FYI: cognite-neat==0.77.8 All context files are in the attached zip. Best regards, Alex

636
Nikola Vasiljevic
Practitioner
K
MVP
Kristian NymoenMVP
Direct connections turns into Edges in reference Excel sheets

Hi. When creating a solution model upon an enterprise model where all connections are done as direct relations, my DMS excel sheet seems to turn all the connections with IsList=True into edges. I manually have to update the RefProperties sheet and add missing containers to RefContainers. Is this a bug? In the example below, both of the connections displayed are direct relations in the enterprise model, but the DMS excel sheet shows hasGate as an edge: (neat version 0.88.2)

322
Anders Albert
Seasoned Practitioner

About This Group

This group is intended for announcements, discussions, and feedback regarding Cognite-Neat, the data model builder, data transformation and data ingestion tool. Cognite-Neat is distributed as a Python-Package, cognite-neat, and a Docker image, cognite/neat. Documentation can be found at https://cognite-neat.readthedocs-hosted.com/en/latest/, and the Python package can be installed using pip install cognite-neat.

Members

Anita Hæhre
Seasoned Practitioner
J
Seasoned Practitioner
Mithila Jayalath
Seasoned Practitioner
Øystein Aspøy
Committed
Noah Karsky
Practitioner
R
Committed
Anders Albert
Seasoned Practitioner
Nikola Vasiljevic
Practitioner
Rocco Addona
Practitioner
K
MVP
M
Practitioner
T
Seasoned
Olav Alstad
Committed
S
Seasoned
H
Andre Alves
MVP
S
S
Committed
G
Active
Marie Solvik Lepoutre
Practitioner
Andrew Wagner
Committed
M
Seasoned
joaomacedx
Active
Y
Active
S
Mittinpreet Singh Nayyar
Practitioner
H
Active
K
Active
D
Terms & ConditionsCookie Settings

Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie Settings