Topics started by Chris Selph

15 Topics

Chris Selph
Seasoned
Chris SelphSeasoned
asked in Academy Discussions

Data Transforms not working in learn environment

Tried to create an Asset Hierarchy transformation and waited for over 5 minutes. It did not work. Tried twice. This is an urgent matter for me to complete this training.  Help is appreciated!  

5
Chris Selph
Seasoned
1 year ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Developer and User Community

Cognite DB Extractor 3.0.0 Stops After Execution

Running Cognite DB Extractor 3.0.0 as a Windows Service. Note that previous versions of this extractor have worked fine although some changes have been made to the config.yml since upgrading. Symptoms - According to the log, Upon starting the service, It seems the extractor will run and successfully query and upload (30 rows in this case) and then the service will STOP running immediately as indicated in the Windows Services app.There is an error in the log file about database/table already existing which does not make sense to me b/c usually errors will prevent the service from starting at all.  https://www.yamllint.com/ indicates the config.yml is valid. The only entry in Windows Application log is an “Informational” note that states:The description for Event ID 4098 from source DBExtractor cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component on the local computer

5
Chris Selph
Seasoned
5 months ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Academy Discussions

Hands on with Data Science Course issue with Google Colab

Hands on with Data Science > Data Processing and Exploratory Data Analysis > Google Colab notebook called Data processing and analysis for IDA course.ipynb has issues in the Setup code block.  Here is partial output log:...Installing collected packages: PyJWT, protobuf, cryptography, msal, cognite-sdk Attempting uninstall: protobuf Found existing installation: protobuf 3.19.6 Uninstalling protobuf-3.19.6: Successfully uninstalled protobuf-3.19.6 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. tensorflow 2.9.2 requires protobuf<3.20,>=3.9.2, but you have protobuf 4.21.12 which is incompatible. tensorflow-metadata 1.12.0 requires protobuf<4,>=3.13, but you have protobuf 4.21.12 which is incompatible. tensorboard 2.9.1 requires protobuf<3.20,>=3.9.2, but you have protobuf 4.21.12 which is incompatible. Successfully installed PyJWT-2.6.0 cog

4
Madina Kholmatova
Seasoned Practitioner
1 year ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Developer and User Community

Chart zoom time axis

I see in videos you can click/drag on the chart to zoom the time axis. When I try that it will only allow “panning”. Is there some mode I need to set? I see that the mouse scroll wheel does zoom the chart but the click drag would be beneficial.

3
R
Committed
1 year ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Developer and User Community

Transformation Run Error

I have a transformation that is to write to a new dataset as seen here:SELECTconcat('CWS:',loc) as externalId,IF(parent_loc='' OR parent_loc IS NULL, '', concat('CWS:',parent_loc)) AS parentExternalId,CAST(lastUpdatedTime AS STRING) AS name,to_metadata(*) AS metadata,description AS description,7089382776719091 AS dataSetId FROM `CWS-Assets-DB`.`CWS-Assets-Tbl` The Preview seems to work fine.When RUN: I get following error:Request with id 96f4a082-9dde-9b41-8065-0b3cf0923197 to https://az-eastus-1.cognitedata.com/api/v1/projects/ra-istc-sandbox/assets/byids failed with status 403: Resource not found. This may also be due to insufficient access rights..The permissions on the dataset for my user group is raw:readraw:writeraw:listdatamodels:readdatamodels:writedatamodelinstances:readdatamodelinstances:writedatasets:readdatasets:writedatasets:ownertimeseries:readtimeseries:writefiles:readfiles:writeevents:readevents:writesequences:readsequences:write3d:read3d:create3d:update3d:deletetransfo

3
G
Seasoned Practitioner
1 year ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Developer and User Community

Transformation failure: failed with status 400: Event id not found.

Executing transform from Raw/Staging to Dataset Events. Codeselect cast(`uniqueid` as BIGINT) as id, cast(`Start Time` as TIMESTAMP) as startTime, cast(`End Time` as TIMESTAMP) as endTime, 1626362640169782 as dataSetId, concat("Chem-Batch", "-", Unit, "-", `Batch ID`) as description, 'Process' as type, 'Batch' as subtype from `Chem-Batch`.`Batch-Unit`where `Start Time` > '2023-06-13'Preview shows expected 3 row results: Run yields this error:Request with id 90f5d941-7f0e-9553-9ca5-317d784434d1 to https://az-eastus-1.cognitedata.com/api/v1/projects/ra-istc-sandbox/events/update failed with status 400: Event id not found. Missing ids: [48, 49].It seems all columns data in Raw rows has appropriate data.Any ideas are welcome.Chris  

3
Dilini Fernando
Seasoned Practitioner
9 months ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Developer and User Community

Transformation to Numeric Data

I’m trying to transform some time-series data (manufacturing pump pressures) into Asset Hierarchy/Numeric Data.The SQL is not writing to the timestamp column and not seeing errors in Preview.I’ve tried MANY different SQL commands to convert the DateTimeStamp string column to timestamp column/datatype and none have worked. CSV files are attached if anyone wants to try it. Added query in attachments. Help is greatly appreciated! Transform setup: Here is some of my data being edited in Excel and saved as CSV then imported into CDF Raw. TagID Tagname Value DateTimeStamp FCE1-HYD-PMP-3 FCE1-HYD-PMP-3 NULL 3/2/2023 3:41 FCE1-HYD-PMP-3 FCE1-HYD-PMP-3 28.54443 3/2/2023 5:51 FCE1-HYD-PMP-3 FCE1-HYD-PMP-3 35.68053 3/2/2023 5:51 FCE1-HYD-PMP-3 FCE1-HYD-PMP-3 42.81664 3/2/2023 5:51 FCE1-HYD-PMP-3 FCE1-HYD-PMP-3 49.95274 3/2/2023 5:51  RAW     

3
G
Seasoned Practitioner
1 year ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Developer and User Community

Transforms Creating Nulls for timestamp

Hi, I’m running a transform from Raw to insert/update Numeric values./* MAPPING_MODE_ENABLED: false *//* {"version":1,"sourceType":"raw","mappings":[{"from":"","to":"id"},{"from":"","to":"externalId"},{"from":"","to":"timestamp"},{"from":"","to":"value"}]} */SELECT dp.Tagname AS externalId,to_timestamp(DateTimeStamp, 'yyyy-M-d h:mm:ss') AS timestamp, cast(value AS double) FROM `ISTC_WW_InSQL`.`wwHistory` AS dp , --selecting from _cdf.timeseries means we select from the timeseries we ingested to CDF earlier. We do this to make sure all the time series we try to add data points to actually exist_cdf.timeseries AS ts WHERE dp.`Tagname` = ts.externalId--And to_timestamp(DateTimeStamp, 'yyyy-M-d h:mm:ss') Is Not Null  When previewing the code above, you can see some null values. Also, if you “run” the code it complains about nulls. (Not pictured.)   I think I’ve confirmed that the DateTimeStamp column in `ISTC_WW_InSQL`.`wwHistory` contains no null values.When, we UnComment the last line

2
Chris Selph
Seasoned
1 year ago
Chris Selph
Seasoned
Chris SelphSeasoned

Improvements to Entity Matching UIGathering Interest

Here are some ideas for improving the user experience in Entity Matching.It is quite annoying that you cannot select "All" when filtering.you cannot filter then make a selection then unfilter and have the prior selections stickthe filtering is too limited.  We should be able to filter like this from the Explore Data > Events UI Finally, it would be useful to have a selection that filters out events that have already been assigned to an Asset.  Thanks!

2
Anita Hæhre
Seasoned Practitioner
1 year ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Monitoring and Alerting [Early Adopter]

Save & Schedule Calculation from Chart Credentials Verification

When saving and scheduling a calculation from Charts, the enter credentials dialog hangs in the “checking credentials” and keeps trying to verify in a loop. This happens only if you select the Use CDF client ID and Client Secret option at the top. If you do not choose the top radio button and simply enter the creds and click next, it works ok. 

2
Dilini Fernando
Seasoned Practitioner
2 months ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Monitoring and Alerting [Early Adopter]

Charting Process Monitoring does not create folders or generate alerts

I created a process monitoring job several weeks ago and it seems to work as expected showing me the folder I created and alerts were delivered to my inbox. After 2 Recent attempts to create monitoring jobs, the UI stated the job was created but I’m not seeing the new folder nor am I receiving alert emails or seeing indications under the alerts tab in Charts. 

2
D
Committed
1 month ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Developer and User Community

SQL Transform Join Error

Executing a SQL Transform joining 2 tables from Raw and writing results to a 3rd Raw table.Perhaps there is a syntax issue? Not sure if it matters but I noticed the error msg omits some backticks like here:'ChemPlant.`Alarms-2-INActive`.EventAssociationID' there is no backtick before Event… Thank you.SELECT `ChemPlant`.`Alarms-2-INActive`.`EventID`, `ChemPlant`.`Alarms-2-INActive`.`SourceName`, `ChemPlant`.`Alarms-1-Active`.`EventTimeStamp`, `ChemPlant`.`Alarms-2-INActive`.`EventTimeStamp` AS AlarmOffTime, `ChemPlant`.`Alarms-2-INActive`.`Message`, `ChemPlant`.`Alarms-2-INActive`.`Active`, `ChemPlant`.`Alarms-2-INActive`.`EventAssociationID` as key, `ChemPlant`.`Alarms-2-INActive`.`EventAssociationID`FROM `ChemPlant`.`Alarms-2-INActive` INNER JOIN `ChemPlant`.`Alarms-1-Active` ON `ChemPlant`.`Alarms-2-INActive`.`EventAssociationID` = `ChemPlant`.`Alarms-1-Active`.`EventAssociationID`Error Message:Cannot resolve 'ChemPlant.`Alarm

2
Chris Selph
Seasoned
11 months ago
Chris Selph
Seasoned
Chris SelphSeasoned
posted in Academy Discussions

Learn to Use the Cognite Python SDK > matplotlib required to plot timeseries

Learn to Use the Cognite Python SDK > List, search, retrieve > Solution: matplotlib required to plot timeseries running this code provided in solution results in error: Pandas ImportError: matplotlib is required for plotting dps.to_pandas().plot() To install:in a terminal session run:pip install matplotlib This may be mentioned somewhere in the lab explanations and I missed it but an easy fix.   

1
K
Practitioner
1 year ago
Chris Selph
Seasoned
Chris SelphSeasoned

Process Monitoring Creates EventsPlanned for development

The Process Monitoring function is very helpful as it is and I see many more things it could do. For example, it would be super helpful to have it create events in the dataset with start and end dates that correspond to “Alerts”. Also, this ability to configure calculations for the duration of the event like averages of other datapoints and write that as metadata or to Flexible Data Model would be impressive and well received by the end user.  Thanks!

1
P
Seasoned
2 months ago
Chris Selph
Seasoned
Chris SelphSeasoned

Charting Threshold Excursion Pen ColorGathering Interest

As I’ve seen in competitive trending tools, it is helpful for the user to quickly identify when charted values have exceeded a defined threshold by changing the line type/color for datapoints that are above/below/outside the thresholds. The user should see this even when the threshold is not being displayed or configurable. See attached example. The line color could be changed to yellow or red or something configurable and set to dashed.  Thanks, I’d like to hear your thoughts PM!

0
Chris Selph
Seasoned
3 months ago

Badge winners

Show all badges
Terms & ConditionsCookie Settings