Skip to main content
Ben Petree
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
September 21, 2023
Parked

Pi Extractor Gap-fill Back-fill enhancement

Related products:Extractors
  • September 21, 2023
  • 6 replies
  • 137 views

The Cognite Pi extractor is currently unable to fill gaps. The only way to force the extractor to re-pull gaps is to:

  1. turn the extractor off
  2. change the state table (update first = last)
  3. change extractor config to enable backfill
  4. turn extractor on

This isn't user friendly nor is it documented. It also usually requires an IT admin with access to the extractor's VM and a person who knows where it was installed. It would be amazing to get a no-code feature to do this same thing. Here are two use cases:

  1. As an SME i notice that I'm missing data points for a failure or process. I check my source system to verify that the points are missing in CDF. I go to the Extraction Pipeline that monitors this extractor and I enter a timeframe and tag that I wish to gap-fill.
  2. As an SME my use case has changed to require more historical data. I want to pull another year's worth of data for a subset of all my tags. I enter a list of tags and set it to backfill just those tags.

6 replies

Seasoned ⭐️⭐️⭐️
September 21, 2023

@Anita Hæhre can we please add Celanese tag to it, so we can track. Thanks

Anita Hæhre
Expert ⭐️⭐️⭐️⭐️
Head of Community
September 21, 2023

Sure @rsiddha, done, and thanks:)

Anita Hæhre
Glen Sykes
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
September 22, 2023

Hi @rsiddha 

Happy to confirm that we’ve received the request in product management and its in our prioritisation pipeline.  @Jørgen Lund or a colleague may be in further contact if we need more information.
 

Thanks! Glen
 

Glen | Cognite Product Management
October 2, 2023

@Ben Petree can’t you run PI replace instead? https://docs.cognite.com/cdf/integration/guides/extraction/pi_replace/

Ben Petree
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
October 3, 2023

@Tania Savitri I can’t run that because I don’t have access to the VM that the extractor is running on. This goes back to my use case where the SME should be able to back/gap fill without including other resources.

Lead Product Manager
October 14, 2024

We will evaluate this idea for inclusion in an upcoming update to the PI extractor. The current timeline is sometime after Q2, 2025.