Impact 2024: The Industrial Data and AI Conference for and by Users | Nominate Speakers Now for a Ch...
Hi @Harsha @rsiddha The SAP extractor extracts data in two different “modes”: full load or incremental load. This is handled by the “incremental_field” configuration parameter. When using the incremental load, the extractor will extract the data in chunks from SAP OData, and the chunk size is also configurable (see chunk_size parameter here). Hence, when running incremental loads, the extractor splits the data in minor requests towards SAP Gateway (avoiding errors like “Request is too big”).Can you please test this functionality and let us know your feedback?Thanks and Regards,Rogerio JuniorCognite Engineering
Hi @shubha k v In the SAP Extractor configuration you have the option to add a list of fields to be used as keys in CDF raw. These fields will be concatenated during extraction, creating an unique raw key. Here is an extraction configuration example for MaintenanceNotification standard entity in S/4HANA: - source_name: mys4hana name: notifications destination: type: raw database: sap_extractor_v2 table: notifications sap_service: API_MAINTNOTIFICATION sap_entity: MaintenanceNotification sap_key: [MaintenanceNotification, LastChangeDateTime]Result in CDF RAW: Let me know if this suggestion works for you. Otherwise, please let me know more details your needs so we can evaluate this further as a feature request.Regards,Rogerio JuniorCognite Engineering
Hi,This feature has been released in the Cognite Extractor v2.0.0. released few months ago. Please check the following documentation for further details: https://docs.cognite.com/cdf/integration/guides/extraction/configuration/sap#-sap-keyRegards,Rogerio JuniorCognite Engineering
Hi Karina,Here is the example query to use with .csv files: - name: query_csv_test_local database: csv_test_local sheet: file query: > SELECT * FROM file“sheet” must be set to “file”, and your query must point to “file” as the table as well. Best Regards,Rogerio JuniorCognite Engineering
Hi Sonali,In your destination configuration, you need to specify the type of the destination you want to ingest data.For CDF Raw destination, it would look like this: destination: type: raw database: "your-raw-db" table: "your-raw-table"Thanks and Regards,Rogerio JuniorCognite Engineering
Hi,We released a fix for this issue (DB Extractor version 3.1.1). Please let us know the results.Regards,Rogerio JuniorCognite Engineering
Hi,Thanks for your suggestion. This request will be evaluated by the Product team and prioritized accordingly.Best Regards,Rogerio
Already have an account? Login
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.
Sorry, our virus scanner detected that this file isn't safe to download.