Solved

SQL Transformation Error

  • 17 August 2023
  • 2 replies
  • 32 views

Userlevel 1
Badge +1

Facing a Critical Error while running the below sql code.

SQL Error:(Attached the Raw input Excel for your reference.)

Text '9/28/2022' could not be parsed at index 0 | code: 400 | X-Request-ID: 14d6d486-1958-99a3-b552-d19e5937bf82

 

-- Loads SAP Work Order as events. Data is already contextualized with assets using functional location. An inner join with CDF Assets is used to ensure only work orders for assets already loaded is ingested.

select
concat('WO_', `Order Number`) as externalId,
to_timestamp('Basic Start Date','M/dd/yyyy') as startTime,


to_timestamp(`Basic Finish Date`,'M/dd/yyyy') as endTime,
'Work Order' as type,
array(`Asset ID`) as assetIds,
'SAP PM' as source,
`Description` as description,
`Order Type` as subtype,
2395436788557957 as dataSetId,
map_concat(
to_metadata_except(Array(
-- "Order Number",
"Basic Start Time",
"Basic Start Date",
"Basic Finish Date",
"Asset ID",
"Description",
"Order Type"), *)
-- map("Priority",
-- IF(`WO_priority`= 6, "Routine Level 4",
-- IF(`WO_priority`= 5, "Routine Level 3",
-- IF(`WO_priority`= 4, "Routine Level 2",
-- IF(`WO_priority`= 3, "Routine Level 1",
-- IF(`WO_priority`= 2, "Schedule-breaker",
-- IF(`WO_priority`= 1, "Emergency", `WO_priority`)
-- )
-- )
-- )
-- )
-- )
-- )
) as metadata
from
(select
ltrim('0', trim(' \"', AUFNR)) as `Order Number`,
--trim(' \"', priok) as `Priority`,
ltrim('0', trim(' \"', EQUNR)) as `Equipment Number`, -- add relationship
--trim(bautl) as `Assembly`,
trim(' \"', INGPR) as `Planner Group`,
trim(' \"', GEWRK) as `Work Center`,
ltrim('0', trim(' \"', WARPL)) as `Maintenance Plan`,
ltrim('0', trim(' \"', WAPOS)) as `Maintenance item`,
--trim(revnr) as `Revision`,
trim(' \"', ARTPR) as `Priority Type`,
-- ltrim('0', trim(' \"', iloan)) as `Location and Account Assignment`,
trim(' \"', ABNUM) as `Maintenance Plan Call Number`,
trim(' \"', OBKNR) as `Object List Number`,
trim(' \"', AUART) as `Order Type`,
--trim(ernam) as `Entered By`,
--trim(erdat) as `Record Creation Date`,
trim(' \"', KTEXT) as `Description`,
trim(' \"', KOSTV) as `Responsible Cost Center`,
trim(' \"', STORT) as `Location`,
to_date(trim(' \"', IDAT1)) as `Release Date`,
--to_date(trim(' \"', idat2)) as `Technical Completion Date`,
--to_date(trim(' \"', idat3)) as `Close Date`,
trim(' \"', KOSTL) as `Cost Center`,
trim(' \"', OBJNR) as `SAP Object Number`,
ltrim('0', trim(' \"', PRCTR)) as `Profit Center`,
ltrim('0', trim(' \"', PSPEL)) as `Work Breakdown Structure Element`,
trim(' \"', STORT_ILOA) as `Location of Maintenance Object`,
trim(' \"', BEBER) as `Plant Section`,
-- trim(' \"', ppsid) as `PP Work Center`,
to_date(trim(' \"', GLTRS),'MM/d/yyyy') as `Basic Finish Date`,
trim(' \"', GSTRP) as `Basic Start Date`,
--trim(gsuzp) as `Basic Start Time`,
to_date(trim(' \"', FTRMS)) as `Scheduled Release Date`,
to_date(trim(' \"', GLTRS)) as `Scheduled Finish`,
to_date(trim(' \"', GSTRS)) as `Scheduled Start`,
to_date(trim(' \"', GSTRI)) as `Actual Start Date`,
--trim(getri) as `Confirmed Order Finish Time`,
--trim(gltri) as `Actual Finish Date`,
to_date(trim(' \"', FTRMI)) as `Actual Release Date`,
ltrim('0', trim(' \"', RSNUM)) as `Number of Reservation/Dependent Requirement`, -- todo add relationship
trim(' \"', PLNTY) as `Task list Type`,
--trim(plnnr) as `Key for Task List Group`,
to_date(trim(' \"', PLAUF)) as `Date for Routing Transfer`,
--trim(plsvb) as `To Lot Size`,
--trim(pdatv) as `Valid-From Date`,
to_date(trim(' \"', AUFLD)) as `Date of BOM Explosion/Routing Transfer`,
--trim(dispo) as `MRP Controller for the Order`,
trim(' \"', AUFPL) as `Routing Number of Operations in the Order`,
--trim(terkz) as `Scheduling Type`,
--trim(profid) as `Network Profile`,
--trim(freiz) as `Release Period in Days`,
--trim(bedid) as `ID of the Capacity Requirements Record`,
--trim(pronr) as `Project Definition`,
--trim(ZAEHL) as `Internal Counter`,
--concat(to_date(trim(addat)), ' ', split(trim(aduhr)[1])) as `PM Order: Reference Date`,
trim(' \"', IPHAS) as `Maintenance Processing Phase`,
trim(' \"', ILART) as `Maintenance activity Type`,
ltrim('0', trim(' \"', QMNUM)) as `Notification Number`,
--trim(gltpp) as `Forecast Finish Date`,
--trim(gstpp) as `Forecast Start Date`,
--trim(gluzs) as `Scheduled Finish Time`,
--trim(gsuzs) as `Scheduled Start Time`,
ltrim('0', trim(' \"', MAUFNR)) as `Number of Superior Order`, --todo add relationahip
ltrim('0', trim(' \"', LEAD_AUFNR)) as `Leading Order in Current Processing`, --todo add relationship
--trim(geuzi) as `Confirmed Order Finish (Time)`,
--trim(gsuzi) as `Actual Start Time`,
--trim(user4) as `Estimated Total Costs of Order`,
--trim(sermat) as `Material Number`
--ZZRES_BL as `Resource Backload`,
--ZZJOBTYP as `Job Type`,
--ZZCOMMENT1 as `Comment 1`,
--ZZCOMMENT2 as `Comment 2`,
--ZZEVENT as `Disaster Event`,
--ZZEVENTPRIORITY as `Disaster Event Priorty`,
--wodata.TOTAL_ACTUAL_COST as `Cost`,
--wodata.USER_STATUS as `Status`,
--wodata.PRIOK as `WO_priority`,
assets.id as `Asset ID`
from `E2_SAP`.`EXPORT_VIAUFKS_UPDATED` as
inner join _cdf.assets assets on trim(TPLNR) = assets.externalId
)


 

icon

Best answer by roman.chesnokov 17 August 2023, 10:57

View original

2 replies

Userlevel 3

Hey @Viswanadha Sai Akhil Pujyam , it seems like an error related to the timestamp parsing. I observe that the date format in Basic Start Date and Basic Finish Date columns in the provided table is different from the format declared in the to_timestamp() function used.

Userlevel 4
Badge +2

@Viswanadha Sai Akhil Pujyam Did you manage to do the changes as Roman mentioned?

Reply