Redacting Confidential Data within your Pipelines in Cloud Data Fusion Reviews

Daniel M. · Reviewed מעל שנה אחת ago

Shivam T. · Reviewed מעל שנה אחת ago

ADITYA K. · Reviewed מעל שנה אחת ago

Dhyéy S. · Reviewed מעל שנה אחת ago

Jalina H. · Reviewed מעל שנה אחת ago

Suyash b. · Reviewed מעל שנה אחת ago

Souradeep M. · Reviewed מעל שנה אחת ago

Souradeep M. · Reviewed מעל שנה אחת ago

Chandan P. · Reviewed מעל שנה אחת ago

Pragnesh S. · Reviewed מעל שנה אחת ago

Complete waste of 1.5hrs, tedious long lab and most time spent waiting for service to prvisioned and each job run takes more than 10 mins, then job won't run properly when pipeline preview ran fine 01/09/2025 23:10:01 ERROR Aborting task 01/09/2025 23:10:01 INFO Successfully repaired 'gs://qwiklabs-gcp-00-e1df31d1f801/2025-01-09-15-01/_temporary/0/_temporary/' directory. 01/09/2025 23:10:01 ERROR Task attempt_20250109150913877997772046728130_0005_r_000000_0 aborted. 01/09/2025 23:10:02 ERROR Exception in task 0.0 in stage 0.0 (TID 0) 01/09/2025 23:10:02 WARN Lost task 0.0 in stage 0.0 (TID 0) (cdap-testpipel-ad1cdc98-ce9a-11ef-90b8-2eb8c6a7bfbd-w-0.us-east1-d.c.qwiklabs-gcp-00-e1df31d1f801.internal executor 2): org.apache.spark.SparkException: Task failed while writing rows at org.apache.spark.internal.io.SparkHadoopWriter$.executeTask(SparkHadoopWriter.scala:163) at org.apache.spark.internal.io.SparkHadoopWriter$.$anonfun$write$1(SparkHadoopWriter.scala:88) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:136) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:548) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1505) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:551) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Caused by: io.cdap.cdap.api.data.format.UnexpectedFormatException: field State cannot be set to a null value. at io.cdap.cdap.api.data.format.StructuredRecord$Builder.validateAndGetField(StructuredRecord.java:708) at io.cdap.cdap.api.data.format.StructuredRecord$Builder.set(StructuredRecord.java:386) at io.cdap.plugin.format.delimited.common.DelimitedStructuredRecordStringConverter.parseAndSetFieldValue(DelimitedStructuredRecordStringConverter.java:40) at io.cdap.plugin.format.delimited.input.PathTrackingDelimitedInputFormat$1.nextKeyValue(PathTrackingDelimitedInputFormat.java:95) at io.cdap.plugin.format.input.PathTrackingInputFormat$TrackingRecordReader.nextKeyValue(PathTrackingInputFormat.java:136) at org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReaderWrapper.nextKeyValue(CombineFileRecordReaderWrapper.java:90) at org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader.nextKeyValue(CombineFileRecordReader.java:65) at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:251) at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:37) at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:491) at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:491) at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:491) at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:491) at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:491) at org.apache.spark.internal.io.SparkHadoopWriter$.$anonfun$executeTask$1(SparkHadoopWriter.scala:136) at org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1539) at org.apache.spark.internal.io.SparkHadoopWriter$.executeTask(SparkHadoopWriter.scala:135) ... 9 more Failed due to DLP rate limit, please request more quota from DLP: https://cloud.google.com/dlp/limits#increases

Allen Y. · Reviewed מעל שנה אחת ago

Manish S. · Reviewed מעל שנה אחת ago

Pramod K. · Reviewed מעל שנה אחת ago

Nakul W. · Reviewed מעל שנה אחת ago

i cant remove the chat on the page, its irritating me and i am unable to see whats wrong

Dhanush R. · Reviewed מעל שנה אחת ago

CHETAN S. · Reviewed מעל שנה אחת ago

Aryan D. · Reviewed מעל שנה אחת ago

bnnv

avinash k. · Reviewed מעל שנה אחת ago

Atindra G. · Reviewed מעל שנה אחת ago

Somes S. · Reviewed מעל שנה אחת ago

vyshnav r. · Reviewed מעל שנה אחת ago

Isuru K. · Reviewed מעל שנה אחת ago

Van Khanh N. · Reviewed מעל שנה אחת ago

Atul P. · Reviewed מעל שנה אחת ago

Rahul G. · Reviewed מעל שנה אחת ago