TFX Standard Components Walkthrough Reviews

ok

Aum S. · Reviewed over 3 years ago

Guillaume B. · Reviewed over 3 years ago

Debora E. · Reviewed over 3 years ago

PRATIK G. · Reviewed over 3 years ago

Can't run example_gen. Getting the following error "700117837951-compute@developer.gserviceaccount.com does not have storage.objects.list access to the Google Cloud Storage bucket."

Gaven Y. · Reviewed over 3 years ago

When trying to run the following cells... ### Configure and run CsvExampleGen output_config = example_gen_pb2.Output( split_config=example_gen_pb2.SplitConfig(splits=[ # TODO: Your code to configure train data split # TODO: Your code to configure eval data split example_gen_pb2.SplitConfig.Split(name='train', hash_buckets=4), example_gen_pb2.SplitConfig.Split(name='eval', hash_buckets=1) ])) example_gen = tfx.components.CsvExampleGen( input_base=DATA_ROOT, output_config=output_config) context.run(example_gen) ...the following error occurred: ... INFO:absl:Running driver for CsvExampleGen INFO:absl:MetadataStore with DB connection initialized INFO:absl:select span and version = (0, None) INFO:absl:latest span and version = (0, None) --------------------------------------------------------------------------- PermissionDeniedError Traceback (most recent call last) /tmp/ipykernel_19615/2331334826.py in <module> ----> 1 context.run(example_gen) ~/.local/lib/python3.7/site-packages/tfx/orchestration/experimental/interactive/interactive_context.py in run_if_ipython(*args, **kwargs) 65 # __IPYTHON__ variable is set by IPython, see 66 # https://ipython.org/ipython-doc/rel-0.10.2/html/interactive/reference.html#embedding-ipython. ---> 67 return fn(*args, **kwargs) 68 else: 69 absl.logging.warning( ~/.local/lib/python3.7/site-packages/tfx/orchestration/experimental/interactive/interactive_context.py in run(self, component, enable_cache, beam_pipeline_args) 180 telemetry_utils.LABEL_TFX_RUNNER: runner_label, 181 }): --> 182 execution_id = launcher.launch().execution_id 183 184 return execution_result.ExecutionResult( ~/.local/lib/python3.7/site-packages/tfx/orchestration/launcher/base_component_launcher.py in launch(self) 196 self._component_info.component_id) 197 execution_decision = self._run_driver(self._input_dict, self._output_dict, --> 198 self._exec_properties) 199 200 if not execution_decision.use_cached_results: ~/.local/lib/python3.7/site-packages/tfx/orchestration/launcher/base_component_launcher.py in _run_driver(self, input_dict, output_dict, exec_properties) 165 driver_args=self._driver_args, 166 pipeline_info=self._pipeline_info, --> 167 component_info=self._component_info) 168 169 return execution_decision ~/.local/lib/python3.7/site-packages/tfx/dsl/components/base/base_driver.py in pre_execution(self, input_dict, output_dict, exec_properties, driver_args, pipeline_info, component_info) 275 exec_properties = self.resolve_exec_properties(exec_properties, 276 pipeline_info, --> 277 component_info) 278 input_artifacts = self.resolve_input_artifacts(input_dict, exec_properties, 279 driver_args, pipeline_info) ~/.local/lib/python3.7/site-packages/tfx/components/example_gen/driver.py in resolve_exec_properties(***failed resolving arguments***) 109 # Note that this function updates the input_config.splits.pattern. 110 fingerprint, span, version = utils.calculate_splits_fingerprint_span_and_version( --> 111 input_base, input_config.splits, range_config) 112 113 exec_properties[utils.INPUT_CONFIG_KEY] = json_format.MessageToJson( ~/.local/lib/python3.7/site-packages/tfx/components/example_gen/utils.py in calculate_splits_fingerprint_span_and_version(input_base_uri, splits, range_config) 657 # Calculate fingerprint. 658 pattern = os.path.join(input_base_uri, split.pattern) --> 659 split_fingerprint = io_utils.generate_fingerprint(split.name, pattern) 660 split_fingerprints.append(split_fingerprint) 661 ~/.local/lib/python3.7/site-packages/tfx/utils/io_utils.py in generate_fingerprint(split_name, file_pattern) 144 def generate_fingerprint(split_name: Text, file_pattern: Text) -> Text: 145 """Generates a fingerprint for all files that match the pattern.""" --> 146 files = fileio.glob(file_pattern) 147 total_bytes = 0 148 # Checksum used here is based on timestamp (mtime). ~/.local/lib/python3.7/site-packages/tfx/dsl/io/fileio.py in glob(pattern) 62 def glob(pattern: PathType) -> List[PathType]: 63 """Return the paths that match a glob pattern.""" ---> 64 return _get_filesystem(pattern).glob(pattern) 65 66 ~/.local/lib/python3.7/site-packages/tfx/dsl/io/plugins/tensorflow_gfile.py in glob(pattern) 46 @staticmethod 47 def glob(pattern: PathType) -> List[PathType]: ---> 48 return tf.io.gfile.glob(pattern) 49 50 @staticmethod ~/.local/lib/python3.7/site-packages/tensorflow/python/lib/io/file_io.py in get_matching_files_v2(pattern) 407 compat.as_str_any(matching_filename) 408 for matching_filename in _pywrap_file_io.GetMatchingFiles( --> 409 compat.as_bytes(pattern)) 410 ] 411 else: PermissionDeniedError: Error executing an HTTP request: HTTP response code 403 with body '{ "error": { "code": 403, "message": "502568882998-compute@developer.gserviceaccount.com does not have storage.objects.list access to the Google Cloud Storage bucket.", "errors": [ { "message": "502568882998-compute@developer.gserviceaccount.com does not have storage.objects.list access to the Google Cloud Storage bucket.", "domain": "global", "reason": "forbidden" } ] } } ' when reading gs://workshop-datasets/covertype/small I tried adding rights under IAM (e.g. adding Storage Admin Storage Object Admin to 502568882998-compute@developer.gserviceaccount.com) but that didn't help. Please advice

Michael G. · Reviewed over 3 years ago

Tatiana I. · Reviewed over 3 years ago

The Lab doesn't work!

Hubert J. · Reviewed over 3 years ago

Adarsh P. · Reviewed over 3 years ago

Ketul C. · Reviewed over 3 years ago

Lubna Sarah D. · Reviewed over 3 years ago

DOES NOT WORK! PermissionDeniedError: Error executing an HTTP request: HTTP response code 403 with body '{ "error": { "code": 403, "message": "649143048432-compute@developer.gserviceaccount.com does not have storage.objects.list access to the Google Cloud Storage bucket.", "errors": [ { "message": "649143048432-compute@developer.gserviceaccount.com does not have storage.objects.list access to the Google Cloud Storage bucket.", "domain": "global", "reason": "forbidden" } ] } } ' when reading gs://workshop-datasets/covertype/small gsutil ls gs://workshop-datasets/covertype/small

BRYAN PERCY S. · Reviewed over 3 years ago

Unable to access cloud bucket

Sai V. · Reviewed over 3 years ago

ok

Aum S. · Reviewed over 3 years ago

Suyash K. · Reviewed over 3 years ago

Aum S. · Reviewed over 3 years ago

na

Mahesh B. · Reviewed over 3 years ago

na

Mahesh B. · Reviewed over 3 years ago

Dipshikha C. · Reviewed over 3 years ago

na

Mahesh B. · Reviewed over 3 years ago

The Lab-Work was not easy as compared to the previous labs but it was interesting.

Abhishek S. · Reviewed over 3 years ago

MD S. · Reviewed over 3 years ago