/data/gmlab_envs/gmqr_311_tps_20250924/bin/python3.11 /home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py
07/06/2026 19:10:52 - [environment.py][check_variables : Line 258] - INFO:gmlab_env.core.environment - Path for slo_path does not exist.
07/06/2026 19:10:52 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable JAVA_HOME = /usr/lib/jvm/java-17-openjdk-amd64
07/06/2026 19:10:52 - [credentials.py][get_credentials : Line 107] - CRITICAL:gmlab_env.core.credentials - Empty credentials.
07/06/2026 19:10:52 - [environment.py][load_credentials : Line 453] - INFO:root - "Credentials summary for gmlab_monitoring/project_monitoring//pyproject.toml – Loaded: [] – Not loaded: []
07/06/2026 19:10:54 - [credentials.py][get_credentials : Line 107] - CRITICAL:gmlab_env.core.credentials - Empty credentials.
07/06/2026 19:10:54 - [environment.py][load_credentials : Line 453] - INFO:root - "Credentials summary for gmlab_spark/pyproject.toml – Loaded: [] – Not loaded: []
07/06/2026 19:11:00 - [credentials.py][add_secret_keys : Line 76] - INFO:gmlab_env.core.credentials - Loading secret key for gmlab_equities_time_series_foundation_models_dev [s3_buckets].
2026-07-06 19:11:00,752 - INFO - ================================================================================
2026-07-06 19:11:00,752 - INFO - HAWK CLEAN SUBSET - TWO-STAGE EXACT OBJECT GROUPING
2026-07-06 19:11:00,752 - INFO - ================================================================================
2026-07-06 19:11:00,752 - INFO - Run id: 20260706T171100Z
2026-07-06 19:11:00,752 - INFO - Input raw subset: s3://FR_DEV_S3_gmlab_equities_time_series_foundation_models/hawk/raw_subset/
2026-07-06 19:11:00,752 - INFO - Temporary shuffle: s3://FR_DEV_S3_gmlab_equities_time_series_foundation_models/tmp_clean_subset/
2026-07-06 19:11:00,752 - INFO - Final clean output: s3://FR_DEV_S3_gmlab_equities_time_series_foundation_models/hawk/clean_subset/
2026-07-06 19:11:00,753 - INFO - Metadata directory: /home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/hawk_clean_subset_metadata/two_stage_exact_20260706T171100Z
2026-07-06 19:11:00,753 - INFO - Object buckets: 2048
2026-07-06 19:11:00,753 - INFO - ================================================================================
2026-07-06 19:11:00,753 - INFO - PHASE 1 - READ CATALOGUE
2026-07-06 19:11:00,753 - INFO - ================================================================================
07/06/2026 19:11:00 - [environment.py][load_credentials : Line 453] - INFO:root - "Credentials summary for gmlab_projects/time_series_foundation_models/pyproject.toml – Loaded: [('s3_buckets', 'gmlab_equities_time_series_foundation_models_dev')] – Not loaded: []
07/06/2026 19:11:00 - [environment.py][load_credentials : Line 453] - INFO:root - "Credentials summary for gmlab_projects/time_series_foundation_models/pyproject.toml – Loaded: [] – Not loaded: []
2026-07-06 19:11:07,646 - INFO - Catalogue rows: 1,867,883
2026-07-06 19:11:07,647 - INFO - ================================================================================
2026-07-06 19:11:07,647 - INFO - PHASE 2 - LIST RAW_SUBSET FILES
2026-07-06 19:11:07,647 - INFO - ================================================================================
2026-07-06 19:11:33,462 - INFO - Raw subset parquet files found: 48,255
2026-07-06 19:11:33,462 - INFO - ================================================================================
2026-07-06 19:11:33,462 - INFO - PHASE 3 - CLEAN TEMPORARY SHUFFLE PREFIX
2026-07-06 19:11:33,462 - INFO - ================================================================================
2026-07-06 19:11:33,462 - INFO - Deleted previous temporary shuffle prefix: s3://FR_DEV_S3_gmlab_equities_time_series_foundation_models/tmp_clean_subset/
2026-07-06 19:11:33,462 - INFO - ================================================================================
2026-07-06 19:11:33,462 - INFO - PHASE 4 - STAGE 1 BUCKETIZE BY OBJECT_NAME
2026-07-06 19:11:33,462 - INFO - ================================================================================
2026-07-06 19:11:33,467 - INFO - Stage 1 tasks: 4,826
07/06/2026 19:11:33 - [spark_session.py][create_context : Line 147] - INFO:root - start_spark_session app_name=HAWK_CLEAN_STAGE1_OBJECT_BUCKETIZE, mode=iv2_yarn, executor_instances=60
07/06/2026 19:11:33 - [spark_session.py][create_context : Line 149] - INFO:root - Using executors 60
07/06/2026 19:11:33 - [environment.py][load_paths : Line 147] - INFO:gmlab_env.core.environment - Provided path /home/h50012/gmlab_config/cyberark/gmlab_v4.slo for slo_path does not exist.
07/06/2026 19:11:33 - [environment.py][load_variable : Line 219] - CRITICAL:root - No Valid Local Path found for PYSPARK_VERSION
07/06/2026 19:11:33 - [environment.py][load_variable : Line 219] - CRITICAL:root - No Valid Local Path found for YARN_RESOURCEMANAGER_SCHEDULER_PORT
07/06/2026 19:11:33 - [environment.py][load_variable : Line 219] - CRITICAL:root - No Valid Local Path found for YARN_RESOURCEMANAGER_ADDRESS_PORT
07/06/2026 19:11:33 - [environment.py][load_variable : Line 219] - CRITICAL:root - No Valid Local Path found for HDFS_PORT
07/06/2026 19:11:33 - [environment.py][load_variable : Line 219] - CRITICAL:root - No Valid Local Path found for SPARK_HOST
07/06/2026 19:11:33 - [environment.py][check_variables : Line 258] - INFO:gmlab_env.core.environment - Path for slo_path does not exist.
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable PYSPARK_VERSION = 3.5.1
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable PYSPARK_PYTHON = /data/gmlab_envs/gmqr_311_tps_20250924/bin/python
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable YARN_RESOURCEMANAGER_SCHEDULER_PORT = 7080
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable YARN_RESOURCEMANAGER_ADDRESS_PORT = 7082
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable HDFS_PORT = 7099
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable YARN_HOME = /data/gmlabcompute_nas/yarn/spark-3.5.1-bin-hadoop3
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable SPARK_HOST = 10.118.64.190
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable JAVA_HOME = /usr/lib/jvm/java-17-openjdk-amd64
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable SPARK_HOME = /data/gmlabcompute_nas/yarn/spark-3.5.1-bin-hadoop3
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable HADOOP_HOME = /data/gmlabcompute_nas/yarn/hadoop
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable PYSPARK_DRIVER_PYTHON = /data/gmlab_envs/gmqr_311_tps_20250924/bin/python
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable HADOOP_CONF_DIR = /data/gmlabcompute_nas/yarn/hadoop/etc/hadoop
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable YARN_CONF_DIR = /data/gmlabcompute_nas/yarn/hadoop/etc/hadoop
07/06/2026 19:11:33 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable _JAVA_OPTIONS = -Djava.io.tmpdir=/data/tmp_spark
07/06/2026 19:11:33 - [spark_environment.py][_check_pyspark : Line 132] - INFO:root - Spark modules successfully loaded!
07/06/2026 19:11:33 - [spark_session.py][create_context : Line 183] - INFO:root - Spark Context configuration: spark.master=yarn
spark.app.name=Ayoub_MARZOUG_eurvlii138651_3.5.1_HAWK_CLEAN_STAGE1_OBJECT_BUCKETIZE
spark.scheduler.mode=FAIR
spark.dynamicAllocation.maxExecutors=60
spark.hadoop.yarn.resourcemanager.hostname=10.118.64.190
spark.hadoop.yarn.resourcemanager.address=10.118.64.190:7082
spark.hadoop.yarn.resourcemanager.scheduler.address=10.118.64.190:7080
spark.hadoop.fs.defaultFS=hdfs://10.118.64.190:7099
spark.yarn.am.memory=16g
spark.driver.memory=16g
spark.executor.memory=8g
spark.driver.maxResultSize=2g
spark.python.worker.memory=2g
spark.rpc.message.maxSize=2047
spark.executor.heartbeatInterval=10s
spark.network.timeout=300s
spark.executor.instances=60
spark.task.cpus=1
spark.executor.cores=1
spark.cores.max=60
spark.driver.port=50065
spark.blockManager.port=50565
spark.broadcast.port=49064
spark.fileserver.port=49063
spark.replClassServer.port=49062
spark.ui.port=50566
spark.port.maxRetries=3000
spark.dynamicAllocation.enabled=True
spark.dynamicAllocation.shuffleTracking.enabled=True
spark.dynamicAllocation.executorIdleTimeout=5s
spark.shuffle.service.port=2504
spark.yarn.queue=best_effort
spark.task.maxFailures=100
spark.excludeOnFailure.enabled=True
spark.excludeOnFailure.task.maxTaskAttemptsPerExecutor=5
spark.executorEnv.PYTHONPATH=.:HAWK_CLEAN_STAGE1_OBJECT_BUCKETIZE.zip
spark.executorEnv.GMLAB_RUNTIME_MODE=unknown
Picked up _JAVA_OPTIONS: -Djava.io.tmpdir=/data/tmp_spark
Picked up _JAVA_OPTIONS: -Djava.io.tmpdir=/data/tmp_spark
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
26/07/06 19:11:35 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
26/07/06 19:11:37 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
07/06/2026 19:11:53 - [spark_utils.py][create_pyzip_from_config : Line 146] - INFO:root - Adding files relative to /home/h50012/gmqr_lab
Creating temp file /data/tmp/tmpxfe6_gqx.zip
2026-07-06 22:29:55,582 - INFO - Stage 1 normalized rows: 9,958,436,379
2026-07-06 22:29:55,583 - INFO - Stage 1 temporary rows written: 9,958,436,379
2026-07-06 22:29:55,583 - INFO - ================================================================================
2026-07-06 22:29:55,584 - INFO - PHASE 5 - STAGE 2 APPLY CORE PIPELINE PER COMPLETE OBJECT BUCKET
2026-07-06 22:29:55,584 - INFO - ================================================================================
2026-07-06 22:29:55,585 - INFO - Stage 2 bucket tasks: 2,048
07/06/2026 22:29:55 - [spark_session.py][create_context : Line 147] - INFO:root - start_spark_session app_name=HAWK_CLEAN_STAGE2_CORE_PIPELINE, mode=iv2_yarn, executor_instances=250
07/06/2026 22:29:55 - [spark_session.py][create_context : Line 149] - INFO:root - Using executors 250
07/06/2026 22:29:55 - [environment.py][load_paths : Line 147] - INFO:gmlab_env.core.environment - Provided path /home/h50012/gmlab_config/cyberark/gmlab_v4.slo for slo_path does not exist.
07/06/2026 22:29:55 - [environment.py][load_variable : Line 219] - CRITICAL:root - No Valid Local Path found for PYSPARK_VERSION
07/06/2026 22:29:55 - [environment.py][load_variable : Line 219] - CRITICAL:root - No Valid Local Path found for YARN_RESOURCEMANAGER_SCHEDULER_PORT
07/06/2026 22:29:55 - [environment.py][load_variable : Line 219] - CRITICAL:root - No Valid Local Path found for YARN_RESOURCEMANAGER_ADDRESS_PORT
07/06/2026 22:29:55 - [environment.py][load_variable : Line 219] - CRITICAL:root - No Valid Local Path found for HDFS_PORT
07/06/2026 22:29:55 - [environment.py][load_variable : Line 219] - CRITICAL:root - No Valid Local Path found for SPARK_HOST
07/06/2026 22:29:55 - [environment.py][check_variables : Line 258] - INFO:gmlab_env.core.environment - Path for slo_path does not exist.
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable PYSPARK_VERSION = 3.5.1
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable PYSPARK_PYTHON = /data/gmlab_envs/gmqr_311_tps_20250924/bin/python
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable YARN_RESOURCEMANAGER_SCHEDULER_PORT = 7080
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable YARN_RESOURCEMANAGER_ADDRESS_PORT = 7082
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable HDFS_PORT = 7099
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable YARN_HOME = /data/gmlabcompute_nas/yarn/spark-3.5.1-bin-hadoop3
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable SPARK_HOST = 10.118.64.190
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable JAVA_HOME = /usr/lib/jvm/java-17-openjdk-amd64
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable SPARK_HOME = /data/gmlabcompute_nas/yarn/spark-3.5.1-bin-hadoop3
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable HADOOP_HOME = /data/gmlabcompute_nas/yarn/hadoop
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable PYSPARK_DRIVER_PYTHON = /data/gmlab_envs/gmqr_311_tps_20250924/bin/python
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable HADOOP_CONF_DIR = /data/gmlabcompute_nas/yarn/hadoop/etc/hadoop
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable YARN_CONF_DIR = /data/gmlabcompute_nas/yarn/hadoop/etc/hadoop
07/06/2026 22:29:55 - [environment.py][set_variable : Line 284] - INFO:gmlab_env.core.environment - Set environment variable _JAVA_OPTIONS = -Djava.io.tmpdir=/data/tmp_spark
07/06/2026 22:29:55 - [spark_environment.py][_check_pyspark : Line 132] - INFO:root - Spark modules successfully loaded!
07/06/2026 22:29:55 - [spark_session.py][create_context : Line 183] - INFO:root - Spark Context configuration: spark.app.name=Ayoub_MARZOUG_eurvlii138651_3.5.1_HAWK_CLEAN_STAGE2_CORE_PIPELINE
spark.app.submitTime=1783357895521
spark.blockManager.port=50858
spark.broadcast.port=49357
spark.cores.max=250
spark.driver.maxResultSize=2g
spark.driver.memory=16g
spark.driver.port=50358
spark.dynamicAllocation.enabled=True
spark.dynamicAllocation.executorIdleTimeout=5s
spark.dynamicAllocation.maxExecutors=250
spark.dynamicAllocation.shuffleTracking.enabled=True
spark.excludeOnFailure.enabled=True
spark.excludeOnFailure.task.maxTaskAttemptsPerExecutor=5
spark.executor.cores=1
spark.executor.heartbeatInterval=10s
spark.executor.instances=250
spark.executor.memory=8g
spark.executorEnv.GMLAB_RUNTIME_MODE=unknown
spark.executorEnv.PYTHONPATH=.:HAWK_CLEAN_STAGE2_CORE_PIPELINE.zip
spark.fileserver.port=49356
spark.hadoop.fs.defaultFS=hdfs://10.118.64.190:7099
spark.hadoop.yarn.resourcemanager.address=10.118.64.190:7082
spark.hadoop.yarn.resourcemanager.hostname=10.118.64.190
spark.hadoop.yarn.resourcemanager.scheduler.address=10.118.64.190:7080
spark.master=yarn
spark.network.timeout=300s
spark.port.maxRetries=3000
spark.python.worker.memory=2g
spark.replClassServer.port=49355
spark.rpc.message.maxSize=2047
spark.scheduler.mode=FAIR
spark.shuffle.service.port=2504
spark.submit.deployMode=client
spark.submit.pyFiles=
spark.task.cpus=1
spark.task.maxFailures=100
spark.ui.port=50859
spark.ui.proxyBase=/proxy/application_1783137559818_0136
spark.ui.showConsoleProgress=true
spark.yarn.am.memory=16g
spark.yarn.isPython=true
spark.yarn.queue=best_effort
26/07/06 22:29:55 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
07/06/2026 22:30:13 - [spark_utils.py][create_pyzip_from_config : Line 146] - INFO:root - Adding files relative to /home/h50012/gmqr_lab
Creating temp file /data/tmp/tmp_lu9gqw7.zip
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1846, in <module>
main()
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1806, in main
require_success(
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1424, in require_success
raise RuntimeError(
RuntimeError: Stage 2 core pipeline failed.
Missing IDs: []
bucket_id=0 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=1 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=2 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=3 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=4 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=5 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=6 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=7 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=8 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=9 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=10 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=11 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=12 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=13 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=14 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=15 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=16 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=17 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=18 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
bucket_id=19 NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
Traceback (most recent call last):
File "/home/h50012/gmqr_lab/gmlab_projects/time_series_foundation_models/query/test.py", line 1253, in stage2_process_bucket
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 801, in preprocess_series_frame
daily = apply_maturity_filter(
^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_projects/time_series_foundation_models/core/query/series_statistics.py", line 124, in apply_maturity_filter
maturities = get_sierra_data(found_isin,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_execution/core/batch_function.py", line 49, in wrapped
result = function(arg_i, *args[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 163, in get_sierra_data
return SierraExtract(host=host, id_type=id_type, headers=headers).extract_sierra_data(id_list=id_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/get_sierra_data.py", line 55, in __init__
available_fields = extract_tables_from_markdown((Path(__file__).parent / 'readme.md').as_posix())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./tmp_lu9gqw7.zip/gmlab_utils/gmlab_various/core/file_utils.py", line 70, in extract_tables_from_markdown
with open(path, 'r') as file:
^^^^^^^^^^^^^^^
NotADirectoryError: [Errno 20] Not a directory: 'tmp_lu9gqw7.zip/gmlab_data/gmlab_credit/core/sierra/readme.md'
07/06/2026 23:20:45 - [clientserver.py][ close : Line 543] - INFO:py4j.clientserver - Closing down clientserver connection
Process finished with exit code 14 views