This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [0m20:22:58 Running with dbt=1.11.7 | |
| [0m20:22:58 Registered adapter: snowflake=1.11.3 | |
| [0m20:22:59 [[33mWARNING[0m]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. | |
| There are 2 unused configuration paths: | |
| - models.bizops.serve_airbyte | |
| - models.bizops.v2.serve_salesforce | |
| [0m20:23:01 Found 945 models, 102 snapshots, 2310 data tests, 282 sources, 1 exposure, 912 macros | |
| [0m20:23:01 analytics X PROD_STAGE X STG_SF__APP_COLLECTION | |
| [0m20:23:04 analytics X DBT_JNETO X STG_SALESFORCE__APP_COLLECTION__C_V2_TO_COMPARE | |
| [0m20:23:05 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [0m20:22:58 Running with dbt=1.11.7 | |
| [0m20:22:58 Registered adapter: snowflake=1.11.3 | |
| [0m20:22:59 [[33mWARNING[0m]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. | |
| There are 2 unused configuration paths: | |
| - models.bizops.serve_airbyte | |
| - models.bizops.v2.serve_salesforce | |
| [0m20:23:01 Found 945 models, 102 snapshots, 2310 data tests, 282 sources, 1 exposure, 912 macros | |
| [0m20:23:01 analytics X PROD_STAGE X STG_SF__APP_COLLECTION | |
| [0m20:23:04 analytics X DBT_JNETO X STG_SALESFORCE__APP_COLLECTION__C_V2_TO_COMPARE | |
| [0m20:23:05 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [0m18:28:03 Running with dbt=1.11.7 | |
| [0m18:28:04 Registered adapter: snowflake=1.11.3 | |
| [0m18:28:05 [[33mWARNING[0m]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. | |
| There are 2 unused configuration paths: | |
| - models.bizops.v2.serve_salesforce | |
| - models.bizops.serve_airbyte | |
| [0m18:28:07 Found 928 models, 102 snapshots, 2300 data tests, 285 sources, 1 exposure, 912 macros | |
| [0m18:28:07 analytics X PROD_STAGE X STG_SF__TASKS_AND_ACTIVITIES_ALL | |
| [0m18:28:08 analytics X DBT_JNETO_stage_v2 X STG_SALESFORCE__TASK_TO_COMPARE | |
| [0m18:28:10 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Monthly Event Usage Migration - Comparison Summary | |
| Generated: 20260328_005921 | |
| ================================================================================ | |
| ================================================================================ | |
| stg_monthly_event_usage | |
| ================================================================================ | |
| [0m01:00:18 Running with dbt=1.10.13 | |
| [0m01:00:18 Registered adapter: snowflake=1.10.2 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from pymongo import MongoClient | |
| from itemadapter import ItemAdapter | |
| class MongoPipeline: | |
| def __init__( | |
| self, | |
| username, | |
| password, | |
| database, |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import json | |
| import pika | |
| import functools | |
| import logging | |
| import logging.handlers | |
| log_file_name = 'logs/publisher_rabbitmq.log' | |
| logging_level = logging.DEBUG | |
| # Logging settings |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import pika | |
| import functools | |
| import logging | |
| import logging.handlers | |
| log_file_name = 'logs/consumer_rabbitmq.log' | |
| logging_level = logging.DEBUG | |
| # Logging settings | |
| formatter = logging.Formatter( |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import time | |
| import numpy as np | |
| import pandas as pd | |
| import nlp_pre_processing | |
| # An internal NLP lib to process text | |
| nlp = nlp_pre_processing_library.NLPPreprocessor() | |
| # Multiprocessing library that uses pool | |
| # to distribute the task for all processors |