Skip to content

Instantly share code, notes, and snippets.

View netoferraz's full-sized avatar
🤖

José Ferraz Neto netoferraz

🤖
View GitHub Profile
@netoferraz
netoferraz / L0_app_coll_comparison_20260329_202256.txt
Created March 29, 2026 21:30
PR 855 Definitive Validation Results
20:22:58 Running with dbt=1.11.7
20:22:58 Registered adapter: snowflake=1.11.3
20:22:59 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
There are 2 unused configuration paths:
- models.bizops.serve_airbyte
- models.bizops.v2.serve_salesforce
20:23:01 Found 945 models, 102 snapshots, 2310 data tests, 282 sources, 1 exposure, 912 macros
20:23:01 analytics X PROD_STAGE X STG_SF__APP_COLLECTION
20:23:04 analytics X DBT_JNETO X STG_SALESFORCE__APP_COLLECTION__C_V2_TO_COMPARE
20:23:05
20:22:58 Running with dbt=1.11.7
20:22:58 Registered adapter: snowflake=1.11.3
20:22:59 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
There are 2 unused configuration paths:
- models.bizops.serve_airbyte
- models.bizops.v2.serve_salesforce
20:23:01 Found 945 models, 102 snapshots, 2310 data tests, 282 sources, 1 exposure, 912 macros
20:23:01 analytics X PROD_STAGE X STG_SF__APP_COLLECTION
20:23:04 analytics X DBT_JNETO X STG_SALESFORCE__APP_COLLECTION__C_V2_TO_COMPARE
20:23:05
@netoferraz
netoferraz / L0_stg_task_comparison_20260329_182802.txt
Created March 29, 2026 19:42
Validation Attachments for PR 854 (Task Migration)
18:28:03 Running with dbt=1.11.7
18:28:04 Registered adapter: snowflake=1.11.3
18:28:05 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
There are 2 unused configuration paths:
- models.bizops.v2.serve_salesforce
- models.bizops.serve_airbyte
18:28:07 Found 928 models, 102 snapshots, 2300 data tests, 285 sources, 1 exposure, 912 macros
18:28:07 analytics X PROD_STAGE X STG_SF__TASKS_AND_ACTIVITIES_ALL
18:28:08 analytics X DBT_JNETO_stage_v2 X STG_SALESFORCE__TASK_TO_COMPARE
18:28:10
@netoferraz
netoferraz / comparison_summary_20260328_005921.txt
Created March 28, 2026 14:49
BIZOPS-4545: Monthly Event Usage Migration - Comparison Results
Monthly Event Usage Migration - Comparison Summary
Generated: 20260328_005921
================================================================================
================================================================================
stg_monthly_event_usage
================================================================================
01:00:18 Running with dbt=1.10.13
01:00:18 Registered adapter: snowflake=1.10.2
@netoferraz
netoferraz / pipelines.py
Created February 5, 2022 12:48
A MongoDB ItemPipelines for Scrapy
from pymongo import MongoClient
from itemadapter import ItemAdapter
class MongoPipeline:
def __init__(
self,
username,
password,
database,
import json
import pika
import functools
import logging
import logging.handlers
log_file_name = 'logs/publisher_rabbitmq.log'
logging_level = logging.DEBUG
# Logging settings
import pika
import functools
import logging
import logging.handlers
log_file_name = 'logs/consumer_rabbitmq.log'
logging_level = logging.DEBUG
# Logging settings
formatter = logging.Formatter(
@netoferraz
netoferraz / markdown-details-collapsible.md
Created January 9, 2021 20:40 — forked from pierrejoubert73/markdown-details-collapsible.md
How to add a collapsible section in markdown.

A collapsible section containing markdown

Click to expand!

Heading

  1. A numbered
  2. list
    • With some
    • Sub bullets
import time
import numpy as np
import pandas as pd
import nlp_pre_processing
# An internal NLP lib to process text
nlp = nlp_pre_processing_library.NLPPreprocessor()
# Multiprocessing library that uses pool
# to distribute the task for all processors