add dbt integration tests

[osmazur]

Add dbt integration tests, packages edition:

• dbt snowplow
• dbt utils
  Configured to run against snowflake or embucket.
  Structure:
• profiles.yml, is a file to set the connection to the dbt.
• repos.yml, contain git links to the dbt packages available to run integration tests
• repos_full_list.yml, contain all the packages with the integration tests
• requiremets.txt
• run_test.sh, bash file configured to run integration tests (setup dbt, env, load the package and run dbt commands)
• upload.py and Web_Analytics_sample_events.csv, files to create the embucket database
• packages folder, stores the logs in log/<package_name>/* directory. Not pushed into the repo, you will see it locally after the run.
• logs folder, stores the cloned package in /packages/<package_name> directory. Not pushed into the repo, you will see it locally after the run.

[rampage644]

I think we technically don't have this API easily working (since UI now requires some other attributes like worksheet_id and authentication token), here is the code I used to create schema that might be better fit here

def create_table(database, schema, table, query):
    import snowflake.connector

    USER = os.getenv("SNOWFLAKE_USER", "xxx")
    PASSWORD = os.getenv("SNOWFLAKE_PASSWORD", "yyy")
    ACCOUNT = os.getenv("SNOWFLAKE_ACCOUNT", "acc")
    DATABASE = os.getenv("SNOWFLAKE_DATABASE", database)
    SCHEMA = os.getenv("SNOWFLAKE_SCHEMA", schema)
    WAREHOUSE = os.getenv("SNOWFLAKE_WAREHOUSE", "")

    con = snowflake.connector.connect(
        host=os.getenv("SNOWFLAKE_HOST", "localhost"),
        port=os.getenv("SNOWFLAKE_PORT", 3000),
        protocol=os.getenv("SNOWFLAKE_PROTOCOL", "http"),
        user=USER,
        password=PASSWORD,
        account=ACCOUNT,
        warehouse=WAREHOUSE,
        database=DATABASE,
        schema=SCHEMA,
        session_parameters={
            "QUERY_TAG": "dbt-testing",
        },
    )

    cursor = con.cursor()
    cursor.execute(f"CREATE SCHEMA IF NOT EXISTS {database}.{schema}")
    cursor.execute(query)

[rampage644]

@osmazur Feel free to mark conversation as resolved and merge