VSCode Dev Container Snowflake

[nstein-gpjoule]

Hi,

I'm trying to get DBT-Core working in a VSCode Dev Container.
My DBT Project works when run directly on MacOS, but I can't get it working inside the Dev Container. I also tried SSO Auth without success.

I the env is available, since we would fail early since we wouldn't have the SF account set.

I really don't know how to debug this.

$ dbt run --target dev --select my_view -d
09:57:38  Sending event: {'category': 'dbt', 'action': 'invocation', 'label': 'start', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb4dbedb0>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb5d3a8d0>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb3ce65a0>]}
09:57:38  Running with dbt=1.8.7
09:57:38  running dbt with arguments {'printer_width': '80', 'indirect_selection': 'eager', 'log_cache_events': 'False', 'write_json': 'True', 'partial_parse': 'True', 'cache_selected_only': 'False', 'warn_error': 'None', 'fail_fast': 'False', 'debug': 'True', 'log_path': '/workspaces/snowfalke-dbt/logs', 'profiles_dir': '/workspaces/snowfalke-dbt', 'version_check': 'True', 'use_colors': 'True', 'use_experimental_parser': 'False', 'no_print': 'None', 'quiet': 'False', 'empty': 'False', 'log_format': 'default', 'static_parser': 'True', 'invocation_command': 'dbt run --target dev --select my_view -d', 'introspect': 'True', 'target_path': 'None', 'warn_error_options': 'WarnErrorOptions(include=[], exclude=[])', 'send_anonymous_usage_stats': 'True'}
09:57:38  Sending event: {'category': 'dbt', 'action': 'project_id', 'label': '1f977c9f-e702-452f-b8df-a80b40cb96af', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb1ff99d0>]}
09:57:38  Sending event: {'category': 'dbt', 'action': 'adapter_info', 'label': '1f977c9f-e702-452f-b8df-a80b40cb96af', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb220fa70>]}
09:57:38  Registered adapter: snowflake=1.8.4
09:57:38  checksum: b72588a61004764de5b9a5a46159da2d5d1870e817a9a65ee379ab1be9083c25, vars: {}, profile: , target: dev, version: 1.8.7
09:57:38  Partial parsing enabled: 0 files deleted, 0 files added, 0 files changed.
09:57:38  Partial parsing enabled, no changes found, skipping parsing
09:57:38  Sending event: {'category': 'dbt', 'action': 'load_project', 'label': '1f977c9f-e702-452f-b8df-a80b40cb96af', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb32dc230>]}
09:57:38  Sending event: {'category': 'dbt', 'action': 'resource_counts', 'label': '1f977c9f-e702-452f-b8df-a80b40cb96af', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb4a3ac60>]}
09:57:38  Found 11 models, 1 operation, 3 sources, 458 macros
09:57:38  Sending event: {'category': 'dbt', 'action': 'runnable_timing', 'label': '1f977c9f-e702-452f-b8df-a80b40cb96af', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb1bfecc0>]}
09:57:38  
09:57:38  Acquiring new snowflake connection 'master'
09:57:38  Acquiring new snowflake connection 'list_MY_DB'
09:57:38  Using snowflake connection "list_MY_DB"
09:57:38  On list_MY_DB: /* {"app": "dbt", "dbt_version": "1.8.7", "profile_name": "my_profile", "target_name": "dev", "connection_name": "list_MY_DB"} */
show terse schemas in database MY_DB
    limit 10000
09:57:38  Opening a new connection, currently in state init
09:57:39  Snowflake adapter: Error running SQL: /* {"app": "dbt", "dbt_version": "1.8.7", "profile_name": "my_profile", "target_name": "dev", "connection_name": "list_MY_DB"} */
show terse schemas in database MY_DB
    limit 10000
09:57:39  Snowflake adapter: Rolling back transaction.
09:57:39  Snowflake adapter: Error running SQL: macro list_schemas
09:57:39  Snowflake adapter: Rolling back transaction.
09:57:39  On list_MY_DB: No close available on handle
09:57:39  Connection 'master' was properly closed.
09:57:39  Connection 'list_MY_DB' was properly closed.
09:57:39  
09:57:39  Finished running  in 0 hours 0 minutes and 1.02 seconds (1.02s).
09:57:39  Encountered an error:
Runtime Error
  Database error while listing schemas in database "MY_DB"
  Database Error
    250001: Could not connect to Snowflake backend after 2 attempt(s).Aborting
09:57:39  Resource report: {"command_name": "run", "command_wall_clock_time": 1.333655, "process_user_time": 0.761142, "process_kernel_time": 0.147609, "process_mem_max_rss": "117976", "process_out_blocks": "1007", "command_success": false, "process_in_blocks": "0"}
09:57:39  Command `dbt run` failed at 09:57:39.946855 after 1.33 seconds
09:57:39  Sending event: {'category': 'dbt', 'action': 'invocation', 'label': 'end', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb3613320>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb1c25f70>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0xffffb1aaf560>]}
09:57:39  Flushing usage events

Dev Container:

{
    "name": "dbt-snowflake",
    "dockerFile": "Dockerfile",
    "context": "..",
    "settings": {
        "terminal.integrated.shell.linux": "/usr/bin/zsh"
    },
    "extensions": [
        "ms-python.python",
        "ms-azuretools.vscode-docker"
    ],
    "remoteUser": "vscode",
    "containerEnv": {
        "SHELL": "/usr/bin/zsh",
        "USER": "vscode",
        "SF_AUTH_SOCKET_ADDR": "localhost", //fix snowflake externalbrowser loopback address
        "SF_AUTH_SOCKET_PORT": 60000,
        "SF_AUTH_SOCKET_REUSEPORT": "true"
    },
    "runArgs": ["--name", "dbt-snowflake",
                "--hostname", "dbt-snowflake",
                "--env-file", "${localWorkspaceFolder}/.env"
    ],
    "forwardPorts": ["60000-60999:60000-60999"],
    "mounts": [
        "source=persist_home,target=/home/vscode,type=volume",
        "source=${localEnv:HOME}/.ssh,target=/home/vscode/.ssh,readonly,type=bind",
        "source=${localEnv:HOME}/.azure,target=/home/vscode/.azure,type=bind"
    ]
}

Dockerfile:

FROM python:3.12-slim-bookworm

ENV DEBIAN_FRONTEND=noninteractive

RUN apt-get update \
  && apt-get install -y --no-install-recommends \
    zsh \
    build-essential \
    libpq-dev \
    git \
    curl \
    wget \
    keychain \
    && apt-get clean \
    && rm -rf /var/lib/apt/lists/*

# Upgrade pip
RUN pip install --upgrade pip

# DBT
COPY ../requirements.txt /tmp/requirements.txt
RUN pip install -r /tmp/requirements.txt \
    && rm -rf /tmp/requirements.txt

# Azure CLI
RUN pip install azure-cli==2.65.0 \
    && pip install --force-reinstall -v "azure-mgmt-rdbms==10.2.0b17"

ARG USERNAME=vscode
ARG USER_UID=1000
ARG USER_GID=$USER_UID

RUN groupadd --gid $USER_GID $USERNAME \
  && useradd --uid $USER_UID --gid $USER_GID -m $USERNAME \
  && chown -R $USERNAME:$USERNAME /home/$USERNAME

WORKDIR /workspaces

USER $USERNAME

# Shell Setup
RUN sh -c "$(wget -O- https://github.com/deluan/zsh-in-docker/releases/download/v1.2.1/zsh-in-docker.sh)" -- \
    -p https://github.com/zsh-users/zsh-syntax-highlighting \
    -p https://github.com/zsh-users/zsh-history-substring-search \
    -p https://github.com/zsh-users/zsh-completions

RUN mkdir -p ~/.oh-my-zsh/completions/ \
    && wget -O ~/.oh-my-zsh/completions/_dbt https://raw.githubusercontent.com/dbt-labs/dbt-completion.bash/refs/heads/master/_dbt

RUN echo "source /usr/local/bin/az.completion.sh" >> /home/$USERNAME/.zshrc