How to assign an integer value to "key.data" in Berkeley DB using C

Off lately I am working with Berkeley DB. I have seen examples wherein people have used "string" as values to "key.data" while creating a database using Berkeley DB. I want to assign an integer...

Writing dBase III+ DBF and FPT with C#

to support a rather old application I would like to write a dBase III+-File with C# that can be used in the legacy application directly. To do so I have to create files containing a 0xF5 in the...

Azure App Gateway V2 cannot be configured with NSG

I have provisioned App Gateway with WAF V2 SKU. Then, I have configured back-end pool to point to WebApp and added IP restrictions to allow only traffic from WAF IP. Then, i am attempting to add...

Installed dbt but getting error "DBT command not found error"

I would like to use dbt (Data build tool) in one of my project. I am facing hurdle while creating a project or using DBT command. I have completed the installation process as described on DBT...

What is the .user.yml file? What is its purpose?

I'm starting with DBT. When I ran my project it created a .user.yml file. Its content: {id: c8e8abd2-09a3-4699-b444-3ef7ee5b04e5} It seems from this github issue that it's some kind of cookie,...

Oracle XE 18c create database error "[DBT-50000] Unable to check for available memory" through DBCA

I have just installed Oracle XE 18c on my Windows 8.1 machine. I am trying to create a new database through Advanced Configuration but when I get to Configuration settings step, it throws an...

dbt to snowflake connections fails via profiles.yml

I'm trying to connect to snowflake via dbt but connections fail with the error below: Using profiles.yml file at /home/myname/.dbt/profiles.yml Using dbt_project.yml file at...

while running the dbt run command gets error

connection to dbt and snowfalke was successful but when tried to run this command: $ dbt run it gives this error ERROR: Runtime Error Could not find profile named 'learn_dbt' Encountered an...

Can dbt connect to different databases in the same project?

It seems dbt only works for a single database. If my data is in a different database, will that still work? For example, if my datalake is using delta, but I want to run dbt using Redshift, would...

Using a string as an argument in a Jinja macro in dbt

I want to create a dbt macro to simplify the following lines COALESCE(LOWER(tags::TEXT) ~ '.*my-first-query.*', FALSE), COALESCE(LOWER(tags::TEXT) ~ '.*my-second-query.*',...

Quoting for incremental model partitions to replace - dbt v0.17.2

I'm writing an incremental model for BigQuery using the insert_overwrite strategy and attempting to set the partitions_to_replace using a variable: {% set partitions_to_replace =...

dbt pre-hooks cannot render/find macros?

A dbt_project.yml model pre-hook is failing to render macros. The following implementation: # gold/dbt_project.yml config-version: 2 ... models: gold: +pre-hooks: "{{...

Materialized View vs Table Using dbt

I'm just onboarding dbt and having gone through the tutorial docs I'm wondering if there's a difference between materializing my transformations as views or tables? I'm using Snowflake as the data...

How can I configure DBT Dependencies without manually running dbt deps?

I am new to DBT and currently trying to build a Docker container where I can directly run DBT commands within. I have a file where I export env variables (envs.sh) that looks like: export...

Macro for custom schema names doesn't apply in a dbt package

I have an issue using custom schema names in a dbt package. I use the Macro provided in dbt documentation. {% macro generate_schema_name(custom_schema_name, node) -%} {%- set default_schema =...

For loop with case statements

I am trying to find a way on how I could run for loop to better optimize my script for my case statement. The script shown below has no error however I feel this is too long-winded which can cause...

How to define AVRO schema in external table definition?

Our dbt installation is 0.18.1 packages: package: fishtown-analytics/dbt_utils version: 0.6.2 package: fishtown-analytics/dbt_external_tables version: 0.5.0 We are using the dbt package for...

Incremental update of specific columns of data in dbt

Given a table with say, 20 columns, my current model already inserts all the records into the table. However, I'd like to focus my incremental updates on a couple of columns specifically. For...

Add index to dbt model column?

We are considering using dbt to manage models in our PostgreSQL data warehouse. Since dbt models are SQL select statements, there doesn't seem to be an obvious, or documented, way to specify that...

Run dbt without compiling

Is it possible to do a dbt run with the already compiled code without the compilation being run again? I have a project that takes a lot to compile and the running time is quite low, and I have to...

Azure Pipeline -- Authenticate once to Azure for all subsequent steps

Problem In an Azure DevOps (ADO) pipeline, I need to run 5+ bash steps that each require authentication to Azure. I want to authenticate once in the first step, and have the cached token be...

DBT select Big Query table from different Google Project

I am using DBT to read and write tables in Big Query, all running in my Google project X. I have one table which I want to read in from a different Google project Y and put in a DBT model (which...

How to use DBT with AWS Managed Airflow?

hope you are doing well. I wanted to check if anyone has get up and running with dbt in aws mwaa airflow. I have tried without success this one and this python packages but fails for some reason...

How to use Update statement in DBT

How to use Update statment in DBT? We created table in Snowflake using DBT but unable to use Update query to update the same table. Is there any other way that we can achieve this , like other...

dbt depends on a source not found

Could you please help me with this issue? Encountered an error: Compilation Error in model metrics_model (models\example\metrics_model.sql) Model 'model.test_project.metrics_model'...

How do I loop through nested structs using Jinja in DBT?

I'm trying to build a model in DBT that flattens out a struct with name properties that contains about a hundred structs inside it (e.g. property1, property2, etc.), each with 5 different columns...

How to add a Jinja function to .sqlfluff config

I'm using the jinja functions run_query and execute. https://docs.getdbt.com/reference/dbt-jinja-functions/run_query But when sqlfluff lint I get the following error: Undefined jinja template...

In dbt, when I add a well formatted .yml file to my project, I stop being able to run dbt or compile SQL until I delete the yaml file. Why?

Thank you in advance for helping me in my journey! I am a dbt newb, doing the dbt fundamentals course. I am following the directions exactly. Sequence of the issue: I created .sql files in my...

DBT to add comments to snowflakes columns

We use DBT for ELT in snowflake. Want to add comments to each column in Snowflake. Either using COMMENT or ALTER command after every full refresh. Decided to add macros with commands and call it...

dbt post hook relation "my_table" does not exist

I am building some models using dbt. I have a model so - SELECT COALESCE( col1, col2 ) AS col, .... FROM {{ source( 'db', 'tbl' ) }} WHERE .... This model has a config...