Vertica, describe table

I have a vertica database and I need to describe some tables. In MySQL you use describe table_name. And I know that in vertica it's \d table_name. Also I need to do it throw python, but when I...

Pyodbc: Error while connecting to Vertica

I'm using pyodbc to connect to vertica using a DSN. I have the related information in .odbc.ini and .vertica.ini files. When I try to connect to Vertica using pyodbc, Python 2.7.6 (default, May 11...

Bulk insert into vertica using Python

I am using python to transfer data (~8 million rows) from oracle to vertica. I wrote a python script which transfers the data in 2 hours, but I am looking for ways to increase the transfer...

Vertica Python Connection

I'm trying to connect to a Vertica database via Python. Here is what I have so far. Using vertica_python: ! pip install vertica_python from vertica_python import connect conn_info = {'host':...

Python pandas dataframe to vertica table using vertica-python

I am using python to communicate with vertica. Is there an elegant way to create a new vertica table with a pandas dataframe. I am using vertica-python 0.6.14. The only way I know is to use a for...

Cloud Dataflow Python: Failed to install packages: failed to install workflow

I am trying to test my dataflow pipeline on the DataflowRunner. My code always gets stuck at 1 hr 1min and says: The Dataflow appears to be stuck. When digging through the stack trace of the...

pip install faling with error gevent failed with error code 1 in /private/tmp/pip-build-muEt66/gevent/

I have a virtualenv. Inside the virtualenv i want to install some dependencies from a file. My command being pip intsall -r requirements.txt I am attaching the terminal error output here. First...

How do I connect Vertica to Python on MAC OS?Will I need Unix or Linux Scripting?

I am new to MAC OS , I need to know how do I connect Vertica to Python on MAC OS . I need to know detailed steps for configuration .

Python Vertica: How to use Kerberos authentication with vertica-python module?

I am using Uber's vertica-python native python adaptor (https://github.com/uber/vertica-python), and I am trying to integrate kerberos authentication with it. Is there a way I can do it? Problem:...

vertica-python Error on COPY LOCAL

I was using this code for 'COPY LOCAL' in python on Vertica 7.1: conn_info = {'host': '192.168.1.1', 'port': 5433, 'user': 'dbadmin', 'password': 'xxxxxx', 'database': 'db'} connection =...

Unable to write data to Vertica Database using Python SqlAlchemy - Type "TEXT" does not exist

I am trying to upload pandas dataframe into Vertica Database was able to setup the engine and query database using sqlalchemy. But when I try to upload data from pandas dataframe get error message...

Cannot COPY UTF-8 data to ScyllaDB with cqlsh

I'm trying to copy a large data set from Postgresql to ScyllaDB, which is supposed to be compatible with Cassandra. This is what I'm trying: psql <db_name> -c "COPY (SELECT row_number() OVER () as...

issues with chunksize/ data type mapping when using pandas to_sql with vertica-python

I'm using pandas to_sql method to upload df to vertica. I'm using: sqlalchemy-vertica-python==0.4.4 vertica-python==0.8.2 sqlalchemy==1.2.16 usually , I can use chunksize > 1 and it worked, but...

Grant access to Vertica SQL Tables to everyone using Python

I'm using a Python script to create tables and insert data into them. However, only I'm able to see the tables created. My team members can't view them. How do I change this? What Python...

inconsistent schema when reading parquet and exporting from Vertica

I've noticed weird behaviour when exporting data from Vertica and trying to read it later with parquet (python). Let's say I want to have table dump to parquet: EXPORT TO PARQUET (directory =...

Vertica dynamic pivot/transform

I have a table in vertica : id Timestamp Mask1 Mask2 ------------------------------------------- 1 11:30 50 100 1 11:35 52 101 2 12:00 ...

Unable to use TransformFunction in vertica_sdk

What i am trying to do is execute vertica's string tokenizer example which is written in python. Here is the link to the said...

Query Vertica between dates from PySpark

I have Spark 1.6 running over Python 3.4, retrieve data from my Vertica database to work on it the below query,Spark DataFrames support predicate push-down with JDBC sources but term predicate is...

Error when init Vertica as a database backend for airflow

I'm trying to use airflow with a Vertica database as a backend for metadata. I have configured correctly the airflow.cfg file providing the string connection with Vertica and the schema name. This...

How to connect vertica with apache superset?

I am trying to connect vertica with apache superset in superset --> add database --> SQLAlchemy URI : vertica+vertica_python://dbadmin:[email protected]:5433/test I am running apache superset in...

How to implement connection pooling for a python application connecting to Vertica or PostgreSQL?

I have a python application which interacts with vertica database through vertica python client. Currently there is no connection pool to manage the connections, instead for every request a new...

How to compare same table between Hive, Teradata

We have a situation where we copy same tables to Hive , Teradata and vertica . We have to test and confirm whether the tables were copied exactly between all. As of now we use python to download...

How to connect python with vertica using ODBC?

import sqlalchemy as sa conn = "vertica+pyodbc://dbadmin:[email protected]" sa.create_engine(conn, pool_size=10, max_overflow=20) %load_ext sql %sql...

how to use boto3 create aws glue job with extra jar files?

I am trying to create a aws glue job from my python job with boto3 to access data in HP Vertica database. In order to do this I need to pass a Vertica driver jar file to the job. I tried using...

Python: JDBC Connection Error using JayDeBeApi

I'm facing an error while running following code. Please help me solving this issue or suggest an alternative way to connect Vertica server via JDBC. I have also tried connecting using pyspark....

Why don't SQLAlchemy show up in the search results of `pip3 search SQLAlchemy`?

I wanted to install SQLAlchemy for Python 3 for working with databases. I searched for the package using pip3 search SQLAlchemy, but I didn't find SQLAlchemy as part of the results. Why don't...

TCPListener in golang: error when number of connections is above 60 / 260

I am building TCP Proxy: `client` `proxy` `Vertica` I have a `net.TCPListener`, which takes incoming requests by `AcceptTCP()` and creating connections, then, making connection to destination...

telegram-python-bot ImportError No module named 'cryptography' Alpine Docker

I am trying to run script which sends message to telegram using python-telegram-bot module. The script runs in docker on alpine. The script cannot import Telegram, I get an error...

How to create table-valued functions in Vertica SQL?

Does anyone know how to create table-valued function in Vertica SQL? For example, I want to create a function f_student_name() that takes in input: student_id to return output: student_name in a...

TypeError: __init__() takes 1 positional argument but 2 were given Python

from locust import HttpLocust, TaskSet, task, between, events, Locust, User, HttpUser import vertica_python import time, logging def get_sample_query(): query = ''' SELECT COUNT(*)...