How to train h2o automl models iteratively

I was trying to train using h2o.automl(). But the training exited due to timeout. I know max_runtime_secs can be set to higher numbers. But it would be great if we can train for 1 hour, then save...

H20 - ncpus exceeded

I am trying to run h2o.automl() but it keeps failing because i am running out of ncpus. I initiate my h20 session by requesting 47 threads: h2o.init(nthreads=47) I am providing a sufficent amount...

Can Google's AutoML export trained models for offline inference?

AutoML seems great. One big question is that - can we export the trained model for offline inference, such as with tensorflow or tensoflow lite?

Return Score from AutoML PredictResponse Object

I'm trying to pull the score values out of my google automl PredictResponse Object. the object returned from the API looks as follows: payload { classification { score: 0.989063024521 } ...

Can I use Google Cloud data labeling service to do text classification?

I have a large dataset with lots of news articles, stored in Google Cloud Storage. I want to train a sentiment classifier (positive, negative, neutral). Does Google has a data labeling service...

Problem with "metalearner" for multi-class classification in H2O AutoML (3.24.0.5) implemented in R

I am trying H2O AutoML for multi-class classification. Everything seems to be working fine except when I am trying to extract the variable importance from metalearner for the StackedEnsemble. This...

Error: Could not load the default credentials (Firebase function to firestore)

I am attempting to write an onCall function for Firebase Cloud Functions that performs advanced querying tasks on a firestore database (i.e. checking a text query up against AutoML natural lang to...

Create .jsonl files from .csv

I want to use AutoML, specifically the Entity extraction, however, I'm asked to upload a .jsonl file. I don't know that a .jsonl file is nor how to create it. I only have a .csv file. So, how can...

How to run code in a debugging session from VS code on a remote using an interactive session?

I am using a cluster (similar to slurm but using condor) and I wanted to run my code using VS code (its debugger specially) and it's remote sync extension. I tried running it using my debugger in...

AutoML Vision: Error: ImportData stopped due to too many errors

I selected to create a dataset in the AutoML Vision UI like so: I get this: Error: ImportData stopped due to too many errors. Notice that it tells me that I have errors in my csv file, but it...

google ai platform vs ml engine

I did lots of search, but I cannot understand what the difference between google ai platform and ml engine. It seems that both of them can be used for training and deploying models. Other words...

How can I port a model (GLM) from h2o to scikit-learn?

I'm trying to train a ML algorithm to predict some data (real numbers). I successfully used h2o automl to find a model that predicts my variable almost perfectly (max error in 16k+ test...

How to load checkpoints across different versions of pytorch (1.3.1 and 1.6.x) using ppc64le and x86?

As I outlined here I am stuck using old versions of pytorch and torchvision due to hardware e.g. using ppc64le IBM architectures. For this reason, I am having issues when sending and receiving...

Why is Cloud AutoML Vision rotating my image?

I've imported images from my computer to my Cloud AutoML dataset in the form of zip file and I've noticed that the orientation of my images were altered. The orientation of my photos is important...

Annotation specs - AutoML (GCP)

I'm using the Natural Language module on Google Cloud Platform and more specifically AUTOML for text classification. I come across this error which I do not understand when I have finished...

Using apache-airflow-providers-snowflake on airflow (no module named Snowflake)

I have installed package apache-airflow-providers-snowflake on airflow on docker and i am getting error No module named Snowflake Please refer attachment (check the error mentioned for the...

Time series forecasting on GCP AutoML

According to this Google AI's blogpost, Google designed an AutoML end-to-end pipeline with a specialized search space for time series forecasting. This AutoML forecasting solution has already been...

Why does my pytorch distributed training (DDP) code send a SIGKILL signal on its own?

My code runs for a few interactions but before ending the training it sends a SIGKILL for some unknown reason: backend='nccl' rank=1 mp.current_process()=<SpawnProcess name='SpawnProcess-2'...

How to access H2O Flow when using Google Colab

Does anyone know how to access H2O Flow when using Google Colab? My code is as follows: !pip install H2O import h2o h2o.init(bind_to_localhost=False, log_dir="./") from google.colab.output import...

While using AutoML from EvalML getting error AttributeError: 'DataTable' object has no attribute 'to_series'

I am running eval.automl on a data, made a class column as below: df.loc[(df.quality<6), 'flag_class'] = 1 df.loc[(df.quality==6), 'flag_class'] = 2 df.loc[(df.quality>6), 'flag_class'] = 3 then...

SSL Error accessing azure datastore for Azure Auto ML

I am implementing Azure AutoML dashboard in a docker container. When I access container without Docker it works. But in docker it gives SSL Error. def upload_dataset_to_blob(ws): datastore =...

Python AWS Lambda Error "libgomp.so.1: cannot open shared object file: No such file or directory" from AWS EFS file system mounted on Ubuntu

I have an AWS lambda function connected to an AWS EFS mounted on a EC2 instance of Ubunutu 18. I am getting this error below when importing a LightGBM model i believe. { "errorMessage":...

Creating a parametrized Vertex AI pipeline in GCP

In our application, we currently expose a UI where a user can select some basic settings (model type, input features, hyperparameters) to specify a forecast model. Every time a user specifies such...

AutoML training pipeline job failed. Where can I find the logs?

I am using Vertex AI's AutoML to train a model an it fails with the error message show below. Where can I find the logs for this job? Training pipeline failed with error message: Job failed. See...

How does one install pytorch 1.9 in an HPC that seems to refuse to cooperate?

I've been trying to install PyTorch 1.9 with Cuda (ideally 11) on my HPC but I cannot. The cluster says: Package typing-extensions conflicts for: typing-extensions torchvision -> pytorch==1.8.1 ->...

H2OServerError: HTTP 500 Server Error: While training automl

I receive following error while training an auto ml model from h2o. H2OServerError: HTTP 500 Server Error: Server error java.lang.NullPointerException: Error: Caught exception:...

How does one pip install torch 1.9.x with cuda 11.1 when errors related with memory issue arise?

I was trying to install torch 1.9.x with pip3 but I get this error: (metalearning_gpu) miranda9~/automl-meta-learning $ pip3 install torch==1.9.0+cu111 torchvision==0.10.0+cu111 torchaudio==0.9.0...

R - H20 - ERROR: Unexpected HTTP Status code: 500 Server Error - java.lang.NullpointerException

I'm brand new in the use of h2o (trough R) and have now encountered a problem when using h2o.automl. The problem is very much similar to that of another thread...

batch predictions in GCP Vertex AI

While trying out batch predictions in GCP Vertex AI for an AutoML model, the batch prediction results span over several files(which is not convenient from a user perspective). If it would have...

Using model for prediction in Vertex AI (Google Cloud Platform)

I am following a tutorial of Vertex AI on google cloud, based on colab (text...