What's the best timing resolution can i get on Linux

I'm trying to measure the time difference between 2 signals on the parallel port, but first i got to know how much accurate and precise is my measuring system (AMD Athlon(tm) 64 X2 Dual Core...

Code coverage using gcov on parallel run

I have C/C++ code coverage setup with gcov for several files in the project. The executables are being run in parallel. This results in some shared piece of code to be run in parallel. I am...

Cuda cudaGetTextureReference returns "invalid texture reference"

Im developing a small cuda lib, stuck by this annoying tex ref issue. This is the sample code from Cuda C Programming Guide, Page43~44: texture<float, cudaTextureType2D,cudaReadModeElementType>...

Find total memory used by Python process and all its children

How can I find the total amount of resident memory used by a Python process and all its forked children? I know that I can use psutil, for example, to find the percentage of a available physical...

How to do asynchronous file copying in Python?

I'm working on a function in Python that takes in a list of file paths and a list of destinations, and copies each file to each of the given destinations. I have the copying portion of this...

Kmeans clustering acceleration in GPU(CUDA)

I am a fairly new cuda user. I'm practicing on my first cuda application where I try to accelerate kmeans algorithm by using GPU(GTX 670). Briefly, each thread works on a single point which is...

Will Xcode compile more Swift files in parallel if you have more cpu cores?

When building a project, I can see Xcode working on 4 Swift files at the same time in the Build Log inside the report navigator. I also see that there are 4 processes in Activity Manager, all...

Why doesn't my OpenCL 3d image lookup work?

I have been having trouble with an OpenCL kernel which I've written producing incorrect results (compared to a reference brute-force CPU implementation). I tracked the problem down to a 3D lookup...

Using Concurrent Futures without running out of RAM

I'm doing some file parsing that is a CPU bound task. No matter how many files I throw at the process it uses no more than about 50MB of RAM. The task is parrallelisable, and I've set it up to use...

Java multi threading performance worst as increasing thread pool size

I have 40 million data in mongoDB. I am reading that data in parallel from collection, processing it and dumping into another collection. Sample code for job initialization. ExecutorService...

Avoid Rate limit with rtweet get_timeline()

Is there anyway to stop my loop from being interrupted by the rate limit? I would like my code to wait to execute until the time limit has passed if possible. A side question: I thought about...

XAML parsing/layout rendering time very high

I've got the problem, that I create an App, that will run on Windows Phone 8.1 and Windows 10 Mobile. This App is a non-UWP Windows Store App. The problem I have is, that I have a list of a custom...

How can I run multiple independent and unrelated functions in parallel without larger code do-over?

I've been searching around the internet, trying to understand parallel processing. What they all seem to assume is that I have some kind of loop function operating on e.g. every Nth row of a data...

How to achieve 100% CPU usage in multithreaded application?

I have ~100 text files 200MB each and I need to parse them. The program below loads files and processes them in parallel. It can create a Thread per file or a Process per file. The problem: If I...

OpenMP Parallel Computing Prime Numbers

The following is simple code for computing prime numbers: #define END 100000000 // Only pass odd values to this function int is_prime(uint32_t v) { uint32_t end = sqrt(v); for (uint32_t...

Multiple large MySQL SELECT queries - better to run in parallel or in a queue?

I have looked up answers to this question a bunch and couldn't find a specific answer - sorry in advance if I missed something! Also, I'm a SQL optimization noob. I have an analytics dashboard...

Parallel Mulit-threaded Downloads using async-await

I have 100s of multiple big files to download from web in my windows service - C#. The requirement is to maintain at one time - max 4 parallel web file downloads. Can I achieve concurrent/parallel...

parallelize genetic algorithm with numba (cuda)

I am making a genetic algorithm on neural nets playing snake for educational purposes I want to be able to run my python code on my gpu (cuda enabled) in order to save some time and accelerate the...

Airflow signals SIGTERM to subprocesses unexpectedly

I am using the PythonOperator to call a function that parallelizes data engineering process as an Airflow task. This is done simply by wrapping a simple function with a callable wrapper function...

How to synchronize Python processes on milliseconds level?

I'm trying to run two Python functions on two cores exactly at the same time. Each process runs a very long loop (theoretically infinite loop). It is important they stay synchronized at the same...

What is limiting number of active workers in a Gradle build?

I am trying to run tests in parallel on my laptop, which has 4 pyhsical and 8 logical CPUs. ➜ sysctl -n hw.ncpu 8 ➜ sysctl -n hw.physicalcpu 4 This is the command that I am...

Parallel Handling Kafka messages in a Windows Service using C#

I have Windows service written in C#. Earlier we were using Event hubs with multiple partitions for message queuing. We recently moved to Kafka. For implementing Event hubs in c# , we have...

How to set seeds when using parallel package in R

I am currently using the parallel package in R and I am trying to make by work reproducible by setting seeds. However, if you set the seed before creating the cluster and performing the tasks you...

Is there a way to parallelly read GB size text files using python script loading in to RAM as chunks?

There is a folder with Gb size text files (most of them are larger than 30 Gb ) and I need to read them and replace " to *. I used sed command to do that. But it was very slow. How to do that...

Design help for parallel processing Azure blob and bulk copy to SQL database. C#

I have a requirement to fetch blob files from Azure storage, read through them, get the data and process it, and store it into a database. The number of data fetched from blob is high, i.e. around...

Run procedures in parallel - Oracle PL/SQL

I am trying to run stored procedures in parallel - Oracle PL/SQL using dbms_scheduler but I am getting an error like an unknown job, I have also tried dbms_job, here I am getting an error-...

Unity/C#, NUnit Parallelizable attribute

I'm using Unity 2019.4.4f1 with NUnit 3.5. I have set up a very simple parallel test between methods to see if it actually works, but they run in sync. I've been looking into NUnit parallel...

PyTorch DataLoader uses same random seed for batches run in parallel

There is a bug in PyTorch/Numpy where when loading batches in parallel with a DataLoader (i.e. setting num_workers > 1), the same NumPy random seed is used for each worker, resulting in any random...

How to retrieve VsTest Test Plan test case id during Azure pipeline is running and use that in automation code

Use Case: Define a Test Plan, Test Suite and add test cases to it on ADO. Link multiple (all) the tests on Test Plan to a single MsTest method. Azure pipeline is setup to run the automation suite...

If each thread needs to resume work, whenever any thread finds some new information, how to wait until all threads have finished?

A Seemingly Simple Synchronization Problem TL;DR Several threads depend on each other. Whenever one of them finds some new information, all of them need to process that information. How to...