When making hundred or thousands of API calls things can quickly get really slow in a single threaded application. No matter how well your own code runs you’ll be limited by network latency and response time of the remote server. Making 10 calls with a 1 second response is maybe OK but now try 1000. …
Author archives: Bob Peers
Using Python with One Time Passwords (2FA)
Ever wanted to automate a process involving a vendor website and come across this. Me too 😔 One time passwords (aka MFA, 2FA, or two factor authentication as I’ll say from here on) are something everyone should use and are great for security, not so great for automation. Until recently I thought this was hard …
Continue reading “Using Python with One Time Passwords (2FA)”
Do What I Mean!
DWIM (do what I mean) computer systems attempt to anticipate what users intend to do, correcting trivial errors automatically rather than blindly executing users’ explicit but potentially incorrect inputs. https://en.wikipedia.org/wiki/DWIM When I hear about the AI singularity and how no one will have jobs in 10 years I usually just laugh. Computers and software are really, …
Why are Logistics Carriers so Bad with Data?
Just to be clear when I say Logistic Carriers I mean UPS, DHL, DSV, GLS and many other three letter companies that deliver your Christmas presents, but in a business context they are also responsible for B2B deliveries of goods to shops and warehouses. I’ve previously worked in Logistics for many years and so have …
Continue reading “Why are Logistics Carriers so Bad with Data?”
Loading Private Python Libraries to Alteryx at Runtime
The python tool in Alteryx is a great resource that I often use but it can easily get very cluttered with lots of reusable code that could easily be moved out and imported as a library. Unfortunately by default you can’t just use the standard import statement since the location of your workflow at runtime …
Continue reading “Loading Private Python Libraries to Alteryx at Runtime”
Converting xls to xlsx files in Alteryx
There are numerous threads on the Alteryx Community where people are asking how to covert xls files to xlsx. The solutions generally suggest one of two approaches, either Read the file in with an Input Data tool then output again in the new format Use the Run Command tool to use an an Excel component …
Jupyter Notebook Shortcut on MacOS using Anaconda
It’s not immediately clear on Mac OS how to start a Jupyter Notebook if you’re using Anaconda. The actual executable is located at /Users/*YOURUSER*/opt/anaconda3/bin/jupyter-notebook but it can be a pain to either type the full link or even worse start the Anaconda application first just to open a notebook. The easiest way I found is to …
Continue reading “Jupyter Notebook Shortcut on MacOS using Anaconda”
Brew Permissions Error
I recently installed Homebrew on my MacBook and immediately hit permissions issues (I’m running Catalina v 10.15.2 (19C57) and it seems permissions are an issue for many apps). Trying to install wget gave this error. If you look at the permissions on the .config folder you immediately see the problem. By default it’s owned by …
The Knowledge Curve
Having recently changed jobs to become a Consultant after working 15 years in the Retail Industry I think about this chart a lot. I’m personally at a stage where I think I know quite a bit but I’m mostly overwhelmed by how much more there is to know 🤯 I also need to become more …
IoT Sensors – Saving Collected Data
Now that my sensors are successfully collecting data and the data is being processed by a Node-RED flow on my Raspberry Pi the final step is to add some persistence to the data. As it stands the data is constantly streaming and being displayed on a dashboard but after that it’s discarded so there’s no …