Categories
Computing Data Science

Global Warming and Data Science, Episode 2: Data Engineering and Loading into Snowflake

a plastic tool box with tools toy
Photo by Polesie Toys on Pexels.com

In the previous episode, I discussed the goals of my current work side-project: loading a fairly sizable weather data set from NOAA and analyzing is using data science techniques and machine learning.

This post will get into the nitty-gritty of how I went ahead and massaged (‘wrangled’) the data into a form Snowflake finds palatable to digest and load into tables from text/CSV files. Subsequent posts will go into the specifics of the analytics. This is all about the dark art of data engineering. I am not a pro data engineer and many are lucky to have their own tools, so take this with a view of me as a dangerous neophyte.

Continue reading “Global Warming and Data Science, Episode 2: Data Engineering and Loading into Snowflake”
Share
Categories
Computing Data Science

Global Warming: self-learning journey to build the story with data science

road in between grass field under grey sky
Photo by Johannes Plenio on Pexels.com

When I was working at MathWorks, I had the opportunity to create a demo in MATLAB that provides a simple walkthrough of how to perform a data science workflow on Domino Data Lab‘s MLOps platform. The demo showed how to use climate data from NOAA, to build a simple prediction tool that uses machine learning (ML) regression.

With the goal of telling you whether you should consider buying an air conditioner, the model predicts how many hot days upcoming years hold in store for us. A hot day is defined as one with a temperature over 29° Celsius (or 84° Fahrenheit). You name a location, and the model predicts the number of hot days.

More than two years later and I am now a member of the Domino team. I am also embarking on a new project to demonstrate our deep integration with a major data store partner, and creating the demo in Python this time. This post and subsequent ones will act as my travelogue for the project.

Continue reading “Global Warming: self-learning journey to build the story with data science”
Share
Categories
General

In case your Mac and your scanner stopped talking, read this

I bought my beloved Brother MFC-J6910DW printer/scanner when I started my own small business close to 10 years ago. In that time, Brother not only maintained updates – including for recent Mac OS Big Sur updates, but it keeps chugging along effortlessly to this day.

A couple of months ago I replaced TrendMicro with McAfee as my antivirus software. It was much cheaper and appears to be less obtrusive for my Windows-loving gamer kids. McAfee used to harangue me to turn on a firewall on my Mac (it was on) but then said it was coming soon as part of their security product. It did indeed arrive and I did turn it on, if only to remove the warning from my toolbar.

Yesterday I noticed that the Brother scanner did not work, either using the iPrintAndScan app nor the built-in Apple Image Capture app. A quick search led me to believe it had something to do with the firewall and it is indeed the case.

To solve the problem:

Continue reading “In case your Mac and your scanner stopped talking, read this”
Share
Share