Backprop and SGD From Scratch Part 4

[[my back prop SGD from scratch 2022-Aug]] 16:38 why no learning going on hmm look at this network import network as n import dataset import plot X, Y = dataset.build_dataset_inside_outside_circle(0.5) model = n.initialize_model({"learning_rate": 0.01}) ( loss_vec, model, artifacts, X_validation, Y_validation, Y_prob ) = n.train_network(X, Y, model) 17:02 wondering if I can inspect the gradient, to see if it is pointing where it should 23:02 so for a random weight initialized network, curious at least here the response should be nonlinear right?...

September 3, 2022 · (updated February 26, 2023) · 1 min · 211 words · Michal Piekarczyk

Backprop and SGD From Scratch Part 3

[[my back prop SGD from scratch 2022-Aug]] 12:38 so what happened last time? well let me look at the 2022-08-21.html notes I created. 13:20 darn so ok spent bunch of time figuring out why I couldnt view all the images in that html but basically combination of the html references images in log seq dir and also I have to copy them to my git repo area for this repo....

August 27, 2022 · (updated February 26, 2023) · 4 min · 845 words · Michal Piekarczyk

Mini scikit-learn backwards compatibility story

hmm blah blah test something #publish-this What So I had a particular need to load a #[[scikit learn sklearn]] model trained with 0.20.4 on Databricks 10.4 and ran into some fun details I was not initially able to use the Databricks 10.4 pinned version of scikit-learn , 0.24.x because of course there were #backwards-compatibility issues where trying to load the model gave me an error saying that ModuleNotFoundError: No module named 'sklearn....

July 12, 2022 · (updated February 26, 2023) · 2 min · 377 words · Michal Piekarczyk

Tracck those daily permanents

will this work? when blog vimeo 2022-04-10 foo yea – – – hope so

April 10, 2022 · (updated February 26, 2023) · 1 min · 14 words · Michal Piekarczyk

Remember to Floss Your Batteries

Today I thought it would take me maybe half an hour to replace my laptop battery. I got a replacement in the mail. Actually funny enough they are called the “function keys” battery because there are three cells . Anyway, turns out they are glued to the inside and you need some kind of epoxy loosener. I randomly stumbled on this video someone put together using some kind of wax line to actually remove batteries....

January 29, 2022 · (updated February 26, 2023) · 1 min · 102 words · Michal Piekarczyk