Discussion about this post

User's avatar
Aaron De Los Reyes's avatar

I just found your article, great breakdown. its a brutal problem getting from concept workflow to real world business or industrial workflow.

My story on a mid-90s ML journey was just as haphazard as yours :)

I'm from LA (nice pic of Santa Monica early Promenade:) & grew-up thru college and left in 1990 (went in the US Army) & when I got out in 1995 was in Boston at the beginning of the new wave of computing (client/server, ML, internet, C++, powerful UNIX & Win NT workstations/servers etc..)

I studied CS/MIS/Engineering undergrad but my real learning was in a awesome/weird program course I took on the side while in the Army, it was 75% paid for by the US Army .. It took me 4yrs to actually complete it but was worth it as I grinded thru it.

NRI School of Computing --https://www.ebay.com/itm/402347864977

(which was a weird correspondence program of 140 booklets & building 2 x SCO Unix PCs while learning Hardware, Networking, Device Drivers, SCO Unix, C, C++, Structured Programming, QBase, SQL Gutpa, DB Connectors etc.. kinda wild)

I had to actually read like 10 CS books to help me thru it and the combined learning was what really made me a UNIX/C/Oracle systems person..

this program really took me down the hardcore path of client/server without realizing it.

When I left active duty Army I was in Boston and started in QA/QC in 1995 at a ML start-up called Unica Technologies that was later sold in late 2000s to IBM..

We had these 8 x monster MIT BS/MS Lincoln Labs engineers that were building a Unix & PC based workstation (remember those:) application..

It was designed around a concept called the "Pattern Recognition Workbench" PRW..

PRW was a analytic application with a massive spreadsheet 16k columns & 16m rows

It could load all in RAM and allow the performance to optimize from cache in large UNIX workstations or small servers.

PRW had Data/file mapping utilities, 100+ stats testing tools, tons of QA/QC tools for data quality

They built a dozen non-parametric algos with 20 or so parametric algos and integrations (old school flat file & point to point, ODBC) into SPSS/SAS/MatLab/Mathematica to mix ML/Stats/Maths etc..

we sold this to big retail, banks, industrial, healthcare

then the fun began.. all that awesome ML/Stats/Math tech hit the wall of how do I make this work in real daily workflow of business processes, industrial apps

I remember our struggle to build dozens of extra modules around PRW to match the actual customer business needs of the processes, workflows steps, back and forth with MS Excel or RDBMSs, MRPs, ERPs, real world mission critical apps in the business that you could not blow away.

this was brutal, we sold and implemented to dozens of customers but was very difficult. Later after I I left Unica pivoted to Marketing Automation and exploded with 1000s of customers and sold itself to IBM in 2009

I left after 2yrs(learned a ton I still use in engineering thinking) and went to PeopleSoft (ERP:) and had a great career in enterprise tech the following 25yrs and have come back into the ML space again and have seen nothing has changed except the founders are just that much more cult like in their one way belief in being right :)

thank you for the article..

Aaron

Expand full comment

No posts