Is functional programming more effective than object-oriented programming?
Imperative vs functional programming. It’s a debate that goes back to the birth of high-level languages—Fortran vs Lisp. In later years, it was retreaded as object-oriented vs function programming (OOP vs FP)—OOP having become the (massively) dominant software development paradigm. And, I’m a fully paid-up member. I embraced Object Pascal via Delphi 1 on 1995 […]
Querying SQL Server Data from Spark with Scala
Spark, as with virtually the entire Hadoop ecosystem, is built with Java, and of course Spark’s shell default programming language, Scala targets the Java Virtual Machine (JVM). For better or for worse, today’s systems involve data from heterogeneous sources, even sources that might at first seem an unnatural fit. Such is the case with reading […]
How to Build a Random Forest Classifier Using Data Frames in Spark
The release of Spark 1.5 increased support for using data frames with MLLib—Spark’s machine learning library. MLlib now divides into two packages spark.mllib which contains the original API built on top of RDDs spark.ml which provides a higher-level API built on top of DataFrames for constructing machine learning pipelines While the spark.mllib package will continue […]