CHAPTER III MONOGRAPHTECHNICAL SPECIFICATION
Big Data & DevOps Explorations
A series of laboratory researches into distributed computing architectures and service orchestration.
I. Problem Statement & Operational Challenge
Bridging the gap between monolithic application logic and the distributed requirements of big data platforms.
II. Implementation Strategy
Completed deep-dives into Hadoop HDFS for distributed storage, Spark for in-memory processing, and Spring Boot for microservice development. Focused on HDFS data replication and Spark RDD transformations.
III. Technical Stack & Tooling
Apache SparkHadoopSpring BootDistributed SystemsHDFSMicroservices
IV. Constraints & Edge Cases
V. Operational Outcome & Learnings
Gained specialized knowledge in high-concurrency systems which I now apply to CIBC's enterprise data platforms.