Good benefits, 401k, stock options, and friendly work environment
Stressful workload and lack of staffing added additional responsibilities without increased pay.
• Built complex Terabyte-scale data pipelines and presentation layers using Cascading for consumption by loan performance analysis models. • Extracted TBs of data from SQL Server and Teradata to the... One Lake. • Worked with spark eco system using Spark SQL and Scala queries on different formats like parquet file, CSV file. • Implementing Spark using Scala and Spark SQL for faster testing and processing of data responsible to manage data from different sources
• Big Data Technologies: Hadoop, MapReduce, Hive, Pig, Scoop, Spark, Kafka. • Machine Learning: Classification, Regression, Clustering, Feature engineering, Ensemble Learning • Statistics: Bayesian... analysis, Time series and Multivariate data analysis • Languages: Python, R, SQL, Scala. • No SQL Databases: HBase, Cassandra, MongoDB. • Cloud Platform: Azure, AWS. • DBs & Tools : SQL Server, Azure Data Factory, ETL – SSIS/SSRS/SSAS, Tableau, Power Bi. • Version control: GIT, TFS,Confluence,BitBucket