Big Data Senior Developer Jobs Opening in A Client of Freshersworld at PalwalLess
Big Data Senior DeveloperJOB DESCRIPTIONUnderstand non-functional requirements and the ability to turn them into Functional/Technical requirements. Then apply the architectural principles to leverage the Spark Framework to reproduce specific use cases and/or features inputs for models.Passion towards automation where appropriate and beneficialUnderstand Data acquisition, Develop data set processes, and knowledge of data conceptsUnderstand the complex transformation logic and translate them to Spark code or Spark-SQL queriesAbility to write reusable code in Scala/Java in Apache SparkHadoop ecosystem (Spark, Hive, HBase, YARN, and Kafka), Spark Core, Spark-SQL, and live streaming datasets using Kafka/Spark StreamingUnix Shell Scripting and knowledge of TWS schedulingCloudera distribution framework, Jenkins (or any version controller)Excellent understanding of technology life cycles and the concepts and practices required to build big data solutionsAbility to understand and build re-usable data assetsUnix Shell Scripting and knowledge of TWS scheduling and Experience in Unix environments with batch scripting and commandsGood to have experience in Distributed storage and computing technologies.
BE/B.Tech