Job description

Job description

Top Skills - Must Haves

• Big data

• Spark

• Sql

• java

• data architecture

Top Skills' Details

**Looking for senior level resources that have a strong Java background and need to be self-sufficient**

1. Must have strong experience with Spark/Java-- Java is the preferred coding language.

2. Experience building applications using SQL, Java, SCALA and Spark.

3. Experience with Hadoop/Big Data technologies

Secondary Skills - Nice to Haves

• gcp

• Azure

• scala

Job Description

This team is responsible for ensuring Privacy regulations of Customer Data is up to par with individual states' standards. Walmart's Customer 360 view is continuing to evolve and this team regulates the Customer data migrated into the Data Lake. The goal of this initiative is to reduce the customer footprint within Walmart and to have a single source of customer data.

This includes: regulatory and ethical requirements around data; Data modeling, storage, integration, and warehousing; Data value chains (identification, ingestion, processing, storage, analysis, and utilization); Data quality framework and metrics; Regulatory and ethical requirements around data privacy, security, storage, retention, and documentation; Business implications on data usage.

*Any knowledge of privacy within data is a plus*

--Design, develop and build database to power Big Data analytical systems.

--Design data integration pipeline architecture and ensure successful creation of the infrastructure required for optimal extraction, transformation, and loading of

data from a wide variety of data sources using Spark, SQL, HQL and other technologies.

--Build robust and scalable applications using SQL, Java and Spark.

--Create real time data streaming and processing using Kafka and/or Spark streaming.

--Work on creating data ingestion processes to maintain Global Data lake on Google cloud or Azure

--Engage with architects and senior technical leads to create and enhance complex software components.

--Design, configure and implement systems that can scale to process terabytes of data between heterogeneous systems on premise and cloud.

--Work with business customers, product managers and engineers to design feature-based solutions and implement them in an agile fashion.

--Develop proof-of-concept prototype with fast iteration and experimentation.

--Develop and maintain design documentation, test cases, performance and monitoring and performance evaluation using Git, Crontab, Putty, Jenkins, Maven, --

Confluence, ETL, Automic, Zookeeper, Cluster Manager

--Perform continuous integration and deployment using Jenkins and Git

Additional Skills & Qualifications

GCP is a big plus, Azure is also fine.

Job Type: Contract

Salary: $45.00 - $65.00 per hour

Schedule:

• Monday to Friday

Application Question(s):

• Should work on our company W2

Experience:

• Spark: 5 years (Preferred)
• SQL: 5 years (Preferred)
• Java: 5 years (Preferred)
• Big data: 7 years (Preferred)

Work Location: Remote

www.colinoncars.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, www.colinoncars.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, www.colinoncars.com is the ideal place to find your next job.