PDS Tech Inc Data Engineer III in Menlo Park, California
PDS TECH INC. is seeking Data Engineer for a 6 Month contract in Menlo Park,CA .
Apply proven expertise and build high-performance, scalable data warehouse application • Securely source external data from numerous global partners • Intelligently design data models for optimal storage and retrieval • Deploy inclusive data quality checks to ensure high quality of data • Optimize existing pipelines and implement new ones, maintenance of all domain-related data pipelines • Ownership of the end-to-end data engineering component of the solution • Collaboration with the program’s SMEs, data scientists
Proficiency in LAMP and the Big Data stack environments (Hadoop, MapReduce, Hive)
Competence with relational databases ( Oracle, MySQL, Vertica )
Experience working with enterprise DE tools (Informatica), & ability to learn in-house DE tolls
Coding and scripting experience with Python, Java, PHP, SQL, CLI
Understanding of the threading limitations in python and multi-process architecture
Developed Etl using python to load data into Oracle/Mysql/Hive
Experience with Tuples and other data types like List, and Pandas modules
Experience in developing module using Python.
Good to have etl experience ( Informatica/datastage etc)
Understanding of Software design patterns, SDLC, Test Driven Development (TDD), Continuous Integration and Continuous Delivery Knowledge of relational, structured, semi-structured and unstructured data systems and when to use each type of system
Agile development experience.
Strong analytical and problem-solving skills
Strong communication and collaboration skills
BS/MS in Computer Science or related technical field
All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, age, marital status, pregnancy, genetic information, or other legally protected status.